Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Pig 0.9.2 and avro on S3


+
meghana narasimhan 2012-11-30, 20:59
Copy link to this message
-
Re: Pig 0.9.2 and avro on S3
Oh I should also mention piggybank : 0.9.2-cdh4.0.1
On Fri, Nov 30, 2012 at 12:59 PM, meghana narasimhan <
[EMAIL PROTECTED]> wrote:

> Hi all,
>
> Is this bug https://issues.apache.org/jira/browse/PIG-2540 applicable to
> plain ec2 instances as well. I seem to have hit a snag with Apache Pig
> version 0.9.2-cdh4.0.1 (rexported) and avro files on S3. My hadoop cluster
> is made of Amazon ec2 instances.
>
> Here is my load statement :
>
> dimRad = LOAD 's3n://credentials@bucket/dimensions/2012/11/29/20121129-000159123456/dim'
> USING
>   AVRO_STORAGE AS
>    (a:int
>   , b:chararray
>   );
>
> and it gives me a :
>
> 2012-11-30 20:42:44,205 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> ERROR 1200: Wrong FS: s3n://credentials@bucket/dimensions/2012/11/29/20121129-000159123456/dim,
> expected: hdfs://ec2-1xxxx.compute-1.amazonaws.com:8020
>
>
> Thanks,
> Meg
>
+
William Oberman 2012-11-30, 21:09
+
William Oberman 2012-11-30, 21:11
+
meghana narasimhan 2012-11-30, 21:15
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB