Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - AvroStorage Issue in 0.9.2-cdh4.0.0 -- Schema is unknown


Copy link to this message
-
Re: AvroStorage Issue in 0.9.2-cdh4.0.0 -- Schema is unknown
Russell Jurney 2012-06-15, 18:59
In my experience, AvroStorage only really works reliably in Pig 0.10.
I believe CDH will have Pig 0.10 in v4.1. I suggest you upgrade to
v0.10 manually now, and if your data still won't load, please file a
JIRA.

Russell Jurney http://datasyndrome.com

On Jun 15, 2012, at 1:50 AM, Markus Resch <[EMAIL PROTECTED]> wrote:

> Hey all,
>
> we're currently testing to switch over from CDH3 to CDH4.
> When I try to read my Avro input data I get en Schema unknown Error:
>
> bash-3.2$ pig
> 12/06/15 08:48:08 WARN pig.Main: Cannot write to log
> file: /usr/lib/pig/pig_1339750088923.log
> 2012-06-15 08:48:09,415 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
> Connecting to hadoop file system at: file:///
> 2012-06-15 08:48:09,421 [main] WARN
> org.apache.hadoop.conf.Configuration - fs.default.name is deprecated.
> Instead, use fs.defaultFS
> 2012-06-15 08:48:09,747 [main] WARN
> org.apache.hadoop.conf.Configuration - fs.default.name is deprecated.
> Instead, use fs.defaultFS
> grunt> REGISTER /usr/lib/pig/contrib/piggybank/java/piggybank.jar;
> grunt> dataImport = LOAD '/our/path/to/our/data/data.avro' USING
> org.apache.pig.piggybank.storage.avro.AvroStorage ();
> grunt> describe
> dataImport;
> Schema for dataImport unknown.
>
> Is this somehow a known issue or do I make something wrong?
>
> Thanks
> Markus
>
>
>