Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # user - Generating Avro files for unit tests


+
meghana narasimhan 2013-01-26, 03:33
Copy link to this message
-
Re: Generating Avro files for unit tests
Cheolsoo Park 2013-01-26, 04:23
Hi Meg,

Can you share what's in /Users/xxxx/pig_1359157245908.log? That will show
what exception was thrown from AvroStorage.

Thanks,
Cheolsoo

On Fri, Jan 25, 2013 at 7:33 PM, meghana narasimhan <
[EMAIL PROTECTED]> wrote:

> Hi All,
>
> I am trying to generate input files using Java. I have raw data in a CSV
> file, which Java reads and then uses GenericDatum/Record to create Avro
> files. The avro file is valid as it is parsed properly by avrocat.
>
>  But, I get this error when I try to load it in Pig grunt :
>
> DEFINE AVRO_STORAGE org.apache.pig.piggybank.storage.avro.AvroStorage();
>
> logdata = LOAD
>
> '/Users/xxxx/Documents/workspace/DP-1147/apache-traffic-export/target/test-classes/output.avro'
> USING AVRO_STORAGE();
>
> 2013-01-25 16:25:06,067 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> ERROR 1200: Pig script failed to parse:
> <line 4, column 10> pig script failed to validate:
> java.lang.RuntimeException: could not instantiate
> 'org.apache.pig.piggybank.storage.avro.AvroStorage' with arguments 'null'
> Details at logfile: /Users/xxxx/pig_1359157245908.log
>
>
> What should I be using instead?
>
> - Meg
>
+
meghana narasimhan 2013-01-26, 04:30
+
Cheolsoo Park 2013-01-26, 05:11
+
meghana narasimhan 2013-01-26, 05:20