Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Generating Avro files for unit tests


Copy link to this message
-
Re: Generating Avro files for unit tests
Yes. Of course.

ERROR 1200: Pig script failed to parse:
<line 2, column 10> pig script failed to validate:
java.lang.RuntimeException: could not instantiate
'org.apache.pig.piggybank.storage.avro.AvroStorage' with arguments 'null'

Failed to parse: Pig script failed to parse:
<line 2, column 10> pig script failed to validate:
java.lang.RuntimeException: could not instantiate
'org.apache.pig.piggybank.storage.avro.AvroStorage' with arguments 'null'
        at
org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:182)
        at org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1570)
        at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1543)
        at org.apache.pig.PigServer.registerQuery(PigServer.java:545)
        at
org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:970)
        at
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
        at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:189)
        at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
        at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
        at org.apache.pig.Main.run(Main.java:490)
        at org.apache.pig.Main.main(Main.java:111)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
Caused by:
<line 2, column 10> pig script failed to validate:
java.lang.RuntimeException: could not instantiate
'org.apache.pig.piggybank.storage.avro.AvroStorage' with arguments 'null'
        at
org.apache.pig.parser.LogicalPlanBuilder.buildLoadOp(LogicalPlanBuilder.java:438)
        at
org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3168)
        at
org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1291)
        at
org.apache.pig.parser.LogicalPlanGenerator.general_statement(LogicalPlanGenerator.java:789)
        at
org.apache.pig.parser.LogicalPlanGenerator.statement(LogicalPlanGenerator.java:507)
        at
org.apache.pig.parser.LogicalPlanGenerator.query(LogicalPlanGenerator.java:382)
        at
org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:175)
        ... 15 more
On Fri, Jan 25, 2013 at 8:23 PM, Cheolsoo Park <[EMAIL PROTECTED]> wrote:

> Hi Meg,
>
> Can you share what's in /Users/xxxx/pig_1359157245908.log? That will show
> what exception was thrown from AvroStorage.
>
> Thanks,
> Cheolsoo
>
> On Fri, Jan 25, 2013 at 7:33 PM, meghana narasimhan <
> [EMAIL PROTECTED]> wrote:
>
> > Hi All,
> >
> > I am trying to generate input files using Java. I have raw data in a CSV
> > file, which Java reads and then uses GenericDatum/Record to create Avro
> > files. The avro file is valid as it is parsed properly by avrocat.
> >
> >  But, I get this error when I try to load it in Pig grunt :
> >
> > DEFINE AVRO_STORAGE org.apache.pig.piggybank.storage.avro.AvroStorage();
> >
> > logdata = LOAD
> >
> >
> '/Users/xxxx/Documents/workspace/DP-1147/apache-traffic-export/target/test-classes/output.avro'
> > USING AVRO_STORAGE();
> >
> > 2013-01-25 16:25:06,067 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> > ERROR 1200: Pig script failed to parse:
> > <line 4, column 10> pig script failed to validate:
> > java.lang.RuntimeException: could not instantiate
> > 'org.apache.pig.piggybank.storage.avro.AvroStorage' with arguments 'null'
> > Details at logfile: /Users/xxxx/pig_1359157245908.log
> >
> >
> > What should I be using instead?
> >
> > - Meg
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB