Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Error with Pig (CDH4.0.0)


Copy link to this message
-
Re: Error with Pig (CDH4.0.0)
Typo: should NOT be visible.

On Tue, Oct 9, 2012 at 4:31 PM, Cheolsoo Park <[EMAIL PROTECTED]> wrote:

> Please note that there was an internal change in the Pig query parser from
> 0.8 to 0.9, but this change should be visible to the end user:
> https://issues.apache.org/jira/browse/PIG-1618
>
> Given your call stack, my best guess is that the old version of pig jar is
> present in classpath and causes trouble. Can you verify that PIG_HOME
> points to where the CDH4.0.0 pig is installed, and the old pig is not
> present in classpath?
>
> Thanks,
> Cheolsoo
>
> On Tue, Oct 9, 2012 at 4:15 PM, Cheolsoo Park <[EMAIL PROTECTED]>wrote:
>
>> Hi Dhaval,
>>
>> That certainly works for me.
>>
>> How did you upgrade CDH? Did you install it via RPMs? Did you completely
>> uninstall CDH3u3 before installing CDH4?
>>
>> It sounds to me like a CDH-upgrade issue rather than Pig issue. Can you
>> please provide steps that you took to upgrade CDH?
>>
>> Thanks,
>> Cheolsoo
>>
>> On Tue, Oct 9, 2012 at 4:02 PM, Dhaval Shah <[EMAIL PROTECTED]>wrote:
>>
>>> Thanks for getting back Cheolsoo..
>>>
>>> All I am trying to do is run the pig shell/grunt and do this:
>>> p = LOAD 'file_name';
>>>
>>> It comes back with the exception mentioned below..
>>>
>>> Regards,
>>> Dhaval
>>>
>>>
>>> ----- Original Message -----
>>> From: Cheolsoo Park <[EMAIL PROTECTED]>
>>> To: [EMAIL PROTECTED]; Dhaval Shah <[EMAIL PROTECTED]>
>>> Cc:
>>> Sent: Tuesday, 9 October 2012 6:57 PM
>>> Subject: Re: Error with Pig (CDH4.0.0)
>>>
>>> Hi Dhaval,
>>>
>>> CDH3u3 includes Pig 0.8, and CDH4.0.0 includes Pig 0.9. There were
>>> some incompatibilities introduced between two version.
>>>
>>>
>>> https://cwiki.apache.org/confluence/display/PIG/Pig+0.9+Backward+Compatibility
>>>
>>> To pin down the exact cause, I'd like to reproduce your error. Would
>>> mind providing an example script that generates the exception?
>>>
>>> Thanks,
>>> Cheolsoo
>>>
>>> On Tue, Oct 9, 2012 at 3:29 PM, Dhaval Shah <[EMAIL PROTECTED]
>>> >wrote:
>>>
>>> > Hi everyone.. We just upgraded to CDH4.0.0 and are seeing a very weird
>>> > issue with Pig.. Everytime I try to run a LOAD command, it dies with
>>> the
>>> > following exception:
>>> >
>>> > ERROR 2998: Unhandled internal error. name
>>> >
>>> > java.lang.NoSuchFieldError: name
>>> >         at
>>> >
>>> org.apache.pig.parser.QueryParserStringStream.<init>(QueryParserStringStream.java:32)
>>> >         at
>>> >
>>> org.apache.pig.parser.QueryParserDriver.tokenize(QueryParserDriver.java:194)
>>> >         at
>>> >
>>> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:162)
>>> >         at
>>> > org.apache.pig.PigServer$Graph.validateQuery(PigServer.java:1609)
>>> >         at
>>> > org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1582)
>>> >         at org.apache.pig.PigServer.registerQuery(PigServer.java:584)
>>> >         at
>>> > org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:967)
>>> >         at
>>> >
>>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:386)
>>> >         at
>>> >
>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:189)
>>> >         at
>>> >
>>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:165)
>>> >         at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:69)
>>> >         at org.apache.pig.Main.run(Main.java:495)
>>> >         at org.apache.pig.Main.main(Main.java:111)
>>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> >         at
>>> >
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>> >         at
>>> >
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>> >         at java.lang.reflect.Method.invoke(Method.java:597)
>>> >         at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
>>> >
>>> > The same script/command worked fine with CDH3U3.. Did any APIs change?