Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Error running PIG 12 with Hadoop 0.23.1.


+
Uttam Kumar 2013-12-02, 19:26
+
Rohini Palaniswamy 2013-12-06, 20:25
Copy link to this message
-
Re: Error running PIG 12 with Hadoop 0.23.1.
Hi Rohini,

Thanks for suggestion. I tried PIG 12 with Hadoop 0.23.9 and it works.

Again, does PG12 works with Hadoop 0.23.1 .... can I replace the lib and
jar files for mapred and yarn folder from 23.9 to 23.1 to resolve the issue
?

I noticed, yarn and  mapred jar files are in separate folder under ver
23.9, but in ver 23.1 it's under combined folder mapread.
Regards,
-Uttam
On Fri, Dec 6, 2013 at 3:25 PM, Rohini Palaniswamy
<[EMAIL PROTECTED]>wrote:

> Can you try with Hadoop 0.23.8 or 0.23.9?
>
> -Rohini
>
>
> On Mon, Dec 2, 2013 at 11:26 AM, Uttam Kumar <[EMAIL PROTECTED]> wrote:
>
> > Hi All,
> >
> > I am trying to run PIG 12 with Hadoop 0.23.1 and getting following error
> > msg, Can someone please help and suggest what I am missing.  I can run
> PIG
> > in local mode without any issue which executes with inbuilt Hadoop.  I
> had
> > recompiled PIG with hadoop 23, but so far no luck in resolving this
> issue.
> >
> > *grunt> A = load 'NYSE_dividends' as (exch, symb, dt, div);*
> > *grunt> dump A ;*
> > ...
> > ...
> >
> >
> > *2013-11-26 13:20:35,975 [JobControl] ERROR
> > org.apache.pig.backend.hadoop23.PigJobControl - Error while trying to run
> > jobs.java.lang.RuntimeException:
> > java.lang.reflect.InvocationTargetException*
> >         at org.apache.pig.backend.hadoop23.PigJobControl.submit(
> > PigJobControl.java:130)
> >         at org.apache.pig.backend.hadoop23.PigJobControl.run(
> > PigJobControl.java:191)
> >         at java.lang.Thread.run(Thread.java:619)
> >         at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.
> > MapReduceLauncher$1.run(MapReduceLauncher.java:270)
> >
> >
> > *Caused by: java.lang.reflect.InvocationTargetException        at
> > sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)        at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)*
> >         at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> > DelegatingMethodAccessorImpl.java:25)
> >         at java.lang.reflect.Method.invoke(Method.java:597)
> >         at org.apache.pig.backend.hadoop23.PigJobControl.submit(
> > PigJobControl.java:128)
> >         ... 3 more
> > Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.
> > getDefaultBlockSize(Lorg/apache/hadoop/fs/Path;)J
> >         at
> org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.
> > getDefaultBlockSize(HadoopShims.java:108)
> >         at org.apache.pig.backend.hadoop.executionengine.
> > mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:277)
> >         at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(
> > JobSubmitter.java:451)
> >         at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(
> > JobSubmitter.java:468)
> >         at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(
> > JobSubmitter.java:360)
> >         at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1221)
> >         at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1218)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:396)
> >         at org.apache.hadoop.security.UserGroupInformation.doAs(
> > UserGroupInformation.java:1177)
> >         at org.apache.hadoop.mapreduce.Job.submit(Job.java:1218)
> >         at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.
> > submit(ControlledJob.java:336)
> >         ... 8 more
> > 2013-11-26 13:20:35,976 [main] INFO  org.apache.pig.backend.hadoop.
> > executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId:
> > job_1385489868206_0001
> >
> > --
> > Regards,
> > Uttam Kumar
> >
>

--
Regards,
Uttam Kumar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB