Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Pig version mismatch after setting PIG_HADOOP_VERSION


Copy link to this message
-
RE: Pig version mismatch after setting PIG_HADOOP_VERSION
The pig.jar is bundled with a hadoop.jar. From the error message, it
appears that the hadoop.jar bundled with the pig.jar has a higher minor
version of hadoop.

Santhosh

-----Original Message-----
From: George Pang [mailto:[EMAIL PROTECTED]]
Sent: Sunday, July 19, 2009 10:54 PM
To: [EMAIL PROTECTED]
Subject: Re: Pig version mismatch after setting PIG_HADOOP_VERSION

Hi Jeff,

When you say server and client, do you mean my master machine and slave
machine?

And my master and slave share the same version of hadoop, I copied and
pasted from the same flash drive.

Thank you,

George

2009/7/19 zhang jianfeng <[EMAIL PROTECTED]>

> It looks like the versions of client and server is not the same.
>
> This is version number explanation from hadoop source code:
>
>   * Version 6: change the counters representation for HADOOP-2248
>   * Version 7: added getAllJobs for HADOOP-2487
>   * Version 8: change {job|task}id's to use corresponding objects
rather
> that strings.
>   * Version 9: change the counter representation for HADOOP-1915
>   * Version 10: added getSystemDir for HADOOP-3135
>   * Version 11: changed JobProfile to include the queue name for
> HADOOP-3698
>   * Version 12: Added getCleanupTaskReports and
>   *             cleanupProgress to JobStatus as part of HADOOP-3150
>   * Version 13: Added getJobQueueInfos and getJobQueueInfo(queue name)
>   *             and getAllJobs(queue) as a part of HADOOP-3930
>   * Version 14: Added setPriority for HADOOP-4124
>   * Version 15: Added KILLED status to JobStatus as part of
> HADOOP-3924
>   * Version 16: Added getSetupTaskReports and
>
> You'd better copy the same version hadoop to server and client to make
them
> consistent.
>
>
> Jeff Zhang
>
> On Mon, Jul 20, 2009 at 11:56 AM, George Pang <[EMAIL PROTECTED]>
wrote:
>
> > Yes, it is, and it was fine with a single-node cluster.
> >
> > George
> >
> > 2009/7/19 zhangjiayin <[EMAIL PROTECTED]>
> >
> > > George Pang wrote:
> > >
> > >> Dear users,
> > >>
> > >> My pig 0.3.0 and hadoop-0.18.3 worked fine with single node
cluster,
> but
> > >> after I change to a 2 - nodes cluster, I got this error as I ran
pig:
> > >>
> > >> *org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
> > >> org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch.
> (client
> > > > >> 11, server = 10)*
> > >>
> > >> Among my environment variables:  PIG_HADOOP_VERSION=18
> > >>
> > >> Did I miss any thing?  Thank you in advance.
> > >>
> > >> George
> > >>
> > >>
> > >>
> > > do you sure the  hadoop  run in  cluster  is  hadoop-0.18.3
> > >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB