Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Pig version mismatch after setting PIG_HADOOP_VERSION


Copy link to this message
-
RE: Pig version mismatch after setting PIG_HADOOP_VERSION
Santhosh Srinivasan 2009-07-20, 05:59
The pig.jar is bundled with a hadoop.jar. From the error message, it
appears that the hadoop.jar bundled with the pig.jar has a higher minor
version of hadoop.

Santhosh

-----Original Message-----
From: George Pang [mailto:[EMAIL PROTECTED]]
Sent: Sunday, July 19, 2009 10:54 PM
To: [EMAIL PROTECTED]
Subject: Re: Pig version mismatch after setting PIG_HADOOP_VERSION

Hi Jeff,

When you say server and client, do you mean my master machine and slave
machine?

And my master and slave share the same version of hadoop, I copied and
pasted from the same flash drive.

Thank you,

George

2009/7/19 zhang jianfeng <[EMAIL PROTECTED]>

> It looks like the versions of client and server is not the same.
>
> This is version number explanation from hadoop source code:
>
>   * Version 6: change the counters representation for HADOOP-2248
>   * Version 7: added getAllJobs for HADOOP-2487
>   * Version 8: change {job|task}id's to use corresponding objects
rather
> that strings.
>   * Version 9: change the counter representation for HADOOP-1915
>   * Version 10: added getSystemDir for HADOOP-3135
>   * Version 11: changed JobProfile to include the queue name for
> HADOOP-3698
>   * Version 12: Added getCleanupTaskReports and
>   *             cleanupProgress to JobStatus as part of HADOOP-3150
>   * Version 13: Added getJobQueueInfos and getJobQueueInfo(queue name)
>   *             and getAllJobs(queue) as a part of HADOOP-3930
>   * Version 14: Added setPriority for HADOOP-4124
>   * Version 15: Added KILLED status to JobStatus as part of
> HADOOP-3924
>   * Version 16: Added getSetupTaskReports and
>
> You'd better copy the same version hadoop to server and client to make
them
> consistent.
>
>
> Jeff Zhang
>
> On Mon, Jul 20, 2009 at 11:56 AM, George Pang <[EMAIL PROTECTED]>
wrote:
>
> > Yes, it is, and it was fine with a single-node cluster.
> >
> > George
> >
> > 2009/7/19 zhangjiayin <[EMAIL PROTECTED]>
> >
> > > George Pang wrote:
> > >
> > >> Dear users,
> > >>
> > >> My pig 0.3.0 and hadoop-0.18.3 worked fine with single node
cluster,
> but
> > >> after I change to a 2 - nodes cluster, I got this error as I ran
pig:
> > >>
> > >> *org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol
> > >> org.apache.hadoop.mapred.JobSubmissionProtocol version mismatch.
> (client
> > > > >> 11, server = 10)*
> > >>
> > >> Among my environment variables:  PIG_HADOOP_VERSION=18
> > >>
> > >> Did I miss any thing?  Thank you in advance.
> > >>
> > >> George
> > >>
> > >>
> > >>
> > > do you sure the  hadoop  run in  cluster  is  hadoop-0.18.3
> > >
> >
>