I was wondering if there was any documentation around (or if anyone simply
knew) which versions of pig work with which versions of Hadoop? We are now
using 0.20.2 CDH3 and it is not compatible with the pig trunk...I'm hoping
to understand why.

Thanks
Jon

We, the Yahoo Pig team, test Pig against 0.20.2 Hadoop and the  
internal Yahoo version of Hadoop (hopefully soon to be released  
through Apache as 0.20.203).  My impression of CHD3 was that it was  
very close to 0.20.203 with HDFS append added.  The Cloudera guys  
would better be able to answer what changes in CDH3 make it not  
compatible with Pig trunk.  They also give a list of patches that they  
apply that makes their release different from the official Apache  
version.  You could look through the patches they applied to Pig 0.8  
to see what they needed to make it work with their version of 0.20.

Alan.

On May 3, 2011, at 8:13 AM, Jonathan Coveney wrote:

> I was wondering if there was any documentation around (or if anyone  
> simply
> knew) which versions of pig work with which versions of Hadoop? We  
> are now
> using 0.20.2 CDH3 and it is not compatible with the pig trunk...I'm  
> hoping
> to understand why.
>
> Thanks
> Jon

Thanks Alan

2011/5/3 Alan Gates <[EMAIL PROTECTED]>

> We, the Yahoo Pig team, test Pig against 0.20.2 Hadoop and the internal
> Yahoo version of Hadoop (hopefully soon to be released through Apache as
> 0.20.203).  My impression of CHD3 was that it was very close to 0.20.203
> with HDFS append added.  The Cloudera guys would better be able to answer
> what changes in CDH3 make it not compatible with Pig trunk.  They also give
> a list of patches that they apply that makes their release different from
> the official Apache version.  You could look through the patches they
> applied to Pig 0.8 to see what they needed to make it work with their
> version of 0.20.
>
> Alan.
>
>
> On May 3, 2011, at 8:13 AM, Jonathan Coveney wrote:
>
>  I was wondering if there was any documentation around (or if anyone simply
>> knew) which versions of pig work with which versions of Hadoop? We are now
>> using 0.20.2 CDH3 and it is not compatible with the pig trunk...I'm hoping
>> to understand why.
>>
>> Thanks
>> Jon
>>
>
>

Cloudera has a list of compatible packages and changes -
https://ccp.cloudera.com/display/DOC/Downloading+CDH+Releases

Hi Jonathan,

I compiled Pig trunk jarwithouthadoop.jar and it works fine with CDH3 (Add
CDH3 libs to classpath).
I think CDH3 pig version is 0.7.

Thanks,
Aniket

On Tue, May 3, 2011 at 9:34 AM, Jonathan Coveney <[EMAIL PROTECTED]> wrote:

> Thanks Alan
>
> 2011/5/3 Alan Gates <[EMAIL PROTECTED]>
>
> > We, the Yahoo Pig team, test Pig against 0.20.2 Hadoop and the internal
> > Yahoo version of Hadoop (hopefully soon to be released through Apache as
> > 0.20.203).  My impression of CHD3 was that it was very close to 0.20.203
> > with HDFS append added.  The Cloudera guys would better be able to answer
> > what changes in CDH3 make it not compatible with Pig trunk.  They also
> give
> > a list of patches that they apply that makes their release different from
> > the official Apache version.  You could look through the patches they
> > applied to Pig 0.8 to see what they needed to make it work with their
> > version of 0.20.
> >
> > Alan.
> >
> >
> > On May 3, 2011, at 8:13 AM, Jonathan Coveney wrote:
> >
> >  I was wondering if there was any documentation around (or if anyone
> simply
> >> knew) which versions of pig work with which versions of Hadoop? We are
> now
> >> using 0.20.2 CDH3 and it is not compatible with the pig trunk...I'm
> hoping
> >> to understand why.
> >>
> >> Thanks
> >> Jon
> >>
> >
> >
>

--
"...:::Aniket:::... Quetzalco@tl"