Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # dev - Pig 0.4.0 release


Copy link to this message
-
RE: Pig 0.4.0 release
Santhosh Srinivasan 2009-08-17, 20:47
Till we release 0.5.0, will zebra's requirement on 0.20 prevent any bugs/issues with Piggybank?

Santhosh

-----Original Message-----
From: Olga Natkovich [mailto:[EMAIL PROTECTED]]
Sent: Monday, August 17, 2009 1:43 PM
To: [EMAIL PROTECTED]
Subject: RE: Pig 0.4.0 release

Hi Santhosh,

What do you mean by "fixing piggybank"?

Olga

-----Original Message-----
From: Santhosh Srinivasan [mailto:[EMAIL PROTECTED]]
Sent: Monday, August 17, 2009 1:37 PM
To: [EMAIL PROTECTED]
Subject: RE: Pig 0.4.0 release

I have a question:

Will we be able to fix piggybank sources given that Zebra needs 0.20 and the rest of Pig requires 0.18?

If the answer is yes then, +1 for the release. I agree with the plan of making 0.4.0 with Hadoop-0.18 and a later release (0.5.0) for Hadoop-0.20.1.

Thanks,
Santhosh

-----Original Message-----
From: Olga Natkovich [mailto:[EMAIL PROTECTED]]
Sent: Monday, August 17, 2009 12:57 PM
To: [EMAIL PROTECTED]
Subject: RE: Pig 0.4.0 release

Hi Dmitry,

Non-committers get a non-binding vote.

Zebra needs Hadoop 20.1 because it is relying on TFile functionality that is not available in Hadoop 20. In general, the recommendation from the Hadoop team is to wait till hadoop 20.1 is released.

For the remainder of the issues, while I see that it would be nice to resolve them, I don't see them as blockers for Pig 0.4.0.

My plan was to release what's currently in the trunk and have a follow up patch releases if needed.

Olga

-----Original Message-----
From: Dmitriy Ryaboy [mailto:[EMAIL PROTECTED]]
Sent: Monday, August 17, 2009 12:04 PM
To: [EMAIL PROTECTED]
Subject: Re: Pig 0.4.0 release

Olga,

Do non-commiters get a vote?

Zebra is in trunk, but relies on 0.20, which is somewhat inconsistent
even if it's in contrib/

Would love to see dynamic (or at least static) shims incorporated into
the 0.4 release (see PIG-660, PIG-924)

There are a couple of bugs still outstanding that I think would need
to get fixed before a release:

https://issues.apache.org/jira/browse/PIG-859
https://issues.apache.org/jira/browse/PIG-925

 I think all of these can be solved within a week; assuming we are
talking about a release after these go into trunk, +1.

-D
On Mon, Aug 17, 2009 at 11:46 AM, Olga Natkovich<[EMAIL PROTECTED]> wrote:
> Pig Developers,
>
>
>
> We have made several significant performance and other improvements over
> the last couple of months:
>
>
>
> (1)     Added an optimizer with several rules
>
> (2)     Introduced skew and merge joins
>
> (3)     Cleaned COUNT and AVG semantics
>
>
>
> I think it is time for another release to make this functionality
> available to users.
>
>
>
> I propose that Pig 0.4.0 is released against Hadoop 18 since most users
> are still using this version. Once Hadoop 20.1 is released, we will roll
> Pig 0.5.0 based on Hadoop 20.
>
>
>
> Please, vote on the proposal by Thursday.
>
>
>
> Olga
>
>