Hi All,

I just noticed that Pig Committer DaiJianYong has mentioned "Cost based optimizer" for pig performanceoptimization.
My question are:
Do we have any plan for this new feature? Like which branch will include this feature?
Is there any task which trace this feature now?

Thanks

Duke has done work around CBOs for Hadoop as part of Starfish and there was
some discussion back in the spring about doing the same for Pig, but I'm
not aware of any concrete plans or JIRAs around that. I'd also be curious
to hear if others have plans to work on this.
On Tue, Dec 4, 2012 at 6:32 PM, lulynn_2008 <[EMAIL PROTECTED]> wrote:

>  Hi All,
>
> I just noticed that Pig Committer DaiJianYong has mentioned "Cost based
> optimizer" for pig performanceoptimization.
> My question are:
> Do we have any plan for this new feature? Like which branch will include
> this feature?
> Is there any task which trace this feature now?
>
> Thanks
>

Not sure for Hadoop but the spark/shark guys have one that works against
hive stats

Don't have any idea how portable it is
Guy

On Thursday, December 6, 2012, Bill Graham wrote:

> Duke has done work around CBOs for Hadoop as part of Starfish and there was
> some discussion back in the spring about doing the same for Pig, but I'm
> not aware of any concrete plans or JIRAs around that. I'd also be curious
> to hear if others have plans to work on this.
>
>
> On Tue, Dec 4, 2012 at 6:32 PM, lulynn_2008 <[EMAIL PROTECTED]<javascript:;>>
> wrote:
>
> >  Hi All,
> >
> > I just noticed that Pig Committer DaiJianYong has mentioned "Cost based
> > optimizer" for pig performanceoptimization.
> > My question are:
> > Do we have any plan for this new feature? Like which branch will include
> > this feature?
> > Is there any task which trace this feature now?
> >
> > Thanks
> >
>

I am not aware of any work going on for this or plans in this area at the moment.

Alan.

On Dec 4, 2012, at 6:32 PM, lulynn_2008 wrote:

> Hi All,
>
> I just noticed that Pig Committer DaiJianYong has mentioned "Cost based optimizer" for pig performanceoptimization.
> My question are:
> Do we have any plan for this new feature? Like which branch will include this feature?
> Is there any task which trace this feature now?
>
> Thanks