Hi All,

What would be a good starting point for me to understand the various Join
implementations in Pig codebase?

Thanks,
Prashant

You can start here :
http://squarecog.wordpress.com/2009/11/03/apache-pig-apittsburgh-hadoop-user-group/

Thanks,
Ashutosh

On Tue, Nov 13, 2012 at 3:20 PM, Prashant Kommireddi <[EMAIL PROTECTED]>wrote:

> Hi All,
>
> What would be a good starting point for me to understand the various Join
> implementations in Pig codebase?
>
> Thanks,
> Prashant
>

Thanks Jon, Ashutosh.
On Tue, Nov 13, 2012 at 7:01 PM, Ashutosh Chauhan <[EMAIL PROTECTED]>wrote:

> You can start here :
>
> http://squarecog.wordpress.com/2009/11/03/apache-pig-apittsburgh-hadoop-user-group/
>
> Thanks,
> Ashutosh
>
> On Tue, Nov 13, 2012 at 3:20 PM, Prashant Kommireddi <[EMAIL PROTECTED]
> >wrote:
>
> > Hi All,
> >
> > What would be a good starting point for me to understand the various Join
> > implementations in Pig codebase?
> >
> > Thanks,
> > Prashant
> >
>

A key class that aids in understanding how the physical layer works is the
LogToPhyTranslationVisitor. You can look at the visitor for the LOJoin
logical operator and see what it does for different join types (FRJoin
being the easier).

The code around plan generation is IMHO some of the most difficult to
understand in Pig, so if you can get your head around how to take the
logical plan and stitch together an optimized join (ie skewed join) then it
will be much easier to debug errors in the physical plan, and potentially
make new operators.
2012/11/13 Prashant Kommireddi <[EMAIL PROTECTED]>

> Hi All,
>
> What would be a good starting point for me to understand the various Join
> implementations in Pig codebase?
>
> Thanks,
> Prashant
>