Hi all,

Sorry if this is a trivial question, but i wanted to clarify it before
starting to use pig.

How exactly does pig exploit the mapreduce framework? Is it through the
standard pig commands? and do they all have a mapreduce implementation?
or just some commands only (for example filter seems to be a mapper)?

Thanks,
George

--

---------------------------

George Kousiouris
Electrical and Computer Engineer
Division of Communications,
Electronics and Information Engineering
School of Electrical and Computer Engineering
Tel: +30 210 772 2546
Mobile: +30 6939354121
Fax: +30 210 772 2569
Email: [EMAIL PROTECTED]

National Technical University of Athens
9 Heroon Polytechniou str., 157 73 Zografou, Athens, Greece

Pig Latin programs get translated into a set of physical operators  
which are placed in MapReduce jobs.  Whether a particular operator  
ends up in a map or a reduce depends on a number of factors.  We  
presented a paper at VLDB a few years ago that goes into this in  
detail, http://www.vldb.org/pvldb/2/vldb09-1074.pdf

Alan.

On May 20, 2011, at 5:16 AM, George Kousiouris wrote:

>
> Hi all,
>
> Sorry if this is a trivial question, but i wanted to clarify it before
> starting to use pig.
>
> How exactly does pig exploit the mapreduce framework? Is it through  
> the
> standard pig commands? and do they all have a mapreduce  
> implementation?
> or just some commands only (for example filter seems to be a mapper)?
>
> Thanks,
> George
>
> --
>
> ---------------------------
>
> George Kousiouris
> Electrical and Computer Engineer
> Division of Communications,
> Electronics and Information Engineering
> School of Electrical and Computer Engineering
> Tel: +30 210 772 2546
> Mobile: +30 6939354121
> Fax: +30 210 772 2569
> Email: [EMAIL PROTECTED]
>
> National Technical University of Athens
> 9 Heroon Polytechniou str., 157 73 Zografou, Athens, Greece
>