|
|
Preeti Gupta 2013-02-25, 20:02
Hi,
I need to do some modifications here and need to know how Pig generates DAG. Can someone throw some light on this?
regards
preeti
-
Re: How Pig generates DAG
Alan Gates 2013-02-25, 21:35
Pig generates several DAGs (a logical plan, a physical plan, a set of MapReduce jobs). Which one are you interested in?
Alan.
On Feb 25, 2013, at 12:02 PM, Preeti Gupta wrote:
> Hi, > > I need to do some modifications here and need to know how Pig generates DAG. Can someone throw some light on this? > > regards > > preeti
-
Re: How Pig generates DAG
Preeti Gupta 2013-02-25, 21:39
> a set of MapReduce jobs
On Feb 25, 2013, at 1:35 PM, Alan Gates <[EMAIL PROTECTED]> wrote:
> Pig generates several DAGs (a logical plan, a physical plan, a set of MapReduce jobs). Which one are you interested in? > > Alan. > > On Feb 25, 2013, at 12:02 PM, Preeti Gupta wrote: > >> Hi, >> >> I need to do some modifications here and need to know how Pig generates DAG. Can someone throw some light on this? >> >> regards >> >> preeti >
-
Re: How Pig generates DAG
Alan Gates 2013-02-26, 01:19
In the Pig code base check out src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java and src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java
These are the classes the control the generation of MapReduce jobs.
Alan.
On Feb 25, 2013, at 1:39 PM, Preeti Gupta wrote:
>> a set of MapReduce jobs > > On Feb 25, 2013, at 1:35 PM, Alan Gates <[EMAIL PROTECTED]> wrote: > >> Pig generates several DAGs (a logical plan, a physical plan, a set of MapReduce jobs). Which one are you interested in? >> >> Alan. >> >> On Feb 25, 2013, at 12:02 PM, Preeti Gupta wrote: >> >>> Hi, >>> >>> I need to do some modifications here and need to know how Pig generates DAG. Can someone throw some light on this? >>> >>> regards >>> >>> preeti >> >
|
|