Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # dev - Review Request 14505: PIG-3501 Initial implementation of TezJobControlCompiler


Copy link to this message
-
Re: Review Request 14505: PIG-3501 Initial implementation of TezJobControlCompiler
Cheolsoo Park 2013-10-08, 02:36

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/14505/
-----------------------------------------------------------

(Updated Oct. 8, 2013, 2:36 a.m.)
Review request for pig, Daniel Dai, Mark Wagner, and Rohini Palaniswamy.
Changes
-------

Incorporated Mark's comments.
Bugs: PIG-3501
    https://issues.apache.org/jira/browse/PIG-3501
Repository: pig-git
Description
-------

Initial implementation of TezJonControlCompiler that converts tez plan into tez dag. Tez dag is built by TezDagBuilder that is a dependency walker of TezOpPlan. At each node, it creates a tez vertex and connect it to dependent vertices with a tez edge.
Diffs (updated)
-----

  src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java 1d5bf73
  src/org/apache/pig/backend/hadoop/executionengine/tez/DagUtils.java abd71ad
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezJob.java f6a98d0
  src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobControlCompiler.java 213ef33
  src/org/apache/pig/impl/util/Utils.java b5cffcf

Diff: https://reviews.apache.org/r/14505/diff/
Testing
-------

Added unit test cases to TestTezJobControlCompiler.
Thanks,

Cheolsoo Park