Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # dev >> [jira] [Resolved] (PIG-3742) Set MR runtime settings on tez runtime


Copy link to this message
-
[jira] [Resolved] (PIG-3742) Set MR runtime settings on tez runtime

     [ https://issues.apache.org/jira/browse/PIG-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy resolved PIG-3742.
-------------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed

Committed to tez branch. Thanks Daniel for the review. TestTezCompiler is failing. But not related to this patch. Will fix that in PIG-3748.

> Set MR runtime settings on tez runtime
> --------------------------------------
>
>                 Key: PIG-3742
>                 URL: https://issues.apache.org/jira/browse/PIG-3742
>             Project: Pig
>          Issue Type: Sub-task
>          Components: tez
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: tez-branch
>
>         Attachments: PIG-3742-3.patch
>
>
> Classify whether a vertex is a map or reduce and set java.opts (mapreduce.map.java.opts or mapreduce.reduce.java.opts), memory.mb (mapreduce.map.memory.mb or mapreduce.reduce.memory.mb) and env (mapreduce.map.env or mapreduce.reduce.env) accordingly on the vertex. A simple thing would be to assume all root vertexes to be map vertexes and intermediate or leaf vertexes to be reduce vertexes.

--
This message was sent by Atlassian JIRA
(v6.1.5#6160)