Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # dev >> [jira] [Resolved] (PIG-3742) Set MR runtime settings on tez runtime


Copy link to this message
-
[jira] [Resolved] (PIG-3742) Set MR runtime settings on tez runtime

     [ https://issues.apache.org/jira/browse/PIG-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Rohini Palaniswamy resolved PIG-3742.
-------------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed

Committed to tez branch. Thanks Daniel for the review. TestTezCompiler is failing. But not related to this patch. Will fix that in PIG-3748.

> Set MR runtime settings on tez runtime
> --------------------------------------
>
>                 Key: PIG-3742
>                 URL: https://issues.apache.org/jira/browse/PIG-3742
>             Project: Pig
>          Issue Type: Sub-task
>          Components: tez
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: tez-branch
>
>         Attachments: PIG-3742-3.patch
>
>
> Classify whether a vertex is a map or reduce and set java.opts (mapreduce.map.java.opts or mapreduce.reduce.java.opts), memory.mb (mapreduce.map.memory.mb or mapreduce.reduce.memory.mb) and env (mapreduce.map.env or mapreduce.reduce.env) accordingly on the vertex. A simple thing would be to assume all root vertexes to be map vertexes and intermediate or leaf vertexes to be reduce vertexes.

--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB