Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # dev - [jira] [Commented] (PIG-3742) Set MR runtime settings on tez runtime


Copy link to this message
-
[jira] [Commented] (PIG-3742) Set MR runtime settings on tez runtime
"Rohini Palaniswamy 2014-02-06, 23:42

    [ https://issues.apache.org/jira/browse/PIG-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13893987#comment-13893987 ]

Rohini Palaniswamy commented on PIG-3742:
-----------------------------------------

This patch also creates the tez staging directory under Pig temporary directory so that it gets cleaned up and we don't have to wait for TEZ-793.

> Set MR runtime settings on tez runtime
> --------------------------------------
>
>                 Key: PIG-3742
>                 URL: https://issues.apache.org/jira/browse/PIG-3742
>             Project: Pig
>          Issue Type: Sub-task
>          Components: tez
>            Reporter: Rohini Palaniswamy
>            Assignee: Rohini Palaniswamy
>             Fix For: tez-branch
>
>         Attachments: PIG-3742-3.patch
>
>
> Classify whether a vertex is a map or reduce and set java.opts (mapreduce.map.java.opts or mapreduce.reduce.java.opts), memory.mb (mapreduce.map.memory.mb or mapreduce.reduce.memory.mb) and env (mapreduce.map.env or mapreduce.reduce.env) accordingly on the vertex. A simple thing would be to assume all root vertexes to be map vertexes and intermediate or leaf vertexes to be reduce vertexes.

--
This message was sent by Atlassian JIRA
(v6.1.5#6160)