Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Need info on mapred.child.java.opts, mapred.map.child.java.opts and mapred.reduce.child.java.opts


+
Gaurav Dasgupta 2013-03-08, 10:11
Copy link to this message
-
Re: Need info on mapred.child.java.opts, mapred.map.child.java.opts and mapred.reduce.child.java.opts
Anthony Rojas 2013-03-09, 01:51
Hi Gaurav,

That's correct.  If the following was set:

*mapred.child.java.opts = -Xmx1g*
*mapred.map.child.java.opts = -Xmx2g*
*mapred.reduce.child.java.opts = -Xmx512m*

then:

1) -Xmx2G will be used for map tasks
2) -Xmx512m will be used for reduce tasks
3) the -Xmx1g will be ignored.

Kind Regards,

Anthony Rojas
On Fri, Mar 8, 2013 at 3:22 AM, Gaurav Dasgupta <[EMAIL PROTECTED]> wrote:

> Thanks for replying Harsh.
>
> So, it means that in my case of configuration, *mapred.child.java.opts > -Xmx1g* will be avoided completely and *mapred.map.child.java.opts > -Xmx2g* will be considered for map tasks and*mapred.reduce.child.java.opts = -Xmx512m
> * will be considered for reduce tasks. Right?
>
> Thanks,
> Gaurav
>