|
|
Visioner Sadak 2012-10-05, 08:09
Is ther a relation between HADOOP_HEAPSIZE mapred.child.java.opts and mapred.child.ulimit settings in hadoop-env.sh and mapred-site.xml i have a sinngle machine with 2gb ram and running hadoop on psuedo distr mode my HADOOP_HEAPSIZE is set to 256 wat shud i set mapred.child.java.opts and mapred.child.ulimit and how these settings are calculated if my ram is incresed or machine clusters are increased
+
Visioner Sadak 2012-10-05, 08:09
-
Re: hadoop memory settings
Visioner Sadak 2012-10-05, 08:17
coz i m getting Error occurred during initialization of VM hadoop java.lang.Throwable: Child Error At org.apache.hadoop.mapred.TaskRunner.run whe running a job.....:)
On Fri, Oct 5, 2012 at 1:39 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:
> Is ther a relation between HADOOP_HEAPSIZE mapred.child.java.opts and > mapred.child.ulimit settings in hadoop-env.sh and mapred-site.xml i have a > sinngle machine with 2gb ram and running hadoop on psuedo distr mode my > HADOOP_HEAPSIZE is set to 256 wat shud i set mapred.child.java.opts and > mapred.child.ulimit and how these settings are calculated if my ram is > incresed or machine clusters are increased
+
Visioner Sadak 2012-10-05, 08:17
-
Re: hadoop memory settings
Bejoy KS 2012-10-05, 11:08
Hi Sadak
AFAIK HADOOP_HEAPSIZE determines the jvm size of the daemons like NN,JT,TT,DN etc.
mapred.child.java.opts and mapred.child.ulimit is used to set the jvm heap for child jvms launched for each map/reduce task launched.
Regards Bejoy KS
Sent from handheld, please excuse typos.
-----Original Message----- From: Visioner Sadak <[EMAIL PROTECTED]> Date: Fri, 5 Oct 2012 13:47:24 To: <[EMAIL PROTECTED]> Reply-To: [EMAIL PROTECTED] Subject: Re: hadoop memory settings
coz i m getting Error occurred during initialization of VM hadoop java.lang.Throwable: Child Error At org.apache.hadoop.mapred.TaskRunner.run whe running a job.....:)
On Fri, Oct 5, 2012 at 1:39 PM, Visioner Sadak <[EMAIL PROTECTED]>wrote:
> Is ther a relation between HADOOP_HEAPSIZE mapred.child.java.opts and > mapred.child.ulimit settings in hadoop-env.sh and mapred-site.xml i have a > sinngle machine with 2gb ram and running hadoop on psuedo distr mode my > HADOOP_HEAPSIZE is set to 256 wat shud i set mapred.child.java.opts and > mapred.child.ulimit and how these settings are calculated if my ram is > incresed or machine clusters are increased
+
Bejoy KS 2012-10-05, 11:08
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext