Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # dev >> Re: Heads up: branch-2.1-beta


+
Alejandro Abdelnur 2013-06-20, 15:31
+
Arun C Murthy 2013-06-20, 21:40
+
Roman Shaposhnik 2013-06-20, 05:02
+
Todd Lipcon 2013-06-20, 06:10
+
Suresh Srinivas 2013-06-20, 05:16
+
Arun C Murthy 2013-06-19, 06:58
+
Devaraj k 2013-06-19, 13:13
Copy link to this message
-
Re: Heads up: branch-2.1-beta
Can you please run the tests with -Xms2G added?
Sent from a mobile device

On Jun 20, 2013, at 6:02 PM, Roman Shaposhnik <[EMAIL PROTECTED]> wrote:

> On Thu, Jun 20, 2013 at 5:59 PM, Suresh Srinivas <[EMAIL PROTECTED]> wrote:
>> I still need look at hadoop-env.sh
>
> Bigtopt deployments don't utilize hadoop-env.sh we use /etc/default/hadoop*
> for the more precise configuration.
>
>> I suspect this is due to not passing Xms (starting java heap size) set to same
>> value as Xmx (max java heap size). The recent inode id changes create hash
>> apps based on max heap size and I have seen this problem without Xms.
>
> Here's the output of ps:
>
> $ ps -aelf | grep NameNode
> 0 S hdfs     28482     1  1  80   0 - 661539 futex_ 00:42 ?
> 00:00:13 /usr/java/jdk1.6.0_21/bin/java -Dproc_namenode -Xmx2G
> -Dhadoop.log.dir=/var/log/hadoop-hdfs -Dhadoop.log.file=hadoop.log
> -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs
> -Dhadoop.root.logger=INFO,console
> -Djava.library.path=/usr/lib/hadoop/lib/native
> -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true
> -Dhadoop.log.dir=/var/log/hadoop-hdfs
> -Dhadoop.log.file=hadoop-hdfs-namenode-ip-10-144-82-213.log
> -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs
> -Dhadoop.root.logger=INFO,RFA
> -Djava.library.path=/usr/lib/hadoop/lib/native
> -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true
> -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote
> -Dcom.sun.management.jmxremote -Dhadoop.security.logger=INFO,RFAS
> org.apache.hadoop.hdfs.server.namenode.NameNode
>
>
> Thanks,
> Roman.
+
Suresh Srinivas 2013-06-21, 01:01