Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # dev >> Re: Heads up: branch-2.1-beta


+
Alejandro Abdelnur 2013-06-20, 15:31
+
Arun C Murthy 2013-06-20, 21:40
+
Roman Shaposhnik 2013-06-20, 05:02
+
Todd Lipcon 2013-06-20, 06:10
+
Suresh Srinivas 2013-06-20, 05:16
+
Arun C Murthy 2013-06-19, 06:58
+
Devaraj k 2013-06-19, 13:13
Copy link to this message
-
Re: Heads up: branch-2.1-beta
Can you please run the tests with -Xms2G added?
Sent from a mobile device

On Jun 20, 2013, at 6:02 PM, Roman Shaposhnik <[EMAIL PROTECTED]> wrote:

> On Thu, Jun 20, 2013 at 5:59 PM, Suresh Srinivas <[EMAIL PROTECTED]> wrote:
>> I still need look at hadoop-env.sh
>
> Bigtopt deployments don't utilize hadoop-env.sh we use /etc/default/hadoop*
> for the more precise configuration.
>
>> I suspect this is due to not passing Xms (starting java heap size) set to same
>> value as Xmx (max java heap size). The recent inode id changes create hash
>> apps based on max heap size and I have seen this problem without Xms.
>
> Here's the output of ps:
>
> $ ps -aelf | grep NameNode
> 0 S hdfs     28482     1  1  80   0 - 661539 futex_ 00:42 ?
> 00:00:13 /usr/java/jdk1.6.0_21/bin/java -Dproc_namenode -Xmx2G
> -Dhadoop.log.dir=/var/log/hadoop-hdfs -Dhadoop.log.file=hadoop.log
> -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs
> -Dhadoop.root.logger=INFO,console
> -Djava.library.path=/usr/lib/hadoop/lib/native
> -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true
> -Dhadoop.log.dir=/var/log/hadoop-hdfs
> -Dhadoop.log.file=hadoop-hdfs-namenode-ip-10-144-82-213.log
> -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs
> -Dhadoop.root.logger=INFO,RFA
> -Djava.library.path=/usr/lib/hadoop/lib/native
> -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true
> -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote
> -Dcom.sun.management.jmxremote -Dhadoop.security.logger=INFO,RFAS
> org.apache.hadoop.hdfs.server.namenode.NameNode
>
>
> Thanks,
> Roman.
+
Suresh Srinivas 2013-06-21, 01:01
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB