Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> High load on datanode startup


Copy link to this message
-
Re: High load on datanode startup
When you say 'load', what do you mean? CPU load or something else?

Raj

>________________________________
> From: Darrell Taylor <[EMAIL PROTECTED]>
>To: [EMAIL PROTECTED]
>Sent: Wednesday, May 9, 2012 9:52 AM
>Subject: High load on datanode startup
>
>Hi,
>
>I wonder if someone could give some pointers with a problem I'm having?
>
>I have a 7 machine cluster setup for testing and we have been pouring data
>into it for a week without issue, have learnt several thing along the way
>and solved all the problems up to now by searching online, but now I'm
>stuck.  One of the data nodes decided to have a load of 70+ this morning,
>stopping datanode and tasktracker brought it back to normal, but every time
>I start the datanode again the load shoots through the roof, and all I get
>in the logs is :
>
>STARTUP_MSG: Starting DataNode
>
>
>STARTUP_MSG:   host = pl464/10.20.16.64
>
>
>STARTUP_MSG:   args = []
>
>
>STARTUP_MSG:   version = 0.20.2-cdh3u3
>
>
>STARTUP_MSG:   build >file:///data/1/tmp/nightly_2012-03-20_13-13-48_3/hadoop-0.20-0.20.2+923.197-1~squeeze
>-************************************************************/
>
>
>2012-05-09 16:12:05,925 INFO
>org.apache.hadoop.security.UserGroupInformation: JAAS Configuration already
>set up for Hadoop, not re-installing.
>
>2012-05-09 16:12:06,139 INFO
>org.apache.hadoop.security.UserGroupInformation: JAAS Configuration already
>set up for Hadoop, not re-installing.
>
>Nothing else.
>
>The load seems to max out only 1 of the CPUs, but the machine becomes
>*very* unresponsive
>
>Anybody got any pointers of things I can try?
>
>Thanks
>Darrell.
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB