Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Multiple data node and namenode ?


+
Manish Bhoge 2013-07-25, 06:58
+
Devaraj k 2013-07-25, 07:11
+
Manish Bhoge 2013-07-25, 07:25
Copy link to this message
-
RE: Multiple data node and namenode ?
I could see two data node's log files. But the modified times for both files are different with the difference as 21 mins. I doubt whether they are really running. By any chance have you updated the host name in the machine and then restarted the data node?

Could you check with 'ps -ef | grep datanode' shell command to know how many datanode processes are running at this moment.

Thanks
Devaraj k
-----Original Message-----
From: Manish Bhoge [mailto:[EMAIL PROTECTED]]
Sent: 25 July 2013 12:56
To: [EMAIL PROTECTED]
Subject: Re: Multiple data node and namenode ?

Unfortunately, I don't have JPS installed. But as you can see it shows 2 data nodes.
 hadoop-hdfs-datanode-INBEDU011997A.log 243358 bytes Jul 25, 2013 2:29:15 AM hadoop-hdfs-datanode-myhost-1.log 1893692 bytes Jul 25, 2013 2:50:42 AM
is it because i have given 3 directory under dfs-data.dir in hdfs-site.xml?
________________________________
 From: Devaraj k <[EMAIL PROTECTED]>
To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Sent: Thursday, 25 July 2013 12:41 PM
Subject: RE: Multiple data node and namenode ?
 

Hi Manish,

  Can you check how many data node processes are running really in the machine using the command 'jps' or 'ps'.

Thanks
Devaraj k
-----Original Message-----
From: Manish Bhoge [mailto:[EMAIL PROTECTED]]
Sent: 25 July 2013 12:29
To: [EMAIL PROTECTED]
Subject: Multiple data node and namenode ?

I am configuring cluster and starting with first machine. So i have configured the core-site, hdfs-site and mapred-site to run hadoop only on 1 machine. But somehow i am getting 2 copies of data node, namenode and secondary namenode. Not able to figure out why ?

SecurityAuth-hdfs.audit 0 bytes Jul 17, 2013 4:34:56 AM hadoop-hdfs-datanode-INBEDU011997A.log 243358 bytes Jul 25, 2013 2:29:15 AM hadoop-hdfs-datanode-myhost-1.log 1893692 bytes Jul 25, 2013 2:50:42 AM hadoop-hdfs-namenode-INBEDU011997A.log 19545397 bytes Jul 25, 2013 2:50:40 AM hadoop-hdfs-namenode-myhost-1.log 2438271 bytes Jul 25, 2013 2:48:57 AM hadoop-hdfs-secondarynamenode-INBEDU011997A.log 4061047 bytes Jul 25, 2013 2:30:10 AM hadoop-hdfs-secondarynamenode-myhost-1.log 9707957 bytes Jul 25, 2013 2:46:18 AM
+
manishbhoge@...) 2013-07-25, 08:21
+
Devaraj k 2013-07-25, 08:55
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB