Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> DataNode is shutting down


Copy link to this message
-
Re: DataNode is shutting down
May be master / slave file in conf directory is over written with new data nodes address.
Instead it should be appended.
G Sudha Sadasivam

--- On Wed, 10/14/09, yibo820217 <[EMAIL PROTECTED]> wrote:
From: yibo820217 <[EMAIL PROTECTED]>
Subject: DataNode is shutting down
To: [EMAIL PROTECTED]
Date: Wednesday, October 14, 2009, 11:41 AM

hi all,there is my problem.
when add a datanode to hadoop,the way is;
1.in namenode add the new datanode to conf/slave

2.in new datanode cd $HADOOP_HOME then
$ bin/hadoop-daemon.sh start datanode
$ bin/hadoop-daemon.sh start tasktracker

3.in namenode,
$bin/hadoop  balancer

and the new datanode is added to hadoop,but a old datanode is shutdown
and here is the logs in datanode which is shutdown

2009-10-14 13:16:30,604 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: BlockReport of 3 blocks got
processed in 5 msecs
2009-10-14 13:48:44,395 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action:
DNA_REGISTER
2009-10-14 13:48:47,402 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action:
DNA_REGISTER
2009-10-14 13:48:50,403 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action:
DNA_REGISTER
2009-10-14 13:48:53,407 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action:
DNA_REGISTER
2009-10-14 13:48:56,418 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action:
DNA_REGISTER
2009-10-14 13:48:59,415 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: DatanodeCommand action:
DNA_REGISTER
2009-10-14 13:49:02,420 WARN
org.apache.hadoop.hdfs.server.datanode.DataNode: DataNode is shutting down:
org.apache.hadoop.ipc.RemoteException:
org.apache.hadoop.hdfs.protocol.UnregisteredDatanodeException: Data node
100.207.100.33:50010 is attempting to report storage ID
DS-1277539940-100.207.100.33-50010-1255486116525. Node 100.207.100.25:50010
is expected to serve this storage.
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getDatanode(FSNamesystem.java:3914)
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.processReport(FSNamesystem.java:2885)
        at
org.apache.hadoop.hdfs.server.namenode.NameNode.blockReport(NameNode.java:715)
        at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:959)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:955)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:953)

        at org.apache.hadoop.ipc.Client.call(Client.java:739)
        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
        at $Proxy4.blockReport(Unknown Source)
        at
org.apache.hadoop.hdfs.server.datanode.DataNode.offerService(DataNode.java:756)
        at
org.apache.hadoop.hdfs.server.datanode.DataNode.run(DataNode.java:1186)
        at java.lang.Thread.run(Thread.java:619)

2009-10-14 13:49:02,527 INFO org.apache.hadoop.ipc.Server: Stopping server
on 50020
2009-10-14 13:49:02,528 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 50020: exiting
2009-10-14 13:49:02,529 INFO org.apache.hadoop.ipc.Server: Stopping IPC
Server Responder
2009-10-14 13:49:02,529 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Waiting for threadgroup to
exit, active threads is 1
2009-10-14 13:49:02,528 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 50020: exiting
2009-10-14 13:49:02,528 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 50020: exiting
2009-10-14 13:49:02,529 WARN
org.apache.hadoop.hdfs.server.datanode.DataNode:
DatanodeRegistration(10.207.0.33:50010,
storageID=DS-1277539940-100.207.100.33-50010-1255486116525, infoPort=50075,
ipcPort=50020):DataXceiveServer:
java.nio.channels.AsynchronousCloseException
        at
java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:185)
        at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:152)
        at
sun.nio.ch.ServerSocketAdaptor.accept(ServerSocketAdaptor.java:84)
        at
org.apache.hadoop.hdfs.server.datanode.DataXceiverServer.run(DataXceiverServer.java:130)
        at java.lang.Thread.run(Thread.java:619)

2009-10-14 13:49:02,530 INFO org.apache.hadoop.ipc.Server: Stopping IPC
Server listener on 50020
2009-10-14 13:49:03,267 INFO
org.apache.hadoop.hdfs.server.datanode.DataBlockScanner: Exiting
DataBlockScanner thread.
2009-10-14 13:49:03,530 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Waiting for threadgroup to
exit, active threads is 0
2009-10-14 13:49:03,635 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode:
DatanodeRegistration(10.207.0.33:50010,
storageID=DS-1277539940-100.207.100.33-50010-1255486116525, infoPort=50075,
ipcPort=50020):Finishing DataNode in:
FSDataset{dirpath='/data0/hadoop/hadoopfs/data/current'}
2009-10-14 13:49:03,635 INFO org.apache.hadoop.ipc.Server: Stopping server
on 50020
2009-10-14 13:49:03,635 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: Waiting for threadgroup to
exit, active threads is 0
2009-10-14 13:49:03,636 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at cent52ip33/100.207.100.33
************************************************************/

...
  <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>
...

can anybody help me please?

Thanks!

Darren.
View this message in context: http://www.nabble.com/DataNode-is-shutting-down-tp25885861p25885861.html
Sent from the Hadoop core-user mailing list archiv
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB