Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - Re: Distributed hadoop setup 0 live datanode problem in cluster


+
Jeff Zhang 2010-03-17, 07:14
Copy link to this message
-
Re: Distributed hadoop setup 0 live datanode problem in cluster
William Kang 2010-03-17, 07:18
Hi Jeff,
Here is the log from my namenode:
************************************************************/
2010-03-17 03:09:59,750 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG:   host = ubtserver01/127.0.0.1
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.20.2
STARTUP_MSG:   build https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r
911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
2010-03-17 03:09:59,903 INFO org.apache.hadoop.ipc.metrics.RpcMetrics:
Initializing RPC Metrics with hostName=NameNode, port=9000
2010-03-17 03:09:59,909 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Namenode up at:
ubtserver01/127.0.0.1:9000
2010-03-17 03:09:59,912 INFO org.apache.hadoop.metrics.jvm.JvmMetrics:
Initializing JVM Metrics with processName=NameNode, sessionId=null
2010-03-17 03:09:59,914 INFO
org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics: Initializing
NameNodeMeterics using context
object:org.apache.hadoop.metrics.spi.NullContext
2010-03-17 03:09:59,979 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
fsOwner=cakang,cakang,adm,dialout,cdrom,plugdev,lpadmin,admin,sambashare
2010-03-17 03:09:59,980 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=supergroup
2010-03-17 03:09:59,980 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem:
isPermissionEnabled=true
2010-03-17 03:09:59,995 INFO
org.apache.hadoop.hdfs.server.namenode.metrics.FSNamesystemMetrics:
Initializing FSNamesystemMetrics using context
object:org.apache.hadoop.metrics.spi.NullContext
2010-03-17 03:09:59,998 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered
FSNamesystemStatusMBean
2010-03-17 03:10:00,042 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files = 1
2010-03-17 03:10:00,048 INFO org.apache.hadoop.hdfs.server.common.Storage:
Number of files under construction = 0
2010-03-17 03:10:00,048 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 96 loaded in 0 seconds.
2010-03-17 03:10:00,048 INFO org.apache.hadoop.hdfs.server.common.Storage:
Edits file /opt/hadoop/dfs/name/current/edits of size 4 edits # 0 loaded in
0 seconds.
2010-03-17 03:10:00,122 INFO org.apache.hadoop.hdfs.server.common.Storage:
Image file of size 96 saved in 0 seconds.
2010-03-17 03:10:00,391 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading
FSImage in 436 msecs
2010-03-17 03:10:00,393 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Total number of blocks
= 0
2010-03-17 03:10:00,393 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of invalid
blocks = 0
2010-03-17 03:10:00,393 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of
under-replicated blocks = 0
2010-03-17 03:10:00,393 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of
 over-replicated blocks = 0
2010-03-17 03:10:00,393 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Leaving safe mode after 0 secs.
2010-03-17 03:10:00,393 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Network topology has 0 racks and 0 datanodes
2010-03-17 03:10:00,393 INFO org.apache.hadoop.hdfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks
2010-03-17 03:10:05,572 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2010-03-17 03:10:05,661 INFO org.apache.hadoop.http.HttpServer: Port
returned by webServer.getConnectors()[0].getLocalPort() before open() is -1.
Opening the listener on 50070
2010-03-17 03:10:05,663 INFO org.apache.hadoop.http.HttpServer:
listener.getLocalPort() returned 50070
webServer.getConnectors()[0].getLocalPort() returned 50070
2010-03-17 03:10:05,663 INFO org.apache.hadoop.http.HttpServer: Jetty bound
to port 50070
2010-03-17 03:10:05,663 INFO org.mortbay.log: jetty-6.1.14
2010-03-17 03:11:10,095 INFO org.mortbay.log: Started
SelectChannelConnector@0.0.0.0:50070
2010-03-17 03:11:10,095 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: Web-server up at:
0.0.0.0:50070
2010-03-17 03:11:10,097 INFO org.apache.hadoop.ipc.Server: IPC Server
Responder: starting
2010-03-17 03:11:10,098 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 9000: starting
2010-03-17 03:11:10,110 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 9000: starting
2010-03-17 03:11:10,113 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 9000: starting
2010-03-17 03:11:10,114 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 9000: starting
2010-03-17 03:11:10,153 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 9000: starting
2010-03-17 03:11:10,153 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 9000: starting
2010-03-17 03:11:10,160 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 9000: starting
2010-03-17 03:11:10,160 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 9000: starting
2010-03-17 03:11:10,160 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 9000: starting
2010-03-17 03:11:10,161 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 9000: starting
2010-03-17 03:11:10,170 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 9000: starting
2010-03-17 03:15:51,270 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
NameSystem.registerDatanode: node registration from 127.0.0.1:50010 storage
DS-37429514-127.0.0.1-50010-1268798883208
2010-03-17 03:15:51,274 INFO org.apache.hadoop.net.NetworkTopology: Adding a
new node: /default-rack/127.0.0.1:50010

Thanks for the replies.
I am looking forward to hearing from you.
William

On Wed, Mar 17, 2010 at 3:14 AM, Jeff Zhang <[EMAIL PROTECTED]> wrote:

+
William Kang 2010-03-17, 07:29
+
Steve Loughran 2010-03-22, 11:36