Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Starting Abnormally After Shutting Down For Some Time


Copy link to this message
-
Re: Starting Abnormally After Shutting Down For Some Time
Dear Manish and Jean-Daniel,

After starting DFS (/opt/hadoop/bin/start-dfs.sh), I got the following
daemons after tying "jps".

5212 Jps
5150 SecondaryNameNode
4932 DataNode
4737 NameNode

Then, I started the HBase (/opt/hbase/bin/start-hbase.sh). The following
daemons were available.

5797 Jps
5526 HMaster
5150 SecondaryNameNode
5711 HRegionServer
4932 DataNode
4737 NameNode
5456 HQuorumPeer

HMaster was started. It seemed that everything was fine.

But when typing "status" in HBase shell. The following error still occurred.

ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 times

In the master log, the following exception was found.

2012-03-28 13:40:01,193 FATAL org.apache.hadoop.hbase.master.HMaster:
Unhandled exception. Starting shutdown.
java.net.ConnectException: Call to localhost/127.0.0.1:9000 failed on
connection exception: java.net.ConnectException: Connection refused
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1095)
at org.apache.hadoop.ipc.Client.call(Client.java:1071)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
at $Proxy10.setSafeMode(Unknown Source)
at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
at $Proxy10.setSafeMode(Unknown Source)
at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1120)
at
org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:423)
at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:439)
at
org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:323)
at
org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:128)
at
org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:113)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:448)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:326)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:701)
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:656)
at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:434)
at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:560)
at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:184)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1202)
at org.apache.hadoop.ipc.Client.call(Client.java:1046)
... 17 more
2012-03-28 13:40:01,195 INFO org.apache.hadoop.hbase.master.HMaster:
Aborting

What is the problem? Why does it happen after HBase/Hadoop is shutdown for
a couple of days?

Thanks so much!

Bing

On Wed, Mar 28, 2012 at 11:09 AM, Manish Bhoge
<[EMAIL PROTECTED]>wrote:

> It says you have not started the hbase master. Once you restarted the
> system have you confirmed whether all hadoop daemons are running?
> sudo jps
> If you are using CDH package then you can automatically start the hadoop
> daemons on boot using reconfig package.
>
> Sent from my BlackBerry, pls excuse typo
>
> -----Original Message-----
> From: Bing Li <[EMAIL PROTECTED]>
> Date: Wed, 28 Mar 2012 03:52:12
> To: <[EMAIL PROTECTED]>; user<[EMAIL PROTECTED]>
> Reply-To: [EMAIL PROTECTED]
> Subject: Starting Abnormally After Shutting Down For Some Time
>
> Dear all,
>
> I got a weird problem when programming on the pseudo-distributed mode of
> HBase/Hadoop.
>
> The HBase/Hadoop were installed correctly. It also ran well with my Java
> code.