Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # dev >> HMaster shutdown when a DNS address cannot be solved


Copy link to this message
-
Re: HMaster shutdown when a DNS address cannot be solved
You may be hitting this: https://issues.apache.org/jira/browse/HBASE-5481
--Suraj

On Sun, Apr 8, 2012 at 11:36 AM, Mikael Sitruk <[EMAIL PROTECTED]> wrote:
> Hi devs.
>
> I have a strange situation with my cluster when an address cannot be
> resolved.
> Few days ago I had two entries in a DNS file, so a computer could be found
> either via <host name> or <hostname>.<domain>
> Now the domain entries in the DNS resolving was removed, (so only the short
> name exists) when i try to start the cluster the master fail indicating
> that the server address cannot be resolved see below...
> Any help appreciated???
> BTW this is hadoop-1.0.0 and HBase-0.92.0
>
> 2012-04-08 21:06:45,496 INFO
> org.apache.hadoop.hbase.catalog.CatalogTracker: Failed verification of
> -ROOT-,,0 at address=server118,60020,1333842630426;
> org.apache.hadoop.hbase.NotServingRegionException: org.apache.had
> oop.hbase.NotServingRegionException: Region is not online: -ROOT-,,0
> 2012-04-08 21:06:45,497 INFO
> org.apache.hadoop.hbase.catalog.RootLocationEditor: Unsetting ROOT region
> location in ZooKeeper
> 2012-04-08 21:06:45,969 INFO
> org.apache.hadoop.hbase.master.handler.OpenedRegionHandler: Handling OPENED
> event for -ROOT-,,0.70236052 from server119,60020,1333908308851; deleting
> unassigned node
> 2012-04-08 21:06:45,973 INFO
> org.apache.hadoop.hbase.master.AssignmentManager: The master has opened the
> region -ROOT-,,0.70236052 that was online on server119,60020,1333908308851
> 2012-04-08 21:06:45,976 INFO org.apache.hadoop.hbase.master.HMaster: -ROOT-
> assigned=1, rit=false, location=server119,60020,1333908308851
> 2012-04-08 21:06:46,041 FATAL org.apache.hadoop.hbase.master.HMaster:
> Master server abort: loaded coprocessors are: []
> 2012-04-08 21:06:46,042 FATAL org.apache.hadoop.hbase.master.HMaster:
> Unhandled exception. Starting shutdown.
> java.net.UnknownHostException: unknown host: server116.<domain>
>        at
> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.<init>(HBaseClient.java:227)
>        at
> org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1016)
>        at
> org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:878)
>        at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
>        at $Proxy12.getProtocolVersion(Unknown Source)
>        at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:183)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:303)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:280)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:332)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC.waitForProxy(HBaseRPC.java:236)
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1278)
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1235)
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHRegionConnection(HConnectionManager.java:1222)
>        at
> org.apache.hadoop.hbase.catalog.CatalogTracker.getCachedConnection(CatalogTracker.java:564)
>        at
> org.apache.hadoop.hbase.catalog.CatalogTracker.getMetaServerConnection(CatalogTracker.java:422)
>        at
> org.apache.hadoop.hbase.catalog.CatalogTracker.waitForMeta(CatalogTracker.java:478)
>        at
> org.apache.hadoop.hbase.catalog.CatalogTracker.waitForMetaServerConnection(CatalogTracker.java:503)
>        at
> org.apache.hadoop.hbase.catalog.CatalogTracker.verifyMetaRegionLocation(CatalogTracker.java:674)
>        at
> org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:575)
>        at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:491)
>        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:326)
>        at java.lang.Thread.run(Thread.java:662)