Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - RegionServer  unable to connect to master


Copy link to this message
-
Re: RegionServer unable to connect to master
shashwat shriparv 2011-12-15, 18:26
make 127.0.1.1 to 127.0.0.1 that will solve lot of problems

On Thu, Dec 15, 2011 at 11:54 PM, Jean-Daniel Cryans <[EMAIL PROTECTED]>wrote:

> Hi,
>
> A few notes:
>
> Remove the 127.0.1.1 lines, they usually mess things up.
>
> The hbase.master configuration has been removed from the HBase code
> more than 2 years ago, you can remove it too.
>
> Setting hbase.master.dns.interface alone without
> hbase.master.dns.nameserver doesn't do anything if I remember
> correctly, also I'm pretty sure you don't have an interface named
> "master", it's more likely "eth0" and whatnot.
>
> I don't know if this will fix your DNS resolution, but at least it
> will clean up a bit :)
>
> J-D
>
> 2011/12/15 exp <[EMAIL PROTECTED]>:
> > hi all,
> >
> > I am installing hbase on a small cluster of 3 machines. The RegionServer
> unable connect to the master. This is the log:
> >
> >
> > 2011-12-15 13:46:43,415 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer: Attempting connect to
> Master server at localhost:60000
> > 2011-12-15 13:47:43,473 WARN
> org.apache.hadoop.hbase.regionserver.HRegionServer: Unable to connect to
> master. Retrying. Error was:
> > java.net.ConnectException: Connection refused
> >        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> >        at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
> >        at
> org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
> > ......
> >
> >
> >
> >
> > The lod shows this RegionServer connect to the master at a wrong
> address(localhost:60000).
> >
> >
> > as far as I know, the RegionServer use ZooKeeper to find out the
> master's address. so I check the HMaster's log.
> >
> >
> > this is what i find out:
> > ...
> > 2011-12-15 13:44:34,946 INFO
> org.apache.hadoop.hbase.master.metrics.MasterMetrics: Initialized
> > 2011-12-15 13:44:35,010 INFO
> org.apache.hadoop.hbase.master.ActiveMasterManager: Master=localhost:60000
> > 2011-12-15 13:44:37,476 INFO org.apache.zookeeper.ZooKeeper: Initiating
> client connection, connectString=master:2181,slave2:2181,slave
> > 1:2181 sessionTimeout=180000 watcher=hconnection
> > ...
> >
> >
> > The HMaster starts at localhost:60000! I think the HMaster should start
> at master:60000. "master" is the hosts where JobTracker runs.
> >
> >
> > I am using hbase 0.90.3 and zookeeper 3.3.4. This is the source code
> where the HMaster get the address:
> >
> >
> > HServerAddress a = new HServerAddress(getMyAddress(this.conf));
> > int numHandlers = conf.getInt("hbase.regionserver.handler.count", 10);
> > this.rpcServer = HBaseRPC.getServer(this,
> >      new Class<?>[]{HMasterInterface.class,
> HMasterRegionInterface.class},
> >      a.getBindAddress(), a.getPort(),
> >      numHandlers,
> >      0, // we dont use high priority handlers in master
> >      false, conf,
> >      0); // this is a DNC w/o high priority handlers
> > this.address = new HServerAddress(rpcServer.getListenerAddress());
> >
> >
> >  private static String getMyAddress(final Configuration c)
> >  throws UnknownHostException {
> >    // Find out our address up in DNS.
> >    String s > DNS.getDefaultHost(c.get("hbase.master.dns.interface","default"),
> >      c.get("hbase.master.dns.nameserver","default"));
> >    s += ":" + c.get(HConstants.MASTER_PORT,
> >        Integer.toString(HConstants.DEFAULT_MASTER_PORT));
> >    return s;
> >  }
> >
> >
> >
> >
> > As you can see in the code, the HMaster find its address in DNS! I have
> no idea how to setup the hbase to let the HMaster find the correct address.
> >
> >
> > this is my hbase-site.xml:
> >
> >
> > <configuration>
> >    <property>
> >        <name>hbase.rootdir</name>
> >        <value>hdfs://master:9000/user/hadoop/hbase</value>
> >    </property>
> >    <property>
> >        <name>hbase.cluster.distributed</name>
> >        <value>true</value>
> >    </property>
> >
> >
> >    <property>
> >        <name>hbase.master.dns.interface</name>
> >        <value>master</value>

Shashwat Shriparv
09900059620
09663531241

<iframe src="
http://rcm.amazon.com/e/cm?t=shriparv-20&o=1&p=48&l=ur1&category=kindlerotating&f=ifr"
width="728" height="90" scrolling="no" border="0" marginwidth="0"
style="border:none;" frameborder="0"></iframe>