Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - loss znode


Copy link to this message
-
Re: loss znode
Nicolas Liochon 2012-12-13, 16:53
Checking the code (for JM: it's in HMasterCommandLine), the only check is
on distributed on/off. So you need to be in distributed mode to have a
separate ZK. The pseudo distributed mode I was mentioning previously will
work.

It can be considered as a bug, at the minimum a documentation bug...
On Thu, Dec 13, 2012 at 5:33 PM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:

> Hum.
>
> If you see this line "Could not start ZK at requested" that mean HBase
> is still trying to launch ZK. So he might not have seen
> HBASE_MANAGES_ZK. Can you update it on the hbase-env file?
>
> # Tell HBase whether it should manage it's own instance of Zookeeper or
> not.
> export HBASE_MANAGES_ZK=false
>
> Also, for the Quorum property, can you try with a fully qualified name
> or localhost instead of the IP? Default value is localhost, so you can
> also maybe just remove it.
>
> JM
>
>     <property>
>       <name>hbase.zookeeper.quorum</name>
>       <value>rs1.example.com,rs2.example.com,rs3.example.com,
> rs4.example.com,rs5.example.com</value>
>       <description>Comma separated list of servers in the ZooKeeper Quorum.
>       For example, "host1.mydomain.com,host2.mydomain.com,
> host3.mydomain.com".
>       By default this is set to localhost for local and pseudo-distributed
> modes
>       of operation. For a fully-distributed setup, this should be set to a
> full
>       list of ZooKeeper quorum servers. If HBASE_MANAGES_ZK is set in
> hbase-env.sh
>       this is the list of servers which we will start/stop ZooKeeper on.
>       </description>
>     </property>
>
>
> 2012/12/13, Zbierski Christophe <[EMAIL PROTECTED]>:
> > Hi JM, I downloaded and added new ZK, and  I started this server befor
> > hbase.
> >
> > So , I used an external ZK server (listen on 3181)
> >
> > tof@W30596-lnx /opt/zookeeper-3.4.5/bin]# cat ../conf/zoo.cfg
> > tickTime=2000
> > initLimit=10
> > syncLimit=5
> > dataDir=/DATA/zookeeper
> > clientPort=3181
> >
> > And I used hbase in standalone mode
> > export HBASE_MANAGES_ZK=false
> >
> > and
> >   <property>
> >      <name>hbase.zookeeper.property.clientPort</name>
> >      <value>3181</value>
> >   </property>
> >   <property>
> >   <name>hbase.zookeeper.quorum</name>
> >   <value>127.0.0.1</value>
> >   </property>
> >
> >
> > In this configuration, this is hbase logs :
> >
> >  2012-12-13 17:06:58,593 INFO
> > org.apache.zookeeper.server.NIOServerCnxnFactory: binding to port
> > 0.0.0.0/0.0.0.0:3181
> > 2012-12-13 17:06:58,593 DEBUG
> > org.apache.hadoop.hbase.zookeeper.MiniZooKeeperCluster: Failed binding ZK
> > Server to client port: 3181
> > 2012-12-13 17:06:58,594 INFO
> > org.apache.zookeeper.server.NIOServerCnxnFactory: binding to port
> > 0.0.0.0/0.0.0.0:3182
> > 2012-12-13 17:06:58,613 INFO
> > org.apache.zookeeper.server.persistence.FileTxnSnapLog: Snapshotting:
> 0x0 to
> > /tmp/hbase-tof/zookeeper/zookeeper_0/version-2/snapshot.0
> > 2012-12-13 17:06:58,822 INFO
> > org.apache.zookeeper.server.NIOServerCnxnFactory: Accepted socket
> connection
> > from /127.0.0.1:36652
> > 2012-12-13 17:06:58,833 INFO org.apache.zookeeper.server.NIOServerCnxn:
> > Processing stat command from /127.0.0.1:36652
> > 2012-12-13 17:06:58,844 INFO org.apache.zookeeper.server.NIOServerCnxn:
> Stat
> > command output
> > 2012-12-13 17:06:58,847 INFO
> > org.apache.hadoop.hbase.zookeeper.MiniZooKeeperCluster: Started MiniZK
> > Cluster and connect 1 ZK server on client port: 3182
> > 2012-12-13 17:06:58,848 ERROR
> > org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master
> > java.io.IOException: Could not start ZK at requested port of 3181.  ZK
> was
> > started at port: 3182.  Aborting as clients (e.g. shell) will not be
> able to
> > find this ZK quorum.
> >         at
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:134)
> >         at
> >
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:103)
> >         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)