HBase, mail # user - Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Mohammad Tariq 2012-06-06, 14:43

Are you creating too many "configuration" objects..that could create a
problem like this??

Regards,
Mohammad Tariq
On Wed, Jun 6, 2012 at 7:55 PM, Manu S <[EMAIL PROTECTED]> wrote:
> Hi All,
>
> We are running a mapreduce job in a fully distributed cluster.The output of
> the job is writing to HBase.
>
> While running this job we are getting an error:
>
> *Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException:
> HBase is able to connect to ZooKeeper but the connection closes
> immediately. This could be a sign that the server has too many
> connections (30 is the default). Consider inspecting your ZK server
> logs for that error and then make sure you are reusing
> HBaseConfiguration as often as you can. See HTable's javadoc for more
> information.*
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> at org.apache.hadoop.hbase.client.HTableFactory.createHTableInterface(HTableFactory.java:36)
>
>
> I had gone through some threads related to this issue and I modified the *
> zoo.cfg* accordingly. These configurations are same in all the nodes.
> Please find the configuration of HBase & ZooKeeper:
>
> Hbase-site.xml:
>
> <configuration>
>
> <property>
> <name>hbase.cluster.distributed</name>
> <value>true</value>
> </property>
>
> <property>
> <name>hbase.rootdir</name>
> <value>hdfs://namenode/hbase</value>
> </property>
>
> <property>
> <name>hbase.zookeeper.quorum</name>
> <value>namenode</value>
> </property>
>
> </configuration>
>
>
> Zoo.cfg:
>
> # The number of milliseconds of each tick
> tickTime=2000
> # The number of ticks that the initial
> # synchronization phase can take
> initLimit=10
> # The number of ticks that can pass between
> # sending a request and getting an acknowledgement
> syncLimit=5
> # the directory where the snapshot is stored.
> dataDir=/var/zookeeper
> # the port at which the clients will connect
> clientPort=2181
> #server.0=localhost:2888:3888
> server.0=namenode:2888:3888
>
> ################# Max Client connections ###################
> *maxClientCnxns=1000
> minSessionTimeout=4000
> maxSessionTimeout=40000*
>
>
> It would be really great if anyone can help me to resolve this issue by
> giving your thoughts/suggestions.
>
> Thanks,
> Manu S

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Kevin O'dell 2012-06-06, 15:03

Manu,

If you are creating new objects depending on what version of HBase you
are using you could be hitting
https://issues.apache.org/jira/browse/HBASE-5466

On Wed, Jun 6, 2012 at 10:43 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:

> Are you creating too many "configuration" objects..that could create a
> problem like this??
>
> Regards,
> Mohammad Tariq
>
>
> On Wed, Jun 6, 2012 at 7:55 PM, Manu S <[EMAIL PROTECTED]> wrote:
> > Hi All,
> >
> > We are running a mapreduce job in a fully distributed cluster.The output
> of
> > the job is writing to HBase.
> >
> > While running this job we are getting an error:
> >
> > *Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException:
> > HBase is able to connect to ZooKeeper but the connection closes
> > immediately. This could be a sign that the server has too many
> > connections (30 is the default). Consider inspecting your ZK server
> > logs for that error and then make sure you are reusing
> > HBaseConfiguration as often as you can. See HTable's javadoc for more
> > information.*
> > at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
> > at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> > at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> > at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> > at
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> > at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> > at
> org.apache.hadoop.hbase.client.HTableFactory.createHTableInterface(HTableFactory.java:36)
> >
> >
> > I had gone through some threads related to this issue and I modified the
> *
> > zoo.cfg* accordingly. These configurations are same in all the nodes.
> > Please find the configuration of HBase & ZooKeeper:
> >
> > Hbase-site.xml:
> >
> > <configuration>
> >
> > <property>
> > <name>hbase.cluster.distributed</name>
> > <value>true</value>
> > </property>
> >
> > <property>
> > <name>hbase.rootdir</name>
> > <value>hdfs://namenode/hbase</value>
> > </property>
> >
> > <property>
> > <name>hbase.zookeeper.quorum</name>
> > <value>namenode</value>
> > </property>
> >
> > </configuration>
> >
> >
> > Zoo.cfg:
> >
> > # The number of milliseconds of each tick
> > tickTime=2000
> > # The number of ticks that the initial
> > # synchronization phase can take
> > initLimit=10
> > # The number of ticks that can pass between
> > # sending a request and getting an acknowledgement
> > syncLimit=5
> > # the directory where the snapshot is stored.
> > dataDir=/var/zookeeper
> > # the port at which the clients will connect
> > clientPort=2181
> > #server.0=localhost:2888:3888
> > server.0=namenode:2888:3888
> >
> > ################# Max Client connections ###################
> > *maxClientCnxns=1000
> > minSessionTimeout=4000
> > maxSessionTimeout=40000*
> >
> >
> > It would be really great if anyone can help me to resolve this issue by
> > giving your thoughts/suggestions.
> >
> > Thanks,
> > Manu S
>

--
Kevin O'Dell
Customer Operations Engineer, Cloudera

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Manu S 2012-06-07, 07:43

Hi All,

Thank you for your reply.

I tried all these options but still I am facing this issue.

@Mayank: I tried the same, but still getting error.
export
HADOOP_CLASSPATH="/usr/lib/hadoop/:/usr/lib/hadoop/lib/:/usr/lib/hadoop/conf/"
export
HBASE_CLASSPATH="/usr/lib/hbase/:/usr/lib/hbase/lib/:/usr/lib/hbase/conf/:/usr/lib/zookeeper/:/usr/lib/zookeeper/conf/:/usr/lib/zookeeper/lib/"
export CLASSPATH="${HADOOP_CLASSPATH}:${HBASE_CLASSPATH}"

@Marcos & Tariq:
We are using Hbase version 0.90.4
Job creating single HBaseConfiguration object only

@Kevin:
No luck, same error
Thanks,
Manu S

On Thu, Jun 7, 2012 at 3:50 AM, Mayank Bansal <[EMAIL PROTECTED]> wrote:

>
> zookeeper conf is not on the class path for the mapreduce job. Add conf
>> file to class path for the job.
>>
>> Thanks,
>> Mayank
>>
>>
>> On Wed, Jun 6, 2012 at 7:25 AM, Manu S <[EMAIL PROTECTED]> wrote:
>>
>>> Hi All,
>>>
>>> We are running a mapreduce job in a fully distributed cluster.The output
>>> of the job is writing to HBase.
>>>
>>> While running this job we are getting an error:
>>>
>>> *Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect to ZooKeeper but the connection closes immediately. This could be a sign that the server has too many connections (30 is the default). Consider inspecting your ZK server logs for that error and then make sure you are reusing HBaseConfiguration as often as you can. See HTable's javadoc for more information.*
>>> at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
>>> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
>>> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
>>> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
>>> at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
>>> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
>>> at org.apache.hadoop.hbase.client.HTableFactory.createHTableInterface(HTableFactory.java:36)
>>>
>>>
>>> I had gone through some threads related to this issue and I modified the
>>> *zoo.cfg* accordingly. These configurations are same in all the nodes.
>>> Please find the configuration of HBase & ZooKeeper:
>>>
>>> Hbase-site.xml:
>>>
>>> <configuration>
>>>
>>> <property>
>>> <name>hbase.cluster.distributed</name>
>>> <value>true</value>
>>> </property>
>>>
>>> <property>
>>> <name>hbase.rootdir</name>
>>> <value>hdfs://namenode/hbase</value>
>>> </property>
>>>
>>> <property>
>>> <name>hbase.zookeeper.quorum</name>
>>> <value>namenode</value>
>>> </property>
>>>
>>> </configuration>
>>>
>>>
>>> Zoo.cfg:
>>>
>>> # The number of milliseconds of each tick
>>> tickTime=2000
>>> # The number of ticks that the initial
>>> # synchronization phase can take
>>> initLimit=10
>>> # The number of ticks that can pass between
>>> # sending a request and getting an acknowledgement
>>> syncLimit=5
>>> # the directory where the snapshot is stored.
>>> dataDir=/var/zookeeper
>>> # the port at which the clients will connect
>>> clientPort=2181
>>> #server.0=localhost:2888:3888
>>> server.0=namenode:2888:3888
>>>
>>> ################# Max Client connections ###################
>>> *maxClientCnxns=1000
>>> minSessionTimeout=4000
>>> maxSessionTimeout=40000*
>>>
>>>
>>> It would be really great if anyone can help me to resolve this issue by
>>> giving your thoughts/suggestions.
>>>
>>> Thanks,
>>> Manu S
>>>
>>
>>
>

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Mohammad Tariq 2012-06-07, 08:01

Actually zookeeper servers have an active connections limit, which by
default is 30. You can increase this limit by setting maxClientCnxns
property accordingly in your zookeeper config file, zoo.cfg. For
example - maxClientCnxns=100....but before that copy the
hadoop-core-*.jar present inside hadoop folder to the hbase/lib
folder.Also copy commons-configuration-1.6.jar from hadoop/lib folder
to hbase/lib folder and check it once and see if it works for you.

Regards,
Mohammad Tariq
On Thu, Jun 7, 2012 at 1:13 PM, Manu S <[EMAIL PROTECTED]> wrote:
> Hi All,
>
> Thank you for your reply.
>
> I tried all these options but still I am facing this issue.
>
> @Mayank: I tried the same, but still getting error.
> export
> HADOOP_CLASSPATH="/usr/lib/hadoop/:/usr/lib/hadoop/lib/:/usr/lib/hadoop/conf/"
> export
> HBASE_CLASSPATH="/usr/lib/hbase/:/usr/lib/hbase/lib/:/usr/lib/hbase/conf/:/usr/lib/zookeeper/:/usr/lib/zookeeper/conf/:/usr/lib/zookeeper/lib/"
> export CLASSPATH="${HADOOP_CLASSPATH}:${HBASE_CLASSPATH}"
>
> @Marcos & Tariq:
> We are using Hbase version 0.90.4
> Job creating single HBaseConfiguration object only
>
> @Kevin:
> No luck, same error
>
>
> Thanks,
> Manu S
>
> On Thu, Jun 7, 2012 at 3:50 AM, Mayank Bansal <[EMAIL PROTECTED]> wrote:
>
>>
>> zookeeper conf is not on the class path for the mapreduce job. Add conf
>>> file to class path for the job.
>>>
>>> Thanks,
>>> Mayank
>>>
>>>
>>> On Wed, Jun 6, 2012 at 7:25 AM, Manu S <[EMAIL PROTECTED]> wrote:
>>>
>>>> Hi All,
>>>>
>>>> We are running a mapreduce job in a fully distributed cluster.The output
>>>> of the job is writing to HBase.
>>>>
>>>> While running this job we are getting an error:
>>>>
>>>> *Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect to ZooKeeper but the connection closes immediately. This could be a sign that the server has too many connections (30 is the default). Consider inspecting your ZK server logs for that error and then make sure you are reusing HBaseConfiguration as often as you can. See HTable's javadoc for more information.*
>>>> at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
>>>> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
>>>> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
>>>> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
>>>> at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
>>>> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
>>>> at org.apache.hadoop.hbase.client.HTableFactory.createHTableInterface(HTableFactory.java:36)
>>>>
>>>>
>>>> I had gone through some threads related to this issue and I modified the
>>>> *zoo.cfg* accordingly. These configurations are same in all the nodes.
>>>> Please find the configuration of HBase & ZooKeeper:
>>>>
>>>> Hbase-site.xml:
>>>>
>>>> <configuration>
>>>>
>>>> <property>
>>>> <name>hbase.cluster.distributed</name>
>>>> <value>true</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>hbase.rootdir</name>
>>>> <value>hdfs://namenode/hbase</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>hbase.zookeeper.quorum</name>
>>>> <value>namenode</value>
>>>> </property>
>>>>
>>>> </configuration>
>>>>
>>>>
>>>> Zoo.cfg:
>>>>
>>>> # The number of milliseconds of each tick
>>>> tickTime=2000
>>>> # The number of ticks that the initial
>>>> # synchronization phase can take
>>>> initLimit=10
>>>> # The number of ticks that can pass between
>>>> # sending a request and getting an acknowledgement
>>>> syncLimit=5
>>>> # the directory where the snapshot is stored.
>>>> dataDir=/var/zookeeper
>>>> # the port at which the clients will connect
>>>> clientPort=2181
>>>> #server.0=localhost:2888:3888

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Mohammad Tariq 2012-06-07, 09:46

which distribution are you using??actually this is not possible..it
must be there..download it put it there

Regards,
Mohammad Tariq
On Thu, Jun 7, 2012 at 2:41 PM, Manu S <[EMAIL PROTECTED]> wrote:
> Hi Tariq,
>
> Thank you!!
> I already changed the maxClientCnxns to 1000.
> Also we have set CLASSPATH that includes all the Hadoop,HBase & Zookeper
> path's. I think copying hadoop .jar files to Hbase lib folder is the same
> affect of setting CLASSPATH with all the folders.
> There is no commons-configuration-*.jar inside hadoop/lib folder.
>
> Any other options?
>
> Thanks,
> Manu S
>
> On Thu, Jun 7, 2012 at 1:31 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>
>> Actually zookeeper servers have an active connections limit, which by
>> default is 30. You can increase this limit by setting maxClientCnxns
>> property accordingly in your zookeeper config file, zoo.cfg. For
>> example - maxClientCnxns=100....but before that copy the
>> hadoop-core-*.jar present inside hadoop folder to the hbase/lib
>> folder.Also copy commons-configuration-1.6.jar from hadoop/lib folder
>> to hbase/lib folder and check it once and see if it works for you.
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>> On Thu, Jun 7, 2012 at 1:13 PM, Manu S <[EMAIL PROTECTED]> wrote:
>> > Hi All,
>> >
>> > Thank you for your reply.
>> >
>> > I tried all these options but still I am facing this issue.
>> >
>> > @Mayank: I tried the same, but still getting error.
>> > export
>> >
>> HADOOP_CLASSPATH="/usr/lib/hadoop/:/usr/lib/hadoop/lib/:/usr/lib/hadoop/conf/"
>> > export
>> >
>> HBASE_CLASSPATH="/usr/lib/hbase/:/usr/lib/hbase/lib/:/usr/lib/hbase/conf/:/usr/lib/zookeeper/:/usr/lib/zookeeper/conf/:/usr/lib/zookeeper/lib/"
>> > export CLASSPATH="${HADOOP_CLASSPATH}:${HBASE_CLASSPATH}"
>> >
>> > @Marcos & Tariq:
>> > We are using Hbase version 0.90.4
>> > Job creating single HBaseConfiguration object only
>> >
>> > @Kevin:
>> > No luck, same error
>> >
>> >
>> > Thanks,
>> > Manu S
>> >
>> > On Thu, Jun 7, 2012 at 3:50 AM, Mayank Bansal <[EMAIL PROTECTED]> wrote:
>> >
>> >>
>> >> zookeeper conf is not on the class path for the mapreduce job. Add conf
>> >>> file to class path for the job.
>> >>>
>> >>> Thanks,
>> >>> Mayank
>> >>>
>> >>>
>> >>> On Wed, Jun 6, 2012 at 7:25 AM, Manu S <[EMAIL PROTECTED]> wrote:
>> >>>
>> >>>> Hi All,
>> >>>>
>> >>>> We are running a mapreduce job in a fully distributed cluster.The
>> output
>> >>>> of the job is writing to HBase.
>> >>>>
>> >>>> While running this job we are getting an error:
>> >>>>
>> >>>> *Caused by: org.apache.hadoop.hbase.ZooKeeperConnectionException:
>> HBase is able to connect to ZooKeeper but the connection closes
>> immediately. This could be a sign that the server has too many connections
>> (30 is the default). Consider inspecting your ZK server logs for that error
>> and then make sure you are reusing HBaseConfiguration as often as you can.
>> See HTable's javadoc for more information.*
>> >>>> at
>> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
>> >>>> at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
>> >>>> at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
>> >>>> at
>> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
>> >>>> at
>> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
>> >>>> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
>> >>>> at
>> org.apache.hadoop.hbase.client.HTableFactory.createHTableInterface(HTableFactory.java:36)
>> >>>>
>> >>>>
>> >>>> I had gone through some threads related to this issue and I modified
>> the
>> >>>> *zoo.cfg* accordingly. These configurations are same in all the nodes.
>> >>>> Please find the configuration of HBase & ZooKeeper:

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

shashwat shriparv 2012-06-07, 13:41

Try this settings check what you have and what you dont have in the
configuration :
*<configuration>*
*<property>*
*<name>hbase.rootdir</name>*
*<value>hdfs://{your machine name} or {localhost}:9000/hbase</value>*
*</property>*
*<property>*
*<name>hbase.master</name>*
*<value>{your machine name} or {localhost}:60000</value>*
*<description>The host and port that the HBase master runs at.</description>
*
*</property>*
*<property>*
*<name>hbase.regionserver.port</name>*
*<value>60020</value>*
*<description>The host and port that the HBase master runs at.</description>
*
*</property>*
**
*<property>*
*<name>hbase.cluster.distributed</name>*
*<value>true</value>*
*</property>*
*<property>*
*<name>hbase.tmp.dir</name>*
*<value>/home/shashwat/Hadoop/hbase-0.90.4/temp</value>*
*</property>*
*<property>*
*<name>hbase.zookeeper.quorum</name>*
*<value>{your machine name} or {localhost}</value>*
*</property>*
*<property>*
*<name>dfs.replication</name>*
*<value>1</value>*
*</property>*
*<property>*
*<name>hbase.zookeeper.property.clientPort</name>*
*<value>2181</value>*
*<description>Property from ZooKeeper's config zoo.cfg.*
*The port at which the clients will connect.*
*</description>*
*</property>*
*<property>*
*<name>hbase.zookeeper.property.dataDir</name>*
*<value>/home/shashwat/zookeeper</value>*
*<description>Property from ZooKeeper's config zoo.cfg.*
*The directory where the snapshot is stored.*
*</description>*
*</property>*
*
*
*
*
*<property>*
* <name>zookeeper.session.timeout</name>*
* <value>18000000</value>*
* <description>Session Time out.</description>*
* </property>*
* <property>*
* <name>hbase.client.scanner.caching</name>*
* <value>5000</value>*
* </property>*
*<property>*
*<name>hbase.regionserver.lease.period</name>*
*<value>2400000</value>*
*</property>*
Thanx and regards

∞
Shashwat Shriparv

On Thu, Jun 7, 2012 at 3:16 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:

> which distribution are you using??actually this is not possible..it
> must be there..download it put it there
>
> Regards,
> Mohammad Tariq
>
>
> On Thu, Jun 7, 2012 at 2:41 PM, Manu S <[EMAIL PROTECTED]> wrote:
> > Hi Tariq,
> >
> > Thank you!!
> > I already changed the maxClientCnxns to 1000.
> > Also we have set CLASSPATH that includes all the Hadoop,HBase & Zookeper
> > path's. I think copying hadoop .jar files to Hbase lib folder is the same
> > affect of setting CLASSPATH with all the folders.
> > There is no commons-configuration-*.jar inside hadoop/lib folder.
> >
> > Any other options?
> >
> > Thanks,
> > Manu S
> >
> > On Thu, Jun 7, 2012 at 1:31 PM, Mohammad Tariq <[EMAIL PROTECTED]>
> wrote:
> >
> >> Actually zookeeper servers have an active connections limit, which by
> >> default is 30. You can increase this limit by setting maxClientCnxns
> >> property accordingly in your zookeeper config file, zoo.cfg. For
> >> example - maxClientCnxns=100....but before that copy the
> >> hadoop-core-*.jar present inside hadoop folder to the hbase/lib
> >> folder.Also copy commons-configuration-1.6.jar from hadoop/lib folder
> >> to hbase/lib folder and check it once and see if it works for you.
> >>
> >> Regards,
> >> Mohammad Tariq
> >>
> >>
> >> On Thu, Jun 7, 2012 at 1:13 PM, Manu S <[EMAIL PROTECTED]> wrote:
> >> > Hi All,
> >> >
> >> > Thank you for your reply.
> >> >
> >> > I tried all these options but still I am facing this issue.
> >> >
> >> > @Mayank: I tried the same, but still getting error.
> >> > export
> >> >
> >>
> HADOOP_CLASSPATH="/usr/lib/hadoop/:/usr/lib/hadoop/lib/:/usr/lib/hadoop/conf/"
> >> > export
> >> >
> >>
> HBASE_CLASSPATH="/usr/lib/hbase/:/usr/lib/hbase/lib/:/usr/lib/hbase/conf/:/usr/lib/zookeeper/:/usr/lib/zookeeper/conf/:/usr/lib/zookeeper/lib/"
> >> > export CLASSPATH="${HADOOP_CLASSPATH}:${HBASE_CLASSPATH}"
> >> >
> >>
∞
Shashwat Shriparv

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Manu S 2012-06-07, 14:42

Hi Tariq,

Version: HBase-0.90.4
I downloaded commons-configuration-1.6.jar and put it inside HBASE_HOME/lib
& HADOOP_HOME/lib(In pseudo distributed) and tested.

*hbase(main):002:0> status
12/06/07 19:59:59 FATAL zookeeper.ZKConfig: The server in zoo.cfg cannot be
set to localhost in a fully-distributed setup because it won't be
reachable. See "Getting Started" for more information.

ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able
to connect to ZooKeeper but the connection closes immediately. This could
be a sign that the server has too many connections (30 is the default).
Consider inspecting your ZK server logs for that error and then make sure
you are reusing HBaseConfiguration as often as you can. See HTable's
javadoc for more information.*

Is this common-configuration version is compatible for hbase-0.90.4?

@Shashwat:
Thank you!!
Some parameters are missing in my hbase configuration, I will add these and
test. The zookeeper parameters I already added in zoo.cfg. Is that enough
or do I need to add once again in hbase configuration?

Thanks,
Manu S
On Thu, Jun 7, 2012 at 7:11 PM, shashwat shriparv <[EMAIL PROTECTED]
> wrote:

> Try this settings check what you have and what you dont have in the
> configuration :
>
>
> *<configuration>*
> *<property>*
> *<name>hbase.rootdir</name>*
> *<value>hdfs://{your machine name} or {localhost}:9000/hbase</value>*
> *</property>*
> *<property>*
> *<name>hbase.master</name>*
> *<value>{your machine name} or {localhost}:60000</value>*
> *<description>The host and port that the HBase master runs
> at.</description>
> *
> *</property>*
> *<property>*
> *<name>hbase.regionserver.port</name>*
> *<value>60020</value>*
> *<description>The host and port that the HBase master runs
> at.</description>
> *
> *</property>*
> **
> *<property>*
> *<name>hbase.cluster.distributed</name>*
> *<value>true</value>*
> *</property>*
> *<property>*
> *<name>hbase.tmp.dir</name>*
> *<value>/home/shashwat/Hadoop/hbase-0.90.4/temp</value>*
> *</property>*
> *<property>*
> *<name>hbase.zookeeper.quorum</name>*
> *<value>{your machine name} or {localhost}</value>*
> *</property>*
> *<property>*
> *<name>dfs.replication</name>*
> *<value>1</value>*
> *</property>*
> *<property>*
> *<name>hbase.zookeeper.property.clientPort</name>*
> *<value>2181</value>*
> *<description>Property from ZooKeeper's config zoo.cfg.*
> *The port at which the clients will connect.*
> *</description>*
> *</property>*
> *<property>*
> *<name>hbase.zookeeper.property.dataDir</name>*
> *<value>/home/shashwat/zookeeper</value>*
> *<description>Property from ZooKeeper's config zoo.cfg.*
> *The directory where the snapshot is stored.*
> *</description>*
> *</property>*
> *
> *
> *
> *
> *<property>*
> * <name>zookeeper.session.timeout</name>*
> * <value>18000000</value>*
> * <description>Session Time out.</description>*
> * </property>*
> * <property>*
> * <name>hbase.client.scanner.caching</name>*
> * <value>5000</value>*
> * </property>*
> *<property>*
> *<name>hbase.regionserver.lease.period</name>*
> *<value>2400000</value>*
> *</property>*
>
>
>
>
> Thanx and regards
>
> ∞
> Shashwat Shriparv
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> On Thu, Jun 7, 2012 at 3:16 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>
> > which distribution are you using??actually this is not possible..it
> > must be there..download it put it there
> >
> > Regards,
> > Mohammad Tariq
> >
> >
> > On Thu, Jun 7, 2012 at 2:41 PM, Manu S <[EMAIL PROTECTED]> wrote:
> > > Hi Tariq,
> > >
> > > Thank you!!
> > > I already changed the maxClientCnxns to 1000.
> > > Also we have set CLASSPATH that includes all the Hadoop,HBase &
> Zookeper
> > > path's. I think copying hadoop .jar files to Hbase lib folder is the
> same
> > > affect of setting CLASSPATH with all the folders.

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

shashwat shriparv 2012-06-07, 17:27

If you have separate zookeeper running no need to specify in hbase
settings...

On Thu, Jun 7, 2012 at 8:12 PM, Manu S <[EMAIL PROTECTED]> wrote:

> Hi Tariq,
>
> Version: HBase-0.90.4
> I downloaded commons-configuration-1.6.jar and put it inside HBASE_HOME/lib
> & HADOOP_HOME/lib(In pseudo distributed) and tested.
>
> *hbase(main):002:0> status
> 12/06/07 19:59:59 FATAL zookeeper.ZKConfig: The server in zoo.cfg cannot be
> set to localhost in a fully-distributed setup because it won't be
> reachable. See "Getting Started" for more information.
>
> ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able
> to connect to ZooKeeper but the connection closes immediately. This could
> be a sign that the server has too many connections (30 is the default).
> Consider inspecting your ZK server logs for that error and then make sure
> you are reusing HBaseConfiguration as often as you can. See HTable's
> javadoc for more information.*
>
> Is this common-configuration version is compatible for hbase-0.90.4?
>
>
>
> @Shashwat:
> Thank you!!
> Some parameters are missing in my hbase configuration, I will add these and
> test. The zookeeper parameters I already added in zoo.cfg. Is that enough
> or do I need to add once again in hbase configuration?
>
> Thanks,
> Manu S
>
>
> On Thu, Jun 7, 2012 at 7:11 PM, shashwat shriparv <
> [EMAIL PROTECTED]
> > wrote:
>
> > Try this settings check what you have and what you dont have in the
> > configuration :
> >
> >
> > *<configuration>*
> > *<property>*
> > *<name>hbase.rootdir</name>*
> > *<value>hdfs://{your machine name} or {localhost}:9000/hbase</value>*
> > *</property>*
> > *<property>*
> > *<name>hbase.master</name>*
> > *<value>{your machine name} or {localhost}:60000</value>*
> > *<description>The host and port that the HBase master runs
> > at.</description>
> > *
> > *</property>*
> > *<property>*
> > *<name>hbase.regionserver.port</name>*
> > *<value>60020</value>*
> > *<description>The host and port that the HBase master runs
> > at.</description>
> > *
> > *</property>*
> > **
> > *<property>*
> > *<name>hbase.cluster.distributed</name>*
> > *<value>true</value>*
> > *</property>*
> > *<property>*
> > *<name>hbase.tmp.dir</name>*
> > *<value>/home/shashwat/Hadoop/hbase-0.90.4/temp</value>*
> > *</property>*
> > *<property>*
> > *<name>hbase.zookeeper.quorum</name>*
> > *<value>{your machine name} or {localhost}</value>*
> > *</property>*
> > *<property>*
> > *<name>dfs.replication</name>*
> > *<value>1</value>*
> > *</property>*
> > *<property>*
> > *<name>hbase.zookeeper.property.clientPort</name>*
> > *<value>2181</value>*
> > *<description>Property from ZooKeeper's config zoo.cfg.*
> > *The port at which the clients will connect.*
> > *</description>*
> > *</property>*
> > *<property>*
> > *<name>hbase.zookeeper.property.dataDir</name>*
> > *<value>/home/shashwat/zookeeper</value>*
> > *<description>Property from ZooKeeper's config zoo.cfg.*
> > *The directory where the snapshot is stored.*
> > *</description>*
> > *</property>*
> > *
> > *
> > *
> > *
> > *<property>*
> > * <name>zookeeper.session.timeout</name>*
> > * <value>18000000</value>*
> > * <description>Session Time out.</description>*
> > * </property>*
> > * <property>*
> > * <name>hbase.client.scanner.caching</name>*
> > * <value>5000</value>*
> > * </property>*
> > *<property>*
> > *<name>hbase.regionserver.lease.period</name>*
> > *<value>2400000</value>*
> > *</property>*
> >
> >
> >
> >
> > Thanx and regards
> >
> > ∞
> > Shashwat Shriparv
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > On Thu, Jun 7, 2012 at 3:16 PM, Mohammad Tariq <[EMAIL PROTECTED]>
> wrote:
> >
> > > which distribution are you using??actually this is not possible..it
> > > must be there..download it put it there

∞
Shashwat Shriparv

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Mohammad Tariq 2012-06-07, 18:21

This will be thrown when the hbase.cluster.distributed is true and the
value in zoo.cfg is localhost.

Regards,
Mohammad Tariq
On Thu, Jun 7, 2012 at 10:57 PM, shashwat shriparv
<[EMAIL PROTECTED]> wrote:
> If you have separate zookeeper running no need to specify in hbase
> settings...
>
> On Thu, Jun 7, 2012 at 8:12 PM, Manu S <[EMAIL PROTECTED]> wrote:
>
>> Hi Tariq,
>>
>> Version: HBase-0.90.4
>> I downloaded commons-configuration-1.6.jar and put it inside HBASE_HOME/lib
>> & HADOOP_HOME/lib(In pseudo distributed) and tested.
>>
>> *hbase(main):002:0> status
>> 12/06/07 19:59:59 FATAL zookeeper.ZKConfig: The server in zoo.cfg cannot be
>> set to localhost in a fully-distributed setup because it won't be
>> reachable. See "Getting Started" for more information.
>>
>> ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able
>> to connect to ZooKeeper but the connection closes immediately. This could
>> be a sign that the server has too many connections (30 is the default).
>> Consider inspecting your ZK server logs for that error and then make sure
>> you are reusing HBaseConfiguration as often as you can. See HTable's
>> javadoc for more information.*
>>
>> Is this common-configuration version is compatible for hbase-0.90.4?
>>
>>
>>
>> @Shashwat:
>> Thank you!!
>> Some parameters are missing in my hbase configuration, I will add these and
>> test. The zookeeper parameters I already added in zoo.cfg. Is that enough
>> or do I need to add once again in hbase configuration?
>>
>> Thanks,
>> Manu S
>>
>>
>> On Thu, Jun 7, 2012 at 7:11 PM, shashwat shriparv <
>> [EMAIL PROTECTED]
>> > wrote:
>>
>> > Try this settings check what you have and what you dont have in the
>> > configuration :
>> >
>> >
>> > *<configuration>*
>> > *<property>*
>> > *<name>hbase.rootdir</name>*
>> > *<value>hdfs://{your machine name} or {localhost}:9000/hbase</value>*
>> > *</property>*
>> > *<property>*
>> > *<name>hbase.master</name>*
>> > *<value>{your machine name} or {localhost}:60000</value>*
>> > *<description>The host and port that the HBase master runs
>> > at.</description>
>> > *
>> > *</property>*
>> > *<property>*
>> > *<name>hbase.regionserver.port</name>*
>> > *<value>60020</value>*
>> > *<description>The host and port that the HBase master runs
>> > at.</description>
>> > *
>> > *</property>*
>> > **
>> > *<property>*
>> > *<name>hbase.cluster.distributed</name>*
>> > *<value>true</value>*
>> > *</property>*
>> > *<property>*
>> > *<name>hbase.tmp.dir</name>*
>> > *<value>/home/shashwat/Hadoop/hbase-0.90.4/temp</value>*
>> > *</property>*
>> > *<property>*
>> > *<name>hbase.zookeeper.quorum</name>*
>> > *<value>{your machine name} or {localhost}</value>*
>> > *</property>*
>> > *<property>*
>> > *<name>dfs.replication</name>*
>> > *<value>1</value>*
>> > *</property>*
>> > *<property>*
>> > *<name>hbase.zookeeper.property.clientPort</name>*
>> > *<value>2181</value>*
>> > *<description>Property from ZooKeeper's config zoo.cfg.*
>> > *The port at which the clients will connect.*
>> > *</description>*
>> > *</property>*
>> > *<property>*
>> > *<name>hbase.zookeeper.property.dataDir</name>*
>> > *<value>/home/shashwat/zookeeper</value>*
>> > *<description>Property from ZooKeeper's config zoo.cfg.*
>> > *The directory where the snapshot is stored.*
>> > *</description>*
>> > *</property>*
>> > *
>> > *
>> > *
>> > *
>> > *<property>*
>> > * <name>zookeeper.session.timeout</name>*
>> > * <value>18000000</value>*
>> > * <description>Session Time out.</description>*
>> > * </property>*
>> > * <property>*
>> > * <name>hbase.client.scanner.caching</name>*
>> > * <value>5000</value>*
>> > * </property>*
>> > *<property>*
>> > *<name>hbase.regionserver.lease.period</name>*
>> > *<value>2400000</value>*
>> > *</property>*

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Manu S 2012-06-20, 05:20

Hi All,

I am still facing this issue in our fully distributed cluster, but its
working fine in pseudo-distributed node.

We have installed *ZooKeeper *on our *Master node* which contains
*Hbase-Master,
Namenode & Job tracker*.
4 slave nodes having *Hbase-region, Datanode & Task tracker.*

Zookeeper can be installed with Hbase-master, right?

I did all the configuration changes in zoo.cfg & hbase-site.xml, copied all
the hadoop jar & common-configuration jar to Hbase/lib directory. But still
I am getting the same error

*Caused by: org.apache.hadoop.hbase.**ZooKeeperConnectionException:
HBase is able to connect to ZooKeeper but the connection closes immediately.
This could be a sign that the server has too many connections (30 is
the default).
Consider inspecting your ZK server logs for that error and then make
sure you are reusing HBaseConfiguration as often as you can.
See HTable's javadoc for more information**.*
Is there any specific code modifications for writing output into HDFS using
mapreduce or configuration problem?? Because it is working fine in
pseudo-distributed node.

Appreciate your help on the same.

Thanks,
Manu S
On Thu, Jun 7, 2012 at 10:57 PM, shashwat shriparv <
[EMAIL PROTECTED]> wrote:

> If you have separate zookeeper running no need to specify in hbase
> settings...
>
> On Thu, Jun 7, 2012 at 8:12 PM, Manu S <[EMAIL PROTECTED]> wrote:
>
> > Hi Tariq,
> >
> > Version: HBase-0.90.4
> > I downloaded commons-configuration-1.6.jar and put it inside
> HBASE_HOME/lib
> > & HADOOP_HOME/lib(In pseudo distributed) and tested.
> >
> > *hbase(main):002:0> status
> > 12/06/07 19:59:59 FATAL zookeeper.ZKConfig: The server in zoo.cfg cannot
> be
> > set to localhost in a fully-distributed setup because it won't be
> > reachable. See "Getting Started" for more information.
> >
> > ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is
> able
> > to connect to ZooKeeper but the connection closes immediately. This could
> > be a sign that the server has too many connections (30 is the default).
> > Consider inspecting your ZK server logs for that error and then make sure
> > you are reusing HBaseConfiguration as often as you can. See HTable's
> > javadoc for more information.*
> >
> > Is this common-configuration version is compatible for hbase-0.90.4?
> >
> >
> >
> > @Shashwat:
> > Thank you!!
> > Some parameters are missing in my hbase configuration, I will add these
> and
> > test. The zookeeper parameters I already added in zoo.cfg. Is that enough
> > or do I need to add once again in hbase configuration?
> >
> > Thanks,
> > Manu S
> >
> >
> > On Thu, Jun 7, 2012 at 7:11 PM, shashwat shriparv <
> > [EMAIL PROTECTED]
> > > wrote:
> >
> > > Try this settings check what you have and what you dont have in the
> > > configuration :
> > >
> > >
> > > *<configuration>*
> > > *<property>*
> > > *<name>hbase.rootdir</name>*
> > > *<value>hdfs://{your machine name} or {localhost}:9000/hbase</value>*
> > > *</property>*
> > > *<property>*
> > > *<name>hbase.master</name>*
> > > *<value>{your machine name} or {localhost}:60000</value>*
> > > *<description>The host and port that the HBase master runs
> > > at.</description>
> > > *
> > > *</property>*
> > > *<property>*
> > > *<name>hbase.regionserver.port</name>*
> > > *<value>60020</value>*
> > > *<description>The host and port that the HBase master runs
> > > at.</description>
> > > *
> > > *</property>*
> > > **
> > > *<property>*
> > > *<name>hbase.cluster.distributed</name>*
> > > *<value>true</value>*
> > > *</property>*
> > > *<property>*
> > > *<name>hbase.tmp.dir</name>*
> > > *<value>/home/shashwat/Hadoop/hbase-0.90.4/temp</value>*
> > > *</property>*
> > > *<property>*
> > > *<name>hbase.zookeeper.quorum</name>*
> > > *<value>{your machine name} or {localhost}</value>*

Re: HBase is able to connect to ZooKeeper but the connection closes immediately

Manu S 2012-06-20, 06:03

Sorry, a mistake in the previous mail. The mapred output is saving to Hbase
table.

Is there any specific code modifications for writing output into *HBase *using
mapreduce or configuration problem?? Because it is working fine in
pseudo-distributed node.

On Wed, Jun 20, 2012 at 10:50 AM, Manu S <[EMAIL PROTECTED]> wrote:

> Hi All,
>
> I am still facing this issue in our fully distributed cluster, but its
> working fine in pseudo-distributed node.
>
> We have installed *ZooKeeper *on our *Master node* which contains *Hbase-Master,
> Namenode & Job tracker*.
> 4 slave nodes having *Hbase-region, Datanode & Task tracker.*
>
> Zookeeper can be installed with Hbase-master, right?
>
> I did all the configuration changes in zoo.cfg & hbase-site.xml, copied
> all the hadoop jar & common-configuration jar to Hbase/lib directory. But
> still I am getting the same error
>
> *Caused by: org.apache.hadoop.hbase.**ZooKeeperConnectionException:
> HBase is able to connect to ZooKeeper but the connection closes immediately.
>
> This could be a sign that the server has too many connections (30 is the default).
> Consider inspecting your ZK server logs for that error and then make sure you are reusing HBaseConfiguration as often as you can.
>
> See HTable's javadoc for more information**.*
>
>
> Is there any specific code modifications for writing output into HDFS
> using mapreduce or configuration problem?? Because it is working fine in
> pseudo-distributed node.
>
> Appreciate your help on the same.
>
> Thanks,
> Manu S
>
> On Thu, Jun 7, 2012 at 10:57 PM, shashwat shriparv <
> [EMAIL PROTECTED]> wrote:
>
>> If you have separate zookeeper running no need to specify in hbase
>> settings...
>>
>> On Thu, Jun 7, 2012 at 8:12 PM, Manu S <[EMAIL PROTECTED]> wrote:
>>
>> > Hi Tariq,
>> >
>> > Version: HBase-0.90.4
>> > I downloaded commons-configuration-1.6.jar and put it inside
>> HBASE_HOME/lib
>> > & HADOOP_HOME/lib(In pseudo distributed) and tested.
>> >
>> > *hbase(main):002:0> status
>> > 12/06/07 19:59:59 FATAL zookeeper.ZKConfig: The server in zoo.cfg
>> cannot be
>> > set to localhost in a fully-distributed setup because it won't be
>> > reachable. See "Getting Started" for more information.
>> >
>> > ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is
>> able
>> > to connect to ZooKeeper but the connection closes immediately. This
>> could
>> > be a sign that the server has too many connections (30 is the default).
>> > Consider inspecting your ZK server logs for that error and then make
>> sure
>> > you are reusing HBaseConfiguration as often as you can. See HTable's
>> > javadoc for more information.*
>> >
>> > Is this common-configuration version is compatible for hbase-0.90.4?
>> >
>> >
>> >
>> > @Shashwat:
>> > Thank you!!
>> > Some parameters are missing in my hbase configuration, I will add these
>> and
>> > test. The zookeeper parameters I already added in zoo.cfg. Is that
>> enough
>> > or do I need to add once again in hbase configuration?
>> >
>> > Thanks,
>> > Manu S
>> >
>> >
>> > On Thu, Jun 7, 2012 at 7:11 PM, shashwat shriparv <
>> > [EMAIL PROTECTED]
>> > > wrote:
>> >
>> > > Try this settings check what you have and what you dont have in the
>> > > configuration :
>> > >
>> > >
>> > > *<configuration>*
>> > > *<property>*
>> > > *<name>hbase.rootdir</name>*
>> > > *<value>hdfs://{your machine name} or {localhost}:9000/hbase</value>*
>> > > *</property>*
>> > > *<property>*
>> > > *<name>hbase.master</name>*
>> > > *<value>{your machine name} or {localhost}:60000</value>*
>> > > *<description>The host and port that the HBase master runs
>> > > at.</description>
>> > > *
>> > > *</property>*
>> > > *<property>*
>> > > *<name>hbase.regionserver.port</name>*
>> > > *<value>60020</value>*
>> > > *<description>The host and port that the HBase master runs
>> > > at.</description>
>> > > *
>> > > *</property>*
>> > > *<!--<property>*
>> > > *<name>hbase.master.port</name>*
>> > > *<value>60000</value>*

"HBase is able to connect to ZooKeeper but the connection closes immediately..."

Ryan Compton 2013-03-12, 20:42

When I try to access HBase from a cluster node which is not the
zookeeper server I have the following problem:

-bash-3.2$ hostname
node33
-bash-3.2$ hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.90.4-cdh3u3, r, Thu Jan 26 10:13:36 PST 2012

hbase(main):001:0> status

ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is
able to connect to ZooKeeper but the connection closes immediately.
This could be a sign that the server has too many connections (30 is
the default). Consider inspecting your ZK server logs for that error
and then make sure you are reusing HBaseConfiguration as often as you
can. See HTable's javadoc for more information.

Here is some help for this command:
Show cluster status. Can be 'summary', 'simple', or 'detailed'. The
default is 'summary'. Examples:

  hbase> status
  hbase> status 'simple'
  hbase> status 'summary'
  hbase> status 'detailed'
hbase(main):002:0>
Now, if I log into the zookeeper server I can do:

-bash-3.2$ hostname
master
-bash-3.2$ hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.90.4-cdh3u3, r, Thu Jan 26 10:13:36 PST 2012

hbase(main):001:0> status
34 servers, 0 dead, 59.0882 average load

hbase(main):002:0>
What's going on? I suspect that HBase should be able to read/write
from any node that I can modify hdfs from.