Eric:
       I understand what you mean。
         jar cf $CHUKWA_HOME/hbase-env.jar $HBASE_CONF_DIR  
  pig -Dpig.additional.jars=${HBASE_HOME}/hbase-0.90.4.jar:${HBASE_HOME}/lib/zookeeper-3.3.2.jar:${PIG_PATH}/pig.jar:${CHUKWA_HOME}/hbase-env.jar ${CHUKWA_HOME}/script/pig/ClusterSummary.pig
     I also set it. in the single node model. I can run the pig and view hicc's chart. in cluster model,my hbase and chukwa are running normally.  but always error  in pig running:
    org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect to ZooKeeper but the connection closes immediately. This could be a sign that the server has too many connections (30 is the default).....................
     I wonder whether you encountered such a situation.  thanks.
  
 best regards
    mason
 ------------------ Original ------------------
  From:  "Eric Yang"<[EMAIL PROTECTED]>;
 Date:  Wed, Aug 15, 2012 10:35 PM
 To:  "[EMAIL PROTECTED]"<[EMAIL PROTECTED]>;
 Cc:  "chukwa-user"<[EMAIL PROTECTED]>;
 Subject:  Re: Connector error

 

 This is caused by the Hbase configuration is not in the class path of pig script.  I work around this by jar up hbase config directory and pass as additional jar to pig.
 
Sent from my iPhone
 
On Aug 15, 2012, at 12:45 AM, "dengyule" <[EMAIL PROTECTED]> wrote:
 
   Eric:
       Thank you for your valuable reply。According to your tips, now my collecor can collect data,and my hbase  and chukwa also all normal。but when i use the pig to run the ClusterSummary.pig . Always occur the following error message：
org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect to ZooKeeper but the connection closes immediately. This could be a sign that the server has too many connections (30 is the default). Consider inspecting your ZK server logs for that error and then make sure you are reusing HBaseConfiguration as often as you can. See HTable's javadoc for more information.
at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
at org.apache.pig.backend.hadoop.hbase.HBaseStorage..setLocation(HBaseStorage.java:438)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(PigInputFormat.java:134)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.createRecordReader(PigInputFormat.java:112)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:489)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:731)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
       　Ｉusing  HBase provided ZooKeeper.  this is  my hbase-site.xml file:
                       <configuration>
 <property>
    <name>hbase.rootdir</name>
    <value>hdfs://master:9000/hbase</value>
</property>
<property>
   <name>hbase.cluster.distributed</name>
   <value>true</value>
</property>
<property>
   <name>hbase.master.port</name>
   <value>6000</value>
</property>
<property>
   <name>hbase.zookeeper.quorum</name>
   <value>master</value>
</property>
<property>
  <name>hbase.master.maxclockskew</name>
  <value>360000</value>
</property>
 <property>
   <name>hbase.zookeeper.property.maxClientCnxns</name>
   <value>0</value>
 </property>
</configuration>

  
 Undo edits

  
 
 
    
         Reference to some of tips. say may be host problem .this is my /etc/hosts file(master and slave are the same )
            192.168.10.15      master
            192.168.10.47      h1  
            192.168.10.46      h2
            192.168.10.41      h3
            192.168.10.68      h4
            192.168.10.79      h5
            192.168.10.76      h6
            192.168.10.86      h7
         Can you tell me how to solve this problem? thanks again.
 

best regards :
         mason

    
 
   automatically translated by Google
     verb
  can 可以, 可, 能, 能够, 会, 堪
  be able to 能够, 可以, 可, 会
  be capable of 能够
  adjective
  able 能够, 能, 能力, 有能力, 会, 干
  

  

 ------------------ Original ------------------
  From:  "Eric Yang"<[EMAIL PROTECTED]>;
 Date:  Tue, Aug 14, 2012 01:51 PM
 To:  "chukwa-user"<[EMAIL PROTECTED]>;
 
 Subject:  Re: Connector error

 

Hi Mason,

Are you using HBase provided ZooKeeper or standalone ZooKeeper?  HBase
client in collector is trying to access ZooKeeper at port 21818, and
unable to connect because there is no ZooKeeper running on port 21818.
 Standalone ZooKeeper is running at port 2181, and hbase-site.xml may
not have been configured correctly on the class path of collector.
HBASE_CONF_DIR should be defined in chukwa-env.sh for this to work
properly.  Hope this helps.

regards,
Eric

Make sure you have zookeeper host and port defined in hbase-site.xml.  The
error looks like they are not defined.

<property>
      <name>hbase.zookeeper.property.clientPort</name>
      <value>2222</value>
      <description>Property from ZooKeeper's config zoo.cfg.
      The port at which the clients will connect.
      </description>
    </property>
    <property>
      <name>hbase.zookeeper.quorum</name>
      <value>rs1.example.com,rs2.example.com,rs3.example.com,rs4.example.com,rs5.example.com</value>
      <description>Comma separated list of servers in the ZooKeeper Quorum.
      For example, "host1.mydomain.com,host2.mydomain.com,host3.mydomain.com".
      By default this is set to localhost for local and pseudo-distributed modes
      of operation. For a fully-distributed setup, this should be set to a full
      list of ZooKeeper quorum servers. If HBASE_MANAGES_ZK is set in
hbase-env.sh
      this is the list of servers which we will start/stop ZooKeeper on.
      </description>
    </property>
On Thu, Aug 16, 2012 at 5:10 AM, dengyule <[EMAIL PROTECTED]> wrote:

> Eric:
> **
>      I understand what you mean。
>         jar cf $CHUKWA_HOME/hbase-env.jar $HBASE_CONF_DIR
>
> pig
> -Dpig.additional.jars=${HBASE_HOME}/hbase-0.90.4.jar:${HBASE_HOME}/lib/zookeeper-3.3.2.jar:${PIG_PATH}/pig.jar:${CHUKWA_HOME}/hbase-env.jar
> ${CHUKWA_HOME}/script/pig/ClusterSummary.pig
>
>     I also set it. in the single node model. I can run the pig and view
> hicc's chart. in cluster model,my hbase and chukwa are running normally.
> but always error  in pig running:
>    org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to
> connect to ZooKeeper but the connection closes immediately. This could be a
> sign that the server has too many connections (30 is the
> default).....................
>     I wonder whether you encountered such a situation.  thanks.
>
> best regards
>    mason
> ------------------ Original ------------------
>  *From: * "Eric Yang"<[EMAIL PROTECTED]>;
> *Date: * Wed, Aug 15, 2012 10:35 PM
> *To: * "[EMAIL PROTECTED]"<[EMAIL PROTECTED]>;
> **
> *Cc: * "chukwa-user"<[EMAIL PROTECTED]>; **
> *Subject: * Re: Connector error
>
> This is caused by the Hbase configuration is not in the class path of pig
> script.  I work around this by jar up hbase config directory and pass as
> additional jar to pig.
>
> Sent from my iPhone
>
> On Aug 15, 2012, at 12:45 AM, "dengyule" <[EMAIL PROTECTED]> wrote:
>
>   Eric:
>        Thank you for your valuable reply。According to your tips, now my
> collecor can collect data,and my hbase  and chukwa also all normal。but
> when i use the pig to run the ClusterSummary.pig . Always occur the
> following error message：
>
> org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect to ZooKeeper but the connection closes immediately. This could be a sign that the server has too many connections (30 is the default). Consider inspecting your ZK server logs for that error and then make sure you are reusing HBaseConfiguration as often as you can. See HTable's javadoc for more information.
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> at org.apache.pig.backend.hadoop.hbase.HBaseStorage..setLocation(HBaseStorage.java:438)
>
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(PigInputFormat.java:134)

Eric:
       Thank  you for your valuable reply。According  to your tips, now my collecor can  collect data,and my hbase   and chukwa also all normal。but when i use the pig to run the ClusterSummary.pig . Always occur the following error message：
org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect to ZooKeeper but the connection closes immediately. This could be a sign that the server has too many connections (30 is the default). Consider inspecting your ZK server logs for that error and then make sure you are reusing HBaseConfiguration as often as you can. See HTable's javadoc for more information.
at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
at org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:438)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(PigInputFormat.java:134)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.createRecordReader(PigInputFormat.java:112)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:489)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:731)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
       　Ｉusing  HBase provided ZooKeeper.  this is  my hbase-site.xml file:
                       <configuration>
<property>
    <name>hbase.rootdir</name>
    <value>hdfs://master:9000/hbase</value>
</property>
<property>
   <name>hbase.cluster.distributed</name>
   <value>true</value>
</property>
<property>
   <name>hbase.master.port</name>
   <value>6000</value>
</property>
<property>
   <name>hbase.zookeeper.quorum</name>
   <value>master</value>
</property>
<property>
  <name>hbase.master.maxclockskew</name>
  <value>360000</value>
</property>
 <property>
   <name>hbase.zookeeper.property.maxClientCnxns</name>
   <value>0</value>
 </property>
</configuration>
Undo edits

         Reference  to some of tips. say may be host problem .this is my /etc/hosts file(master and slave are the same )
            192.168.10.15      master
            192.168.10.47      h1  
            192.168.10.46      h2
            192.168.10.41      h3
            192.168.10.68      h4
            192.168.10.79      h5
            192.168.10.76      h6
            192.168.10.86      h7
         Can  you tell me how to  solve this problem? thanks again.
 

best regards :
         mason

automatically  translated by Google
verb
can可以, 可, 能, 能够, 会, 堪
be able to能够, 可以, 可, 会
be capable of能够
adjective
able能够, 能, 能力, 有能力, 会, 干

 
  

------------------ Original ------------------
From:  "Eric Yang"<[EMAIL PROTECTED]>;
Date:  Tue, Aug 14, 2012 01:51 PM
To:  "chukwa-user"<[EMAIL PROTECTED]>;

Subject:  Re: Connector error

Hi Mason,

Are you using HBase provided ZooKeeper or standalone ZooKeeper?  HBase
client in collector is trying to access ZooKeeper at port 21818, and
unable to connect because there is no ZooKeeper running on port 21818.
 Standalone ZooKeeper is running at port 2181, and hbase-site.xml may
not have been configured correctly on the class path of collector.
HBASE_CONF_DIR should be defined in chukwa-env.sh for this to work
properly.  Hope this helps.

regards,
Eric

This is caused by the Hbase configuration is not in the class path of pig script.  I work around this by jar up hbase config directory and pass as additional jar to pig.

Sent from my iPhone

On Aug 15, 2012, at 12:45 AM, "dengyule" <[EMAIL PROTECTED]> wrote:

> Eric:
>        Thank you for your valuable reply。According to your tips, now my collecor can collect data,and my hbase  and chukwa also all normal。but when i use the pig to run the ClusterSummary.pig . Always occur the following error message：
> org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect to ZooKeeper but the connection closes immediately. This could be a sign that the server has too many connections (30 is the default). Consider inspecting your ZK server logs for that error and then make sure you are reusing HBaseConfiguration as often as you can. See HTable's javadoc for more information.
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:155)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> at org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> at org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:438)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(PigInputFormat.java:134)
> at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.createRecordReader(PigInputFormat.java:112)
> at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:489)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:731)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
>        　Ｉusing  HBase provided ZooKeeper.  this is  my hbase-site.xml file:
>                        <configuration>
> <property>
>     <name>hbase.rootdir</name>
>     <value>hdfs://master:9000/hbase</value>
> </property>
> <property>
>    <name>hbase.cluster.distributed</name>
>    <value>true</value>
> </property>
> <property>
>    <name>hbase.master.port</name>
>    <value>6000</value>
> </property>
> <property>
>    <name>hbase.zookeeper.quorum</name>
>    <value>master</value>
> </property>
> <property>
>   <name>hbase.master.maxclockskew</name>
>   <value>360000</value>
> </property>
>  <property>
>    <name>hbase.zookeeper.property.maxClientCnxns</name>
>    <value>0</value>
>  </property>
> </configuration>
>          Reference to some of tips. say may be host problem .this is my /etc/hosts file(master and slave are the same )
>             192.168.10.15      master
>             192.168.10.47      h1  
>             192.168.10.46      h2
>             192.168.10.41      h3
>             192.168.10.68      h4
>             192.168.10.79      h5
>             192.168.10.76      h6
>             192.168.10.86      h7
>          Can you tell me how to solve this problem? thanks again.
>  
>
> best regards :
>          mason
>
>  
> ------------------ Original ------------------
> From:  "Eric Yang"<[EMAIL PROTECTED]>;
> Date:  Tue, Aug 14, 2012 01:51 PM
> To:  "chukwa-user"<[EMAIL PROTECTED]>;
> Subject:  Re: Connector error
>
> Hi Mason,
>
> Are you using HBase provided ZooKeeper or standalone ZooKeeper?  HBase
> client in collector is trying to access ZooKeeper at port 21818, and
> unable to connect because there is no ZooKeeper running on port 21818.

Hi, Eric:
      When I running the chukwa in cluster,I encountered a question about
the hbase  Connector .My HBase normal run, But Connector error has
occurred,   my hbase is 0.90.4 ,and hadoop is hadoop-1.0.0.chukwa is
chukwa-0.5.0 .
         Connector.log  error tips is :

2012-08-11 21:50:51,693 INFO Timer-2 HBaseWriter -
stat=HBaseWriter|dataRate=0

2012-08-11 21:50:51,766 INFO btpool0-1-SendThread(localhost:21818)
ClientCnxn - Opening socket connection to server localhost/127.0.0.1:21818

2012-08-11 21:50:51,767 WARN btpool0-1-SendThread(localhost:21818)
ClientCnxn - Session 0x0 for server null, unexpected error, closing socket
connection and attempting reconnect

java.net.ConnectException: Connection refused

    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)

    at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)

    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)

As someone's advice ,i removed the IPV6 in /etc/hosts （：：1 localhost）and
disable the ipv6 functions.But still could not solve the problem。Can you
tell me how
to solve the problem? thanks！
Best regards ，
rainerdun

Hi Mason,

Are you using HBase provided ZooKeeper or standalone ZooKeeper?  HBase
client in collector is trying to access ZooKeeper at port 21818, and
unable to connect because there is no ZooKeeper running on port 21818.
 Standalone ZooKeeper is running at port 2181, and hbase-site.xml may
not have been configured correctly on the class path of collector.
HBASE_CONF_DIR should be defined in chukwa-env.sh for this to work
properly.  Hope this helps.

regards,
Eric

On Mon, Aug 13, 2012 at 6:45 AM, mason deng <[EMAIL PROTECTED]> wrote:
> Hi, Eric:
>       When I running the chukwa in cluster,I encountered a question about
> the hbase  Connector .My HBase normal run, But Connector error has occurred,
> my hbase is 0.90.4 ,and hadoop is hadoop-1.0.0.chukwa is chukwa-0.5.0 .
>          Connector.log  error tips is :
>
> 2012-08-11 21:50:51,693 INFO Timer-2 HBaseWriter -
> stat=HBaseWriter|dataRate=0
>
> 2012-08-11 21:50:51,766 INFO btpool0-1-SendThread(localhost:21818)
> ClientCnxn - Opening socket connection to server localhost/127.0.0.1:21818
>
> 2012-08-11 21:50:51,767 WARN btpool0-1-SendThread(localhost:21818)
> ClientCnxn - Session 0x0 for server null, unexpected error, closing socket
> connection and attempting reconnect
>
> java.net.ConnectException: Connection refused
>
>     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>
>     at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
>
>     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
>
> As someone's advice ,i removed the IPV6 in /etc/hosts （：：1 localhost）and
> disable the ipv6 functions.But still could not solve the problem。Can you
> tell me how
> to solve the problem? thanks！
>
>
> Best regards ，
> rainerdun
>
>
>
>