Hi,

I try to start HBase in a distribute model. But, I am failure with the
following error mssae. Anybody here has hint to solve this issue? thanks in
advance!

Yiyu
2012-11-05 23:10:21,217 ERROR
org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master
java.lang.RuntimeException: HMaster Aborted
at
org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:154)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:103)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1806)
2012-11-05 23:10:21,221 ERROR org.apache.hadoop.hdfs.DFSClient: Exception
closing file /hbase-hadoopuser/hbase/hbase.version :
org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
/hbase-hadoopuser/hbase/hbase.version could only be replicated to 0 nodes,
instead of 1
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1558)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:696)
at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:416)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)

My hbase-site.xml :

<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
/**
 * Licensed to the Apache Software Foundation (ASF) under one
 * or more contributor license agreements.  See the NOTICE file
 * distributed with this work for additional information
 * regarding copyright ownership.  The ASF licenses this file
 * to you under the Apache License, Version 2.0 (the
 * "License"); you may not use this file except in compliancef
 * with the License.  You may obtain a copy of the License at
 *
 *     http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */
-->
<configuration>
  <property>
    <name>hbase.rootdir</name>
    <value>hdfs://cent63V1.corp.ybusa.net:9000/hbase-${user.name}/hbase
</value>
    <description>The directory shared by region servers and into
    which HBase persists.  The URL should be 'fully-qualified'
    to include the filesystem scheme.  For example, to specify the
    HDFS directory '/hbase' where the HDFS instance's namenode is
    running at namenode.example.org on port 9000, set this value to:
    hdfs://namenode.example.org:9000/hbase.  By default HBase writes
    into /tmp.  Change this configuration else all data will be lost
    on machine restart.
    </description>
  </property>
  <property>
    <name>hbase.master.port</name>
    <value>60000</value>
    <description>The port the HBase Master should bind to.</description>
  </property>
  <property>
    <name>hbase.cluster.distributed</name>
    <value>true</value>
    <description>The mode the cluster will be in. Possible values are
      false for standalone mode and true for distributed mode.  If
      false, startup will run all HBase and ZooKeeper daemons together
      in the one JVM.
    </description>
  </property>
   <property>
    <name>hbase.master.info.port</name>
    <value>60010</value>
    <description>The port for the HBase Master web UI.
    Set to -1 if you do not want a UI instance run.
    </description>
  </property>
  <property>
    <name>hbase.master.info.bindAddress</name>
    <value>0.0.0.0</value>
    <description>The bind address for the HBase Master web UI
    </description>
  </property>
  <property>
    <name>hbase.client.write.buffer</name>
    <value>2097152</value>
    <description>Default size of the HTable clien write buffer in bytes.
    A bigger buffer takes more memory -- on both the client and server
    side since server instantiates the passed write buffer to process
    it -- but a larger buffer size reduces the number of RPCs made.
    For an estimate of server-side memory-used, evaluate
    hbase.client.write.buffer * hbase.regionserver.handler.count
    </description>
  </property>
  <property>
    <name>hbase.regionserver.port</name>
    <value>60020</value>
    <description>The port the HBase RegionServer binds to.
    </description>
  </property>
  <property>
    <name>hbase.regionserver.info.port</name>
    <value>60030</value>
    <description>The port for the HBase RegionServer web UI
    Set to -1 if you do not want the RegionServer UI to run.
    </description>
  </property>
    <property>
    <name>hbase.regionserver.info.bindAddress</name>
    <value>0.0.0.0</value>
    <description>The address for the HBase RegionServer web UI
    </description>
  </property>

  <property>
    <name>hbase.zookeeper.dns.nameserver</name>
    <value>10.0.40.1</value>
    <description>The host name or IP address of the name server (DNS)
      which a ZooKeeper server should use to determine the host name used
by the
      master for communication and display purposes.
    </description>
  </property>
  <property>
    <name>hbase.regionserver.dns.nameserver</name>
    <value>10.0.40.1</value>
    <description>The host name or IP address of the name server (DNS)
      which a region server should use to determine the host name used by
th

After disable iptables service on my CentOS 6.3 machine, HBase master
starts up. This is strange as I open all ports number i can find in cfg
file and log files already.

anybody has a list of port number, which should be opened through firewall?

On Mon, Nov 5, 2012 at 11:16 PM, yiyu jia <[EMAIL PROTECTED]> wrote:

>
> Hi,
>
> I try to start HBase in a distribute model. But, I am failure with the
> following error mssae. Anybody here has hint to solve this issue? thanks in
> advance!
>
> Yiyu
>
>
>
>
> 2012-11-05 23:10:21,217 ERROR
> org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master
> java.lang.RuntimeException: HMaster Aborted
>  at
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:154)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:103)
>  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
>  at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1806)
> 2012-11-05 23:10:21,221 ERROR org.apache.hadoop.hdfs.DFSClient: Exception
> closing file /hbase-hadoopuser/hbase/hbase.version :
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
> /hbase-hadoopuser/hbase/hbase.version could only be replicated to 0 nodes,
> instead of 1
>  at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1558)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:696)
>  at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:616)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
>  at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
>  at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:416)
>  at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)
>
>
>
> My hbase-site.xml :
>
> <?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <!--
> /**
>  * Licensed to the Apache Software Foundation (ASF) under one
>  * or more contributor license agreements.  See the NOTICE file
>  * distributed with this work for additional information
>  * regarding copyright ownership.  The ASF licenses this file
>  * to you under the Apache License, Version 2.0 (the
>  * "License"); you may not use this file except in compliancef
>  * with the License.  You may obtain a copy of the License at
>  *
>  *     http://www.apache.org/licenses/LICENSE-2.0
>  *
>  * Unless required by applicable law or agreed to in writing, software
>  * distributed under the License is distributed on an "AS IS" BASIS,
>  * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
>  * See the License for the specific language governing permissions and
>  * limitations under the License.
>  */
> -->
> <configuration>
>   <property>
>     <name>hbase.rootdir</name>
>     <value>hdfs://cent63V1.corp.ybusa.net:9000/hbase-${user.name}/hbase<http://cent63V1.corp.ybusa.net:9000/hbase-$%7Buser.name%7D/hbase>
> </value>
>     <description>The directory shared by region servers and into
>     which HBase persists.  The URL should be 'fully-qualified'
>     to include the filesystem scheme.  For example, to specify the
>     HDFS directory '/hbase' where the HDFS instance's namenode is
>     running at namenode.example.org on port 9000, set this value to:
>     hdfs://namenode.example.org:9000/hbase.  By default HBase writes
>     into /tmp.  Change this configuration else all data will be lost
>     on machine restart.
>     </description>
>   </property>
>   <property>
>     <name>hbase.master.port</name>
******************************************
* Mr. Jia Yiyu                                *
*                                                   *
* Email: [EMAIL PROTECTED]          *
*                                                   *
* Web: http://yiyujia.blogspot.com/*
*******************************************

You don�t have to disable firewall, just enable the required ports for
Hadoop and HBase:
All ports for Hadoop 1.0.4:
  NameNode RPC Server 8020
  JobTracker RPC Server 8021
  RPC Service 50020
  TCP/IP Server for block tranfers 50010
  NameNode HTTP Service 50070
  DataNode HTTP Service 50075
  JobTracker HTTP Service 50030
  TaskTracker HTTP Service 50060
  Secondary NameNode HTTP Service 50090

All ports for HBase:
HBase Master RPC Service 60000
HBase Master HTTP Service 60010
Region Server RPC Service 60020
Region Server HTTP Service 60030
On 11/05/2012 11:38 PM, yiyu jia wrote:
> After disable iptables service on my CentOS 6.3 machine, HBase master
> starts up. This is strange as I open all ports number i can find in cfg
> file and log files already.
>
> anybody has a list of port number, which should be opened through firewall?
>
>
>
> On Mon, Nov 5, 2012 at 11:16 PM, yiyu jia <[EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> I try to start HBase in a distribute model. But, I am failure with the
>> following error mssae. Anybody here has hint to solve this issue? thanks in
>> advance!
>>
>> Yiyu
>>
>>
>>
>>
>> 2012-11-05 23:10:21,217 ERROR
>> org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master
>> java.lang.RuntimeException: HMaster Aborted
>>   at
>> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:154)
>> at
>> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:103)
>>   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>> at
>> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
>>   at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1806)
>> 2012-11-05 23:10:21,221 ERROR org.apache.hadoop.hdfs.DFSClient: Exception
>> closing file /hbase-hadoopuser/hbase/hbase.version :
>> org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
>> /hbase-hadoopuser/hbase/hbase.version could only be replicated to 0 nodes,
>> instead of 1
>>   at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1558)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:696)
>>   at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>   at java.lang.reflect.Method.invoke(Method.java:616)
>> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
>>   at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
>> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
>>   at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:416)
>>   at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)
>>
>>
>>
>> My hbase-site.xml :
>>
>> <?xml version="1.0"?>
>> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>> <!--
>> /**
>>   * Licensed to the Apache Software Foundation (ASF) under one
>>   * or more contributor license agreements.  See the NOTICE file
>>   * distributed with this work for additional information
>>   * regarding copyright ownership.  The ASF licenses this file
>>   * to you under the Apache License, Version 2.0 (the
>>   * "License"); you may not use this file except in compliancef
>>   * with the License.  You may obtain a copy of the License at
>>   *
>>   *     http://www.apache.org/licenses/LICENSE-2.0
>>   *
>>   * Unless required by applicable law or agreed to in writing, software
>>   * distributed under the License is distributed on an "AS IS" BASIS,
>>   * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
>>   * See the License for the specific language governing permissions and
>>   * limitations under the License.
>>   */
>> -->
>> <configuration>
>>    <property>
>>      <name>hbase.rootdir</name>
>>      <value>hdfs://cent63V1.corp.ybusa.net:9000/hbase-${user.name}/hbase<http://cent63V1.corp.ybusa.net:9000/hbase-$%7Buser.name%7D/hbase>
Marcos Luis Ort�z Valmaseda
about.me/marcosortiz <http://about.me/marcosortiz>
@marcosluis2186 <http://twitter.com/marcosluis2186>

10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION

http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci

Hi Marcos,

Thank you for helps.

I think I enabled all these port already. Also, I think we need to enable
ports for zookeeper as well for a distributed installation.

What I am doing now is 1) disable the iptables and start hbase.  2) use
netstat to list out all listened port. 3) check them one by one in all
configruation files and enable them in firewall.

Any further suggestion is appreciated.

Yiyu
On Tue, Nov 6, 2012 at 8:58 AM, Marcos Ortiz <[EMAIL PROTECTED]> wrote:

>
> You don´t have to disable firewall, just enable the required ports for
> Hadoop and HBase:
> All ports for Hadoop 1.0.4:
>  NameNode RPC Server 8020
>  JobTracker RPC Server 8021
>  RPC Service 50020
>  TCP/IP Server for block tranfers 50010
>  NameNode HTTP Service 50070
>  DataNode HTTP Service 50075
>  JobTracker HTTP Service 50030
>  TaskTracker HTTP Service 50060
>  Secondary NameNode HTTP Service 50090
>
> All ports for HBase:
> HBase Master RPC Service 60000
> HBase Master HTTP Service 60010
> Region Server RPC Service 60020
> Region Server HTTP Service 60030
>
>
>
> On 11/05/2012 11:38 PM, yiyu jia wrote:
>
> After disable iptables service on my CentOS 6.3 machine, HBase master
> starts up. This is strange as I open all ports number i can find in cfg
> file and log files already.
>
> anybody has a list of port number, which should be opened through firewall?
>
>
>
> On Mon, Nov 5, 2012 at 11:16 PM, yiyu jia <[EMAIL PROTECTED]> <[EMAIL PROTECTED]> wrote:
>
>
>
> Hi,
>
> I try to start HBase in a distribute model. But, I am failure with the
> following error mssae. Anybody here has hint to solve this issue? thanks in
> advance!
>
> Yiyu
>
>
>
>
> 2012-11-05 23:10:21,217 ERROR
> org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master
> java.lang.RuntimeException: HMaster Aborted
>  at
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:154)
> at
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:103)
>  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
>  at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1806)
> 2012-11-05 23:10:21,221 ERROR org.apache.hadoop.hdfs.DFSClient: Exception
> closing file /hbase-hadoopuser/hbase/hbase.version :
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
> /hbase-hadoopuser/hbase/hbase.version could only be replicated to 0 nodes,
> instead of 1
>  at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1558)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:696)
>  at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:616)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
>  at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
>  at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:416)
>  at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)
>
>
>
> My hbase-site.xml :
>
> <?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
> <!--
> /**
>  * Licensed to the Apache Software Foundation (ASF) under one
>  * or more contributor license agreements.  See the NOTICE file
>  * distributed with this work for additional information
>  * regarding copyright ownership.  The ASF licenses this file
>  * to you under the Apache License, Version 2.0 (the
>  * "License"); you may not use this file except in compliancef
>  * with the License.  You may obtain a copy of the License at
>  *
>  *     http://www.apache.org/licenses/LICENSE-2.0
>
******************************************
* Mr. Jia Yiyu                                *
*                                                   *
* Email: [EMAIL PROTECTED]          *
*                                                   *
* Web: http://yiyujia.blogspot.com/*
*******************************************