Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - While starting 3-nodes cluster hbase: WARN org.apache.zookeeper.ClientCnxn: Session 0x0 for server null


Copy link to this message
-
Re: Re: While starting 3-nodes cluster hbase: WARN org.apache.zookeeper.ClientCnxn: Session 0x0 for server null
Jean-Marc Spaggiari 2013-04-30, 16:38
Hi John,

Thanks for sharing that. Might help other people who are facing the same
issues.

JM

2013/4/30 John Foxinhead <[EMAIL PROTECTED]>

> Now I post my configurations:
> I use a 3 nodes cluster with all the nodes runnind hadoop, zookeeper and
> hbase. Hbase master, a zookeeper daemon and Hadoop namenode run on the same
> host. Hbase regionserver, a zookeeper daemon and hadoop datanode run on the
> other 2 nodes. I called one of the datanodes "jobtracker" because of the
> various configuration i tried, but it is a datanode like "datanode1"
> because i configured also the jobtracker while installing hadoop but i
> never used it as jobtracker, but as datanode, because hbase doesn't need
> the use of Map-Reduce algorithm.
> I run all on the same pc: the 3 nodes are 3 virtual machines running on
> VirtualBox connected throught internal network or bridged adapter network
> interfaces (theese are configurations of virtualbox)
> It's important to know that i use 3 virtual machines because comunication
> is very very slow, expecially at startup of hadoop, zookeeper and hbase.
>
>
> HADOOP:
>
> hadoop-env.sh:
> export JAVA_HOME=/usr/lib/jvm/java-7-oracle
> export HADOOP_CLASSPATH=/home/debian/hadoop-1.0.4/lib
> export HADOOP_HEAPSIZE=1000
>
> core-site.xml:
> <configuration>
>   <property>
>     <name>fs.default.name</name>
>     <value>hdfs://namenode:9000/</value>
>   </property>
> </configuration>
>
> hdfs-site.xml:
> <configuration>
>   <property>
>     <name>dfs.name.dir</name>
>     <value>/home/debian/hadoop-1.0.4/FILESYSTEM/name</value>
>   </property>
>   <property>
>     <name>dfs.data.dir</name>
>     <value>/home/debian/hadoop-1.0.4/FILESYSTEM/data</value>
>   </property>
>   <property>
>     <name>dfs.support.append</name>
>     <value>true</value>
>   </property>
>   <property>
>     <name>dfs.datanode.max.xcievers</name>
>     <value>4096</value>
>   </property>
> </configuration>
>
> masters:
> slaves:
> jobtracker
> datanode1
>
>
> HBASE:
>
> hbase-env.sh
> export JAVA_HOME=/usr/lib/jvm/java-7-oracle
> export HBASE_CLASSPATH=/home/debian/hbase-0.94.5/lib
> export HBASE_MANAGES_ZK=false
>
> hbase-site.xml:
> <configuration>
>     <property>
>         <name>dfs.support.append</name>
>         <value>true</value>
>     </property>
>     <property>
>         <name>hbase.rootdir</name>
>         <value>hdfs://namenode:9000/hbase</value>
>     </property>
>     <property>
>         <name>hbase.cluster.distributed</name>
>         <value>true</value>
>     </property>
>     <property>
>         <name>hbase.zookeeper.quorum</name>
>         <value>namenode,jobtracker,datanode1</value>
>     </property>
>     <property>
>         <name>hbase.zookeeper.property.dataDir</name>
>         <value>/home/debian/hbase-0.94.5/zookeeper/data</value>
>     </property>
>     <property>
>         <name>hbase.master</name>
>         <value>namenode:60000</value>
>     </property>
> </configuration>
> note: i think the property hbase.master doesn't work from years, so it can
> be deleted, but after a lot of tries my hbase worked, so i left it there.
> I'll try to delete it later.
> regionservers:
> jobtracker
> datanode
>
>
> OS FILES:
>
> /etc/hosts:
>
> 127.0.0.1    localhost
> 127.0.0.1    debian01
> #  HADOOP
> 192.168.1.111    jobtracker
> 192.168.1.112    datanode1
> 192.168.1.121    namenode
> # The following lines are desirable for IPv6 capable hosts
> ::1     ip6-localhost ip6-loopback
> fe00::0 ip6-localnet
> ff00::0 ip6-mcastprefix
> ff02::1 ip6-allnodes
> ff02::2 ip6-allrouters
>
> /etc/hostname:
> namenode (or jobtracker, or datanode1, depending on the node)
>
> /etc/network/interfaces (to set static IPs: on namenode: address
> 192.168.1.121, on jobtracker: address 192.168.1.111, on datanode1: address
> 192.168.1.112):
> iface eth6 inet static
> address 192.168.1.121
> netmask 255.255.255.0
> network 192.168.1.0
> broadcast 192.168.1.255
> gateway 192.168.1.254
> dns-nameserver 8.8.8.8 8.8.4.4
> note: eth6 because eth2 (where i had "bridged network adapter" virtual