Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Error while configuring HDFS fedration


Copy link to this message
-
Error while configuring HDFS fedration
Guys,

I'm trying to configure HDFS federation with 2.1.0 beta version. I am having 3 machines in that i want to have two name nodes and one data node.

I have done the other thing like password less ssh and host entries properly. when i start the cluster i'm getting the below error.

In node one i'm getting this error.
java.net.BindException: Port in use: lab-hadoop.eng.com:50070

In another node i'm getting this error.
org.apache.hadoop.hdfs.server.common.InconsistentFSStateException: Directory /home/lab/hadoop-2.1.0-beta/tmp/dfs/name is in an inconsistent state: storage directory does not exist or is not accessible.

My core-site xml has the below.
<configuration>
  <property>
    <name>fs.default.name</name>
    <value>hdfs://10.101.89.68:9000</value>
  </property>
  <property>
    <name>hadoop.tmp.dir</name>
    <value>/home/lab/hadoop-2.1.0-beta/tmp</value>
  </property>
</configuration>

My hdfs-site xml has the below.
<configuration>
   <property>
     <name>dfs.replication</name>
     <value>2</value>
   </property>
   <property>
     <name>dfs.permissions</name>
     <value>false</value>
   </property>
   <property>
        <name>dfs.federation.nameservices</name>
        <value>ns1,ns2</value>
    </property>
    <property>
        <name>dfs.namenode.rpc-address.ns1</name>
        <value>10.101.89.68:9001</value>
    </property>
   <property>
    <name>dfs.namenode.http-address.ns1</name>
    <value>10.101.89.68:50070</value>
   </property>
   <property>
        <name>dfs.namenode.secondary.http-address.ns1</name>
        <value>10.101.89.68:50090</value>
    </property>
    <property>
        <name>dfs.namenode.rpc-address.ns2</name>
        <value>10.101.89.69:9001</value>
    </property>
   <property>
    <name>dfs.namenode.http-address.ns2</name>
    <value>10.101.89.69:50070</value>
   </property>
   <property>
        <name>dfs.namenode.secondary.http-address.ns2</name>
        <value>10.101.89.69:50090</value>
    </property>
 </configuration>

Please help me to fix this error.
Thanks,
Manickam P
     
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB