Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> AvatarNode configuration


Copy link to this message
-
AvatarNode configuration
I use facebook AvatarNode, my configuration is below:

<property>
  <name>dfs.name.dir.shared0</name>
  <value>/data6/hdfs_ha1/ha_share1/share0/namenode</value>
</property>
<property>
  <name>dfs.name.edits.dir.shared0</name>
  <value>/data6/hdfs_ha1/ha_share1/share0/editlog</value>
</property>

<property>
  <name>dfs.name.dir.shared1</name>
  <value>/data6/hdfs_ha1/ha_share1/share1/namenode</value>
</property>
<property>
  <name>dfs.name.edits.dir.shared1</name>
  <value>/data6/hdfs_ha1/ha_share1/share1/editlog</value>
</property>

<property>
  <name>dfs.name.dir</name>
  <value>/home/musa.ll/hdfs_ha/local/name</value>
</property>
<property>
  <name>dfs.name.edits.dir</name>
  <value>/home/musa.ll/hdfs_ha/local/name</value>
</property>

The local name dir and edits dir are same.

When I start standby namenode, the standby namenode throw below exception:
 Ingest: Exception while processing transactions (true)
java.io.IOException: Ingest: Timestamp of transaction log on localmachine
is 2012-10-24 11:41:28:271 and on remote namenode is 2012-10-24
11:41:28:146. But this can never happen.
    at
org.apache.hadoop.hdfs.server.namenode.Ingest.ingestFSEdits(Ingest.java:316)
    at
org.apache.hadoop.hdfs.server.namenode.Ingest.loadFSEdits(Ingest.java:216)
    at org.apache.hadoop.hdfs.server.namenode.Ingest.run(Ingest.java:86)
    at java.lang.Thread.run(Unknown Source)

If I config different local name dir and edits dir, thta is ok.  Must be
the local name dir and edits dir different?

Thanks,
LiuLei
+
Harsh J 2012-10-24, 04:11
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB