Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> AvatarNode configuration


Copy link to this message
-
Re: AvatarNode configuration
Hey LiuLei,

AvatarNode isn't part of the Apache Hadoop project yet - you may find
better responses by communicating with the facebook/hadoop repository
maintainers directly. However, you may be interested in the HA
solution carried by Apache Hadoop itself, documented at
http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/HDFSHighAvailability.html.

On Wed, Oct 24, 2012 at 9:26 AM, lei liu <[EMAIL PROTECTED]> wrote:
> I use facebook AvatarNode, my configuration is below:
>
> <property>
>   <name>dfs.name.dir.shared0</name>
>   <value>/data6/hdfs_ha1/ha_share1/share0/namenode</value>
> </property>
> <property>
>   <name>dfs.name.edits.dir.shared0</name>
>   <value>/data6/hdfs_ha1/ha_share1/share0/editlog</value>
> </property>
>
> <property>
>   <name>dfs.name.dir.shared1</name>
>   <value>/data6/hdfs_ha1/ha_share1/share1/namenode</value>
> </property>
> <property>
>   <name>dfs.name.edits.dir.shared1</name>
>   <value>/data6/hdfs_ha1/ha_share1/share1/editlog</value>
> </property>
>
> <property>
>   <name>dfs.name.dir</name>
>   <value>/home/musa.ll/hdfs_ha/local/name</value>
> </property>
> <property>
>   <name>dfs.name.edits.dir</name>
>   <value>/home/musa.ll/hdfs_ha/local/name</value>
> </property>
>
> The local name dir and edits dir are same.
>
> When I start standby namenode, the standby namenode throw below exception:
>  Ingest: Exception while processing transactions (true) java.io.IOException:
> Ingest: Timestamp of transaction log on localmachine is 2012-10-24
> 11:41:28:271 and on remote namenode is 2012-10-24 11:41:28:146. But this can
> never happen.
>     at
> org.apache.hadoop.hdfs.server.namenode.Ingest.ingestFSEdits(Ingest.java:316)
>     at
> org.apache.hadoop.hdfs.server.namenode.Ingest.loadFSEdits(Ingest.java:216)
>     at org.apache.hadoop.hdfs.server.namenode.Ingest.run(Ingest.java:86)
>     at java.lang.Thread.run(Unknown Source)
>
> If I config different local name dir and edits dir, thta is ok.  Must be the
> local name dir and edits dir different?
>
> Thanks,
> LiuLei
>
>
>
>

--
Harsh J
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB