Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # dev >> HDFS HA with HDFS Federation


Copy link to this message
-
HDFS HA with HDFS Federation
Hi Devs,

I am trying to test HDFS Federation and HDFS HA on same cluster.
My setup has 2 federated NameNodes out of which only one NameNode is in HA
mode.
It looks like all configs has good structure to distinguish between the
namenode.
For example dfs.namenode.rpc-address.cluster.namenode is kind of unique.
This enables me to have same hdfs-site.xml across all nodes on cluster.
But some configs like  dfs.namenode.shared.edits.dir does not have this
property.
This forces me to have different hdfs-site.xml on different nodes.
Has anyone run into this situation? Any suggestions to overcome this?

--
Have a Nice Day!
Lohit
+
Todd Lipcon 2012-10-31, 20:10
+
lohit 2012-10-31, 20:15
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB