Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # dev >> HDFS HA with HDFS Federation

Copy link to this message
HDFS HA with HDFS Federation
Hi Devs,

I am trying to test HDFS Federation and HDFS HA on same cluster.
My setup has 2 federated NameNodes out of which only one NameNode is in HA
It looks like all configs has good structure to distinguish between the
For example dfs.namenode.rpc-address.cluster.namenode is kind of unique.
This enables me to have same hdfs-site.xml across all nodes on cluster.
But some configs like  dfs.namenode.shared.edits.dir does not have this
This forces me to have different hdfs-site.xml on different nodes.
Has anyone run into this situation? Any suggestions to overcome this?

Have a Nice Day!