Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> How is sharing done in HDFS ?


Copy link to this message
-
How is sharing done in HDFS ?
Hi,

Can anyone guide me to some pointers or explain how HDFS shares the information put in the temporary directories (hadoop.tmp.dir, mapred.tmp.dir, etc.) to all other nodes?

I suppose that during execution of a MapReduce job, the JobTracker prepares a file called jobtoken and puts it in the temporary directories. which needs to be read by all TaskTrackers. So, how does HDFS share the contents? Does it use nfs mount or ....?

Thanks & Regards,
Nikhil

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB