Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Question about writing HDFS files


Copy link to this message
-
Question about writing HDFS files
I seem to recall reading that when a MapReduce task writes a file, the blocks of the file are always written to local disk, and replicated to other nodes.  If this is true, is this also true for non-MR applications writing to HDFS from Hadoop worker nodes?  What about clients outside of the cluster doing a file load?
Thanks
John

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB