Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> HDFS append overhead


Copy link to this message
-
HDFS append overhead
I am trying to determine if it is feasible for multiple nodes to alternate appends to a shared file in HDFS.
Can someone tell me, what is the overhead of an open/append/close cycle?
If multiple nodes attempt open-for-append at once, the losers queue nicely waiting for the winner to close?
--john

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB