Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> HDFS write failures!


Copy link to this message
-
HDFS write failures!
Hi,

I was going through some documents about HDFS write pattern. It looks like
the write pipeline is closed when a error is encountered and the faulty
node is  taken out of the pipeline and the write continues.Few other
intermediate steps are to move the un-acked packets from ack queue to the
data queue.

My question is , is this faulty data node is reported to the NN and whether
NN would continue to use it as a valid DN while serving other write
requests in future or will it make it as faulty ?

Thanks,
Rahul
+
Ravi Prakash 2013-05-17, 18:14
+
Rahul Bhattacharjee 2013-05-18, 11:54
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB