Hadoop, mail # user - HDFS Client write data is slow - 2014-02-25, 01:59
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
HDFS Client write data is slow
I use Hbase-0.94 and hadoop-2.0.

I install one HDFS cluster that have 15 datanodes. If network bandwidth of
two datanodes is saturation(example 100m/s),  writing performance of the entire
hdfs cluster is slow.

I think that the slow datanodes affect the writing performance of the entire
cluster.

How does HDFS Client avoid writing data to the slow datanodes?

Thanks,

LiuLei

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB