Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> HDFS Client write data is slow


Copy link to this message
-
HDFS Client write data is slow
I use Hbase-0.94 and hadoop-2.0.

I install one HDFS cluster that have 15 datanodes. If network bandwidth of
two datanodes is saturation(example 100m/s),  writing performance of the entire
hdfs cluster is slow.

I think that the slow datanodes affect the writing performance of the entire
cluster.

How does HDFS Client avoid writing data to the slow datanodes?

Thanks,

LiuLei

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB