Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Reg:HDFS Decommission Design Document.


Copy link to this message
-
Reg:HDFS Decommission Design Document.
Hi Guys,

Where I find Decommission document. I need to know how decommission will
really works. Where I can find decommission logs.

How to understand decommission process:

I am planning to remove one of my Datanode in my cluster. I have already
Data available two other nodes. without data loss removing nodes.

% How to actual data moving or transferring other nodes.?
% When I start decommission the decommission initiated node send blocks to
other machine
% All the Blocks info will available in Namenode. NN will so replication
steps

Also I am facing issue very low speed Decommissioning will happening.

for example I have data in 2TB it's take more than 50 hrs. It's quite
unnormal. I believe  I configured
dfs.datanode.balance.bandwidthPerSec=1073741824 [1GB bytes per second]

How to debug, Please guide guys.

-Dhanasekaran
Did I learn something today? If not, I wasted it.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB