Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Unbalanced disks - need to take down whole HDFS?


+
Erik Forsberg 2010-12-16, 14:32
Copy link to this message
-
Re: Unbalanced disks - need to take down whole HDFS?
On Dec 16, 2010, at 6:34 AM, Erik Forsberg <[EMAIL PROTECTED]> wrote:

> Hi!
>
> I have unbalanced disks on one of my nodes after a disk failure with
> disk replacements.
>
> http://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F
> has a solution, but it starts with "Take down HDFS".
>
> Is that really necessary - shouldn't taking down just that datanode,
> moving around the blocks, then start the datanode be good enough, or
> will that mess up some datastructure in the namenode?
>

You're right - that should say take the DataNode down, move blocks
around, then restart the DataNode. You might be able to just replace
the disk and have them unbalanced for a while though. As data is
created and deleted things will naturally even out.

--Travis

> Thanks,
> \EF
> --
> Erik Forsberg <[EMAIL PROTECTED]>
> Developer, Opera Software - http://www.opera.com/
+
Allen Wittenauer 2010-12-16, 19:33
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB