Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Can I move block data directly?

Copy link to this message
Re: Can I move block data directly?
Yes, you could do this, but I'd place steps 3 and 5 as steps 1 and 2.
I'd also ensure the ownership of the block files are intact.

If balancer isn't cutting it out for you with stock defaults, you
should consider tuning that than doing these unsupported scenarios.

On Mon, Jul 8, 2013 at 9:10 AM, Azuryy Yu <[EMAIL PROTECTED]> wrote:
> Hi Dear all,
> There are some unbalanced data nodes in my cluster, some nodes reached more
> than 95% disk usage.
> so Can I move some block data from one node to another node directly?
> such as: from n1 to n2:
> 1) scp /data/xxxx/blk_*   n2:/data/subdir11/
> 2) rm -rf data/xxxx/blk_*
> 3) hadoop-dameon.sh stop datanode (on n1)
> 4) hadoop-damon.sh start datanode(on n1)
> 5) hadoop-dameon.sh stop datanode (on n2)
> 6) hadoop-damon.sh start datanode(on n2)
> Am I right? Thanks for any input.

Harsh J