Hey guys. I posted this on the CDH forum but no one has replied so I'm
posting here to reach a wider audience and hopefully an answer:

 

Has anyone here seen an issue where the balancer will exit before doing any
'balancing'? I'm setting a threshold of 2 but often times, no data will
actually get moved. There are no messages indicating any kind of problem in
the NameNode or in the DataNode logs. I'm using cdh3u1 which is based on
0.20.2.

 

12/05/21 17:04:14 INFO balancer.Balancer: Need to move 5.41 TB bytes to make
the cluster balanced.
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.43:50010 to 192.168.164.30:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.39:50010 to 192.168.164.19:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.45:50010 to 192.168.164.23:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.42:50010 to 192.168.164.6:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.46:50010 to 192.168.164.31:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.48:50010 to 192.168.164.32:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.49:50010 to 192.168.164.16:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.34:50010 to 192.168.164.24:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.51:50010 to 192.168.164.18:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.40:50010 to 192.168.164.22:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.50:50010 to 192.168.164.29:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.35:50010 to 192.168.164.21:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.41:50010 to 192.168.164.11:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.37:50010 to 192.168.164.13:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.52:50010 to 192.168.164.20:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.38:50010 to 192.168.164.15:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.44:50010 to 192.168.164.33:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.36:50010 to 192.168.164.27:50010
12/05/21 17:04:14 INFO balancer.Balancer: Decided to move 10 GB bytes from
192.168.164.47:50010 to 192.168.164.28:50010
12/05/21 17:04:14 INFO balancer.Balancer: Will move 190 GBbytes in this
iteration
May 21, 2012 5:04:14 PM           4                 0 KB 5.41 TB
190 GB
No block has been moved for 5 iterations. Exiting...
Balancing took 34.938 seconds

 

Thanks!

 

-Charles

 

SDL Enterprise Technologies, Inc. - all rights reserved.  The information contained in this email may be confidential and/or legally privileged. It has been sent for the sole use of the intended recipient(s). If you are not the intended recipient of this mail, you are hereby notified that any unauthorized review, use, disclosure, dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited. If you have received this communication in error, please reply to the sender and destroy all copies of the message.
Registered address: 69 Hickory Drive, 3rd Floor, Waltham, MA 02451, USA