You can limit the bandwidth in bytes/second values applied
via dfs.balance.bandwidthPerSec in each DN's hdfs-site.xml. Default is 1
Also, unsure if your version already has it, but it can be applied at
runtime too via the dfsadmin -setBalancerBandwidth command.
On Thu, Jan 17, 2013 at 8:11 PM, Brennon Church <[EMAIL PROTECTED]> wrote:
> Is there a way to throttle the speed at which under-replicated blocks are
> copied across a cluster? Either limiting the bandwidth or the number of
> blocks per time period would work.
> I'm currently running Hadoop v1.0.1. I think the
> dfs.namenode.replication.work.multiplier.per.iteration option would do the
> trick, but that is in v1.1.0 and higher.
Brennon Church 2013-01-17, 21:44