-Re: Maximizing throughput
Andrew Purtell 2013-01-15, 17:48
Thanks Bryan, really appreciate you letting us know the outcome. I'm sure
it will be useful to others.
On Tue, Jan 15, 2013 at 9:28 AM, Bryan Keller <[EMAIL PROTECTED]> wrote:
> I'll follow up on this in case it is useful to anyone. It seems I was
> network I/O limited. The switch I was using was in managed mode which
> decreased throughput to 1gbit/sec within the switch, not just on the wire.
> So with replication set to 2, throughput was about half of the theoretical
> max on a given box (client -> switch -> datanode 1 -> switch -> datanode
> 2). It was an eye opener that I was network I/O limited. I will probably
> move to a 10gbit/sec switch and/or use bonded NICs.
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)