Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - Re: Maximizing throughput


+
Asaf Mesika 2013-01-11, 13:03
+
Bryan Keller 2013-01-11, 17:37
+
Bryan Keller 2013-01-15, 17:28
Copy link to this message
-
Re: Maximizing throughput
Andrew Purtell 2013-01-15, 17:48
Thanks Bryan, really appreciate you letting us know the outcome. I'm sure
it will be useful to others.

On Tue, Jan 15, 2013 at 9:28 AM, Bryan Keller <[EMAIL PROTECTED]> wrote:

> I'll follow up on this in case it is useful to anyone. It seems I was
> network I/O limited. The switch I was using was in managed mode which
> decreased throughput to 1gbit/sec within the switch, not just on the wire.
> So with replication set to 2, throughput was about half of the theoretical
> max on a given box (client -> switch -> datanode 1 -> switch -> datanode
> 2). It was an eye opener that I was network I/O limited. I will probably
> move to a 10gbit/sec switch and/or use bonded NICs.
>
--
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
+
anil gupta 2013-01-15, 20:04