Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Re: Maximizing throughput


+
Asaf Mesika 2013-01-11, 13:03
+
Bryan Keller 2013-01-11, 17:37
+
Bryan Keller 2013-01-15, 17:28
Copy link to this message
-
Re: Maximizing throughput
Thanks Bryan, really appreciate you letting us know the outcome. I'm sure
it will be useful to others.

On Tue, Jan 15, 2013 at 9:28 AM, Bryan Keller <[EMAIL PROTECTED]> wrote:

> I'll follow up on this in case it is useful to anyone. It seems I was
> network I/O limited. The switch I was using was in managed mode which
> decreased throughput to 1gbit/sec within the switch, not just on the wire.
> So with replication set to 2, throughput was about half of the theoretical
> max on a given box (client -> switch -> datanode 1 -> switch -> datanode
> 2). It was an eye opener that I was network I/O limited. I will probably
> move to a 10gbit/sec switch and/or use bonded NICs.
>
--
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
+
anil gupta 2013-01-15, 20:04
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB