Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> recommended nodes


+
David Charle 2012-11-26, 13:53
+
Marcos Ortiz 2012-11-26, 14:05
Copy link to this message
-
Re: recommended nodes
Uhm, those specs are actually now out of date.

If you're running HBase, or want to also run R on top of Hadoop, you will need to add more memory.
Also forget 1GBe got 10GBe,  and w 2 SATA drives, you will be disk i/o bound way too quickly.
On Nov 26, 2012, at 8:05 AM, Marcos Ortiz <[EMAIL PROTECTED]> wrote:

> Are you asking about hardware recommendations?
> Eric Sammer on his "Hadoop Operations" book, did a great job about this:
> For middle size clusters (until 300 nodes):
> Processor: A dual quad-core 2.6 Ghz
> RAM: 24 GB DDR3
> Dual 1 Gb Ethernet NICs
> a SAS drive controller
> at least two SATA II drives in a JBOD configuration
>
> The replication factor depends heavily of the primary use of your cluster.
>
> On 11/26/2012 08:53 AM, David Charle wrote:
>> hi
>>
>> what's the recommended nodes for NN, hmaster and zk nodes for a larger cluster, lets say 50-100+
>>
>> also, what would be the ideal replication factor for larger clusters when u have 3-4 racks ?
>>
>> --
>> David
>> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
>> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>>
>> http://www.uci.cu
>> http://www.facebook.com/universidad.uci
>> http://www.flickr.com/photos/universidad_uci
>
> --
>
> Marcos Luis Ortíz Valmaseda
> about.me/marcosortiz <http://about.me/marcosortiz>
> @marcosluis2186 <http://twitter.com/marcosluis2186>
>
>
>
> 10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
> CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION
>
> http://www.uci.cu
> http://www.facebook.com/universidad.uci
> http://www.flickr.com/photos/universidad_uci
+
Mohammad Tariq 2012-11-26, 13:59
+
Jean-Marc Spaggiari 2012-12-19, 22:59
+
Michael Segel 2012-12-20, 01:14
+
Varun Sharma 2012-12-20, 21:22
+
Jean-Marc Spaggiari 2012-12-20, 21:26
+
Varun Sharma 2012-12-20, 21:37
+
Jean-Marc Spaggiari 2012-12-20, 22:07
+
Adrien Mogenet 2012-12-20, 22:11
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB