Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Hardware specs calculation for io


Copy link to this message
-
Re: Hardware specs calculation for io
You will want something in between...

8 cores means 8 spindles.

16 cores means 16 spindles.

You may want to up the memory, especially if you're running or thinking about running HBase.

If you go beyond 4 spindles, you will saturate your 1GBe link. If you think about Type B, you will need 10GBe.
On Jun 13, 2012, at 9:36 AM, Sandeep Reddy P wrote:

> Hi,
> I need to know difference between two hardware configurations below for
> 24TB of data. (slave machines only for hadoop,hive and pig)
>
> TYPE A: 2 quad core, 32 GB memory, 6 x 1TB drives(6TB / machine)
>
> TYPE B: 4 quad core, 48 GB memory, 12 x 1TB drives (12TB / machine)
>
> suppose we choose 4 type A machines for 24tb of data and 2 type b machines
> for 24 tb data. Assuming disk io speed is constant (7200 RPM sata), cost is
> same for 4Type A and 2 Type B machines.
>
> I need which type of machines will give me best results in terms of
> performance.
>
>
> --
> Thanks,
> sandeep
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB