Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Spindle per Cores


Copy link to this message
-
Re: Spindle per Cores
Ted Dunning 2012-10-12, 19:11
It depends on your distribution.  Some distributions are more efficient at
driving spindles than others.

Ratios as high as 2 spindles per core are sometimes quite reasonable.

On Fri, Oct 12, 2012 at 10:46 AM, Patai Sangbutsarakum <
[EMAIL PROTECTED]> wrote:

> I have read around about the hardware recommendation for hadoop cluster.
> One of them is recommend 1:1 ratio between spindle per core.
>
> Intel CPU come with Hyperthread which will double the number cores on
> one physical CPU. eg. 8 cores with Hyperthread it because 16 which is
> where we start to calculate about number of task slots per node.
>
> Once it come to spindle, i strongly believe I should pick 8 cores and
> picks 8 disks in order to get 1:1 ratio.
>
> Please suggest
> Patai
>