Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Re: Which hardware to choose


Copy link to this message
-
Re: Which hardware to choose
hadoopman 2012-10-03, 01:33
Had to ask :D
On 10/02/2012 07:19 PM, Russell Jurney wrote:
> I believe he means per node.
>
> Russell Jurney http://datasyndrome.com
>
> On Oct 2, 2012, at 6:15 PM, hadoopman<[EMAIL PROTECTED]>  wrote:
>
>> Only 24 map and 8 reduce tasks for 38 data nodes?  are you sure that's right?  Sounds VERY low for a cluster that size.
>>
>> We have only 10 c2100's and are running I believe 140 map and 70 reduce slots so far with pretty decent performance.
>>
>>
>>
>> On 10/02/2012 12:55 PM, Alexander Pivovarov wrote:
>>> 38 data nodes + 2 Name Nodes
>>>>   >
>>>>   >   Data Node:
>>>>   >   Dell PowerEdge C2100 series
>>>>   >   2 x XEON x5670
>>>>   >   48 GB RAM ECC  (12x4GB 1333MHz)
>>>>   >   12 x 2 TB  7200 RPM SATA HDD (with hot swap)  JBOD
>>>>   >   Intel Gigabit ET Dual port PCIe x4
>>>>   >   Redundant Power Supply
>>>>   >   Hadoop CDH3
>>>>   >   max map tasks 24
>>>>   >   max reduce tasks 8