Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Re: Which hardware to choose


Copy link to this message
-
Re: Which hardware to choose
hadoopman 2012-10-03, 01:14
Only 24 map and 8 reduce tasks for 38 data nodes?  are you sure that's
right?  Sounds VERY low for a cluster that size.

We have only 10 c2100's and are running I believe 140 map and 70 reduce
slots so far with pretty decent performance.

On 10/02/2012 12:55 PM, Alexander Pivovarov wrote:
> 38 data nodes + 2 Name Nodes
> >  >
> >  >  Data Node:
> >  >  Dell PowerEdge C2100 series
> >  >  2 x XEON x5670
> >  >  48 GB RAM ECC  (12x4GB 1333MHz)
> >  >  12 x 2 TB  7200 RPM SATA HDD (with hot swap)  JBOD
> >  >  Intel Gigabit ET Dual port PCIe x4
> >  >  Redundant Power Supply
> >  >  Hadoop CDH3
> >  >  max map tasks 24
> >  >  max reduce tasks 8