Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Heterogeneous cluster - quadcores/8 cores, Fairscheduler

Copy link to this message
Heterogeneous cluster - quadcores/8 cores, Fairscheduler
Our unit has 5 quad-core machines, running Hadoop. We have a dedicated
Jobtracker/Namenode. Each machine has 32GB ram.
We have the option of buying an 8 core,128GB machine and the question
is would this be useful as a Tasktracker?

A) It can certainly be used as the JobTracker and Namenode
B) I also read the FairScheduler, and mapred.fairscheduler.loadmanager
appears to allow the administrator allow more jobs to run on a given
machine. Thus the new machine might be able to run double the number
of maps and reduces.

Otherwise, if FairScheduler is not an option(or I misunderstood), then
adding the new machine to the cluster would only underutilize it.

Are my inferences correct?
Saptarshi Guha