Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Fair Scheduler Performance issue.


Copy link to this message
-
Fair Scheduler Performance issue.
Dhanasekaran Anbalagan 2013-02-08, 09:26
Hi Guys,

We have using CDH4.0.1, we having quite monitoring with fair scheduler with
not handle with more than one lakh mapper.

Is the Bug or configuration tweaking please guide me guys.

My scenario:

We have already having research and tech pool, We configured equal weight=1
in this manner. When tech pool more than one Lakh mapper job assigned means
hole cluster fully using by tech job, The same time Research got very low
mapper.
Below One Lakh mapper working good, fair scheduler equally split the
resources.  More than one lakh. Not proper with Fair scheduler Algo.

please guide me, How to debug.

-Dhanasekaran
Did I learn something today? If not, I wasted it.