-Fair Scheduler Performance issue.
Dhanasekaran Anbalagan 2013-02-08, 09:26
We have using CDH4.0.1, we having quite monitoring with fair scheduler with
not handle with more than one lakh mapper.
Is the Bug or configuration tweaking please guide me guys.
We have already having research and tech pool, We configured equal weight=1
in this manner. When tech pool more than one Lakh mapper job assigned means
hole cluster fully using by tech job, The same time Research got very low
Below One Lakh mapper working good, fair scheduler equally split the
resources. More than one lakh. Not proper with Fair scheduler Algo.
please guide me, How to debug.
Did I learn something today? If not, I wasted it.