Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> question on yarn and fairscheduler


Copy link to this message
-
Re: question on yarn and fairscheduler
Hello,

YARN's FairScheduler does not have maxMaps/maxReducers fields like its
MR1 counterpart did, given YARN's generic Container based
architecture. Please see
http://archive.cloudera.com/cdh5/cdh/5/hadoop/hadoop-yarn/hadoop-yarn-site/FairScheduler.html#Configuration,
sub-section "Allocation file format" for the actual configurable
elements in it.

Preemption marks the tasks as killed, and not failed, so they do not
count towards your job failure thresholds. If your task attempts are
truly failing, their task attempt logs (syslog, stderr, stdout) will
have the reason they failed.

On Tue, May 20, 2014 at 12:23 PM, Du Lam <[EMAIL PROTECTED]> wrote:

Harsh J