Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - speculative execution in yarn


Copy link to this message
-
Re: speculative execution in yarn
Radim Kolar 2012-10-19, 17:00
Dne 17.10.2012 20:28, Vinod Kumar Vavilapalli napsal(a):
> Speculative execution is a per-job concept, so in 2.* release line, it
> is MR AM's responsibility.
>
> Because there is a two level scheduling - one at RM and one at AM, AMs
> have not way of figuring out if there are other jobs are not.
AM can query RM if there are other jobs sitting in same queue as its
currently running job before enabling speculative execution.