Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # dev - Abstraction layer to support both YARN and Mesos


Copy link to this message
-
Re: Abstraction layer to support both YARN and Mesos
Harsh J 2013-07-26, 10:14
Do we have a good reason to prefer Mesos over YARN for scheduling MR
specifically? At what times would one prefer the other?

On Fri, Jul 26, 2013 at 11:43 AM, Tsuyoshi OZAWA
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> Now, Apache Mesos, an distributed resource manager, is top-level
> apache project. Meanwhile, As you know, Hadoop has own resource
> manager - YARN. IMHO, we should make resource manager pluggable in
> MRv2, because there are their own field users of MapReduce would like
> to use. I think this work is useful for MapReduce users. On the other
> hand, this work can also be large, because MRv2's code base is tightly
> coupled with YARN currently. Thoughts?
>
> - Tsuyoshi

--
Harsh J