Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: issue about capacity scheduler

Copy link to this message
Re: issue about capacity scheduler

If both the jobs in the MR queue are from the same user, CapacityScheduler will only try to run them one after another. If possible, run them as different users. At which point, you will see sharing across jobs because they are from different users.


On Dec 4, 2013, at 1:33 AM, ch huang wrote:

> hi,maillist :
>                  i use yarn framework and capacity scheduler  ,and i have two queue ,one for hive and the other for big MR job
> in hive  queue it's work fine,because hive task is very faster ,but what i think is user A submitted two big MR job ,so first big job eat
> all the resource belongs to the queue ,the other big MR job should wait until first job finished ,how can i let the same user 's MR job can run parallel?
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.