Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> enabling priority jobs to Hadoop with Yarn


Copy link to this message
-
enabling priority jobs to Hadoop with Yarn
Hi,

Can someone give advice for the following scenario?
I have a MR pool with Yarn; the total number of available containers is
100. At a given time, a lower priority job is submitted and consumes all
100 containers. Later, I submit a higher priority job and it is not running
as the all containers are taken by the lower priority job. I tried to
change the job priority by having -Dmapred.job.priority=HIGH and change the
priority using CLI - mapred job priority job-id HIGH. Both solutions do not
seem to work. Can any one give advice? thx.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB