Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Queues in hadoop 2.0.4


+
Pedro Sá da Costa 2013-05-30, 12:25
Copy link to this message
-
Re: Queues in hadoop 2.0.4
Thomas Graves 2013-05-30, 13:13
The Resourcemanager manages the queues in hadoop 2.0.4.  As far as the specifics it depends on the scheduler you use.  If you use the capacity scheduler or fair scheduler you can have multiple queues.  Take a look at the documentation here for capacity scheduler: http://hadoop.apache.org/docs/r2.0.4-alpha/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html

Any example capacity-scheduler.xml config file is here: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/conf/capacity-scheduler.xml?revision=1432931&view=markup

Tom

From: Pedro Sá da Costa <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Reply-To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Thursday, May 30, 2013 7:25 AM
To: mapreduce-user <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Subject: Queues in hadoop 2.0.4

I am using hadoop 2.0.4

1 - Which component manage queues? Is it the jobtracker?

2 - If so, it is possible to define several queues (set mapred.job.queue.name<http://mapred.job.queue.name>=$QUEUE_NAME;)?

--
Best regards,