Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Problem in Job/TasK scheduling


Copy link to this message
-
Re: Problem in Job/TasK scheduling

On Apr 1, 2011, at 3:03 AM, Nitin Khandelwal wrote:

> Hi,
>
>
> I am right now stuck on the issue of division of tasks among slaves for a
> job. Currently, as far as I know, hadoop does not allow us to fix/determine
> in advance how many tasks of a job would run on each slave. I am trying to
> design a system, where I want a slave to execute only one task of one job
> type ,
> however at the same time , be able to accept/execute task of jobs of other
> types. Is this kind of scheduling possible in hadoop.

This is in the FAQ:

http://wiki.apache.org/hadoop/FAQ#How_do_I_limit_.28or_increase.29_the_number_of_concurrent_tasks_running_on_a_node.3F