Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Problem in Job/TasK scheduling


Copy link to this message
-
Re: Problem in Job/TasK scheduling

On Apr 1, 2011, at 3:03 AM, Nitin Khandelwal wrote:

> Hi,
>
>
> I am right now stuck on the issue of division of tasks among slaves for a
> job. Currently, as far as I know, hadoop does not allow us to fix/determine
> in advance how many tasks of a job would run on each slave. I am trying to
> design a system, where I want a slave to execute only one task of one job
> type ,
> however at the same time , be able to accept/execute task of jobs of other
> types. Is this kind of scheduling possible in hadoop.

This is in the FAQ:

http://wiki.apache.org/hadoop/FAQ#How_do_I_limit_.28or_increase.29_the_number_of_concurrent_tasks_running_on_a_node.3F
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB