Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> mapper and reducer scheduling


Copy link to this message
-
Re: mapper and reducer scheduling
TaskTracker will tell JobTracker how many free slots it has through
heartbeat. And JobTracker will choose the best tasktracker with the
consideration of data locality.
On Thu, Oct 28, 2010 at 2:52 PM, Zhenhua Guo <[EMAIL PROTECTED]> wrote:
> Hi, all
>  I wonder how Hadoop schedules mappers and reducers (e.g. consider
> load balancing, affinity to data?). For example, how to decide on
> which nodes mappers and reducers are to be executed and when.
>  Thanks!
>
> Gerald
>

--
Best Regards

Jeff Zhang
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB