Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> hadoop task assigner


Copy link to this message
-
Re: hadoop task assigner

In 1.0 line, you should look at JobTracker side, specifically JobInProgress.java.

Thanks,
+Vinod

On Dec 7, 2012, at 8:28 AM, Jay Vyas wrote:

> Hi : Where are the hooks in hadoop for the implementation of locality?  I assume that Mappers are blind to locality - they read directly via their Context objects, whatever splits they are given.
>
> But the MapperContext is created by some kind of "smart", locality aware Task assignment class.
>
> What is this class and where is it? In particular, im interested in seeing how to implement it for different InputFormat mechanisms
>
> Thanks!!!!!!!!!!!!!
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB