Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> hadoop task assigner

Jay Vyas 2012-12-07, 16:28
Copy link to this message
Re: hadoop task assigner

In 1.0 line, you should look at JobTracker side, specifically JobInProgress.java.


On Dec 7, 2012, at 8:28 AM, Jay Vyas wrote:

> Hi : Where are the hooks in hadoop for the implementation of locality?  I assume that Mappers are blind to locality - they read directly via their Context objects, whatever splits they are given.
> But the MapperContext is created by some kind of "smart", locality aware Task assignment class.
> What is this class and where is it? In particular, im interested in seeing how to implement it for different InputFormat mechanisms
> Thanks!!!!!!!!!!!!!
> --
> Jay Vyas
> http://jayunit100.blogspot.com