Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - hadoop task assigner


Copy link to this message
-
Re: hadoop task assigner
Vinod Kumar Vavilapalli 2012-12-07, 21:06

In 1.0 line, you should look at JobTracker side, specifically JobInProgress.java.

Thanks,
+Vinod

On Dec 7, 2012, at 8:28 AM, Jay Vyas wrote:

> Hi : Where are the hooks in hadoop for the implementation of locality?  I assume that Mappers are blind to locality - they read directly via their Context objects, whatever splits they are given.
>
> But the MapperContext is created by some kind of "smart", locality aware Task assignment class.
>
> What is this class and where is it? In particular, im interested in seeing how to implement it for different InputFormat mechanisms
>
> Thanks!!!!!!!!!!!!!
>
> --
> Jay Vyas
> http://jayunit100.blogspot.com