|
|
-
hadoop task assignerJay Vyas 2012-12-07, 16:28
Hi : Where are the hooks in hadoop for the implementation of locality? I
assume that Mappers are blind to locality - they read directly via their Context objects, whatever splits they are given. But the MapperContext is created by some kind of "smart", locality aware Task assignment class. What is this class and where is it? In particular, im interested in seeing how to implement it for different InputFormat mechanisms Thanks!!!!!!!!!!!!! -- Jay Vyas http://jayunit100.blogspot.com +
Vinod Kumar Vavilapalli 2012-12-07, 21:06
|