-Re: How to modify the Map-Reduce execution order?
Tsuyoshi OZAWA 2013-10-16, 09:08
How about using ChainMapper? Is the helpful for you?
On Wed, Oct 16, 2013 at 1:16 AM, Anh Pham <[EMAIL PROTECTED]> wrote:
> (Please correct me if I am wrong) So the original chain is:
> InputSplits-->Mapper--> [Sorting/Shuffling, etc]-->Reducer-->...
> Now I don't want the input splits to get to the Mappers first, but to go to
> some other new stage instead (we can call it Pre-Mapper for example, this
> class will be created by myself).
> So the new order will be: InputSplits -> Pre-Mapper->Mapper ->...
> I'm currently reading the source code. However, I still cannot find any
> clue (what classes I should touch). Any suggestion is welcome. Thank you
> very much :)