Hello Friends,

         I am working to propose some improved hadoop scheduling algorithm
or speculative execution algorithim as part of my Phd research work.  Now,
the new version of hadoop, YARN/MR v2, is available.

I have the following doubts:

So, the algorithms (particularly scheduling and speculation
algorithms) proposed for old hadoop version are applicable for new version
of hadoop (YARN) or not.

Is it worth and usefull to propose an algorithm for old hadoop version now?

Is the user community can support and discuss the issues releted to old
version?

Thanks in Advance.

*Regards*
*S.Suresh,*
*Research Scholar,*
*Department of Computer Applications,*
*National Institute of Technology,*
*Tiruchirappalli - 620015.*
*+91-9941506562*

Suresh,

The 1.0 line is still the stable line and improvements there can have a
large impact on existing users.  That being said I think there will be a
lot of movement to Yarn/MRv2 starting in the second half of this year and
all of next year.  Also YARN scheduling is a larger area for study because
it doesn't just run Map/Reduce.  It allows you to explore how to
effectively schedule other workloads in a multi-tennant environment. There
has already been a lot of discussion about the scheduler and its protocol
recently because it is still a very new area to explore and no one really
knows how well the current solutions work for other work loads.

As for speculative execution in MRv2 it is completely pluggable by the
user.  This should make it very easy for you to explore and compare
different speculation schemes.

--Bobby
On 2/7/13 11:39 PM, "Suresh S" <[EMAIL PROTECTED]> wrote:

>Hello Friends,
>
>         I am working to propose some improved hadoop scheduling algorithm
>or speculative execution algorithim as part of my Phd research work.  Now,
>the new version of hadoop, YARN/MR v2, is available.
>
>I have the following doubts:
>
>So, the algorithms (particularly scheduling and speculation
>algorithms) proposed for old hadoop version are applicable for new version
>of hadoop (YARN) or not.
>
>Is it worth and usefull to propose an algorithm for old hadoop version
>now?
>
>Is the user community can support and discuss the issues releted to old
>version?
>
>Thanks in Advance.
>
>*Regards*
>*S.Suresh,*
>*Research Scholar,*
>*Department of Computer Applications,*
>*National Institute of Technology,*
>*Tiruchirappalli - 620015.*
>*+91-9941506562*