Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> Rejuvenate Hadoop 0.22 effort


Copy link to this message
-
Re: Rejuvenate Hadoop 0.22 effort
I'd say let's take a look at how bad are the problems; what are discrepancies?

Do you have any build links or some such to point to?
  Cos
  
On Fri, Sep 23, 2011 at 05:34PM, Roman Shaposhnik wrote:
> On Fri, Sep 16, 2011 at 2:21 AM, Konstantin Shvachko
> <[EMAIL PROTECTED]> wrote:
> > == TESTING => > 5. I think Steve's idea of integrating 0.22 with Apache BigTop is
> > great. Will be glad to see any steps in this direction.
>
> The basic integration is done. We can produce fully functional RPM
> and DEB packages for Hadoop 0.22 release.
>
> This is good news. The bad news is that very few downstream components
> can be compiled against .22. And I'm not talking changes to versions, pom.xml
> and build.xml files. I'm talking API incompatibilities. Pig, Hive, HBase, Mahout
> all need to be modified to support .22. Before that's done -- there's
> little that
> can be done as far as stack validation is concerned.
>
> Given that work needs to be done in downstream components, I've got 2 questions:
>    1. do we know if the API delta between .22 and .23 is as
> significant as betwen
>    .22 and .20.2?
>
>    2. what's the common approach downstream to support multiple versions of
>    Hadoop APIs? Or is this even something that can be asked of all the
> components?
>
> Thanks,
> Roman.