Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # general - [DISCUSS] Spin out MR, HDFS and YARN as their own TLPs and disband Hadoop umbrella project


Copy link to this message
-
Re: [DISCUSS] Spin out MR, HDFS and YARN as their own TLPs and disband Hadoop umbrella project
Andrew Purtell 2012-08-30, 13:46
+1

Please don't do this again.

On Thu, Aug 30, 2012 at 12:18 AM, Todd Lipcon <[EMAIL PROTECTED]> wrote:

> Have we not learned our lessons from the last attempts to split?
>
> The issues in our community, which I think Chris is referring to, do
> not generally revolve around project boundaries. It's not the case
> that the HDFS community wants to go one way and the MR/YARN community
> wants to go another, and we get into a conflict around it. If it were,
> then splitting into separate TLPs would make a ton of sense.
>
> Instead, the issues are usually _within_ a component. So, if we split
> into 3 TLPs, then we'll just have 3 TLPs, each of which is just as
> contentious as before.
>
> Let's just embrace contention as a fact of life on a high-profile
> high-stakes project and get back to work.
>
> I wasted nearly a month undoing the mess of the last attempt, and I
> don't see why this time it would go any better. -1 from my perspective
> on splitting again at this point. Perhaps if we get to the point that
> we're never making cross-project commits it makes sense, but we're not
> there still.
>
> -Todd
>
> On Wed, Aug 29, 2012 at 1:40 PM, Alejandro Abdelnur <[EMAIL PROTECTED]>
> wrote:
> > I volunteer to help cleanup/normalize Maven stuff.
> >
> > Thx
> >
> > On Wed, Aug 29, 2012 at 1:34 PM, Tom White <[EMAIL PROTECTED]> wrote:
> >> Eric - I agree with Common being included in HDFS. That's what I meant
> >> by Common not having a clear enough mission to be a TLP by itself.
> >>
> >> Arun - I'm happy to RM some of the upcoming MR releases too. Also to
> >> help out with the work on audience annotations and compatibility.
> >>
> >> Cheers,
> >> Tom
> >>
> >> On Wed, Aug 29, 2012 at 7:22 PM, Arun C Murthy <[EMAIL PROTECTED]>
> wrote:
> >>> On Aug 29, 2012, at 10:04 AM, Arun C Murthy wrote:
> >>>> On Aug 29, 2012, at 10:02 AM, Suresh Srinivas wrote:
> >>>>>
> >>>>> Robert and Alejandro have brought up good questions. Here are my
> thoughts:
> >>>>> - For first one or two releases all the projects can coordinate and
> do the
> >>>>> releases together. This should help simplify the immediate work
> needed.
> >>>>> This should also help in us meeting the release timelines that we are
> >>>>> working towards. As the split makes progress, this cross project
> >>>>> coordination will no longer be necessary. I volunteer to RM these
> releases
> >>>>> and do the needed co-ordination from HDFS.
> >>>>
> >>>>
> >>>> +1 seems like a reasonable first step. Thanks for volunteering Suresh.
> >>>
> >>> Also, I'd say we make at least 3-4 alpha/beta releases in this shape.
> >>>
> >>> I volunteer to RM for MR/YARN releases and work with Suresh.
> >>>
> >>> Arun
> >>>
> >
> >
> >
> > --
> > Alejandro
>
>
>
> --
> Todd Lipcon
> Software Engineer, Cloudera
>

--
Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)