Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # general - [DISCUSS] Spin out MR, HDFS and YARN as their own TLPs and disband Hadoop umbrella project


Copy link to this message
-
Re: [DISCUSS] Spin out MR, HDFS and YARN as their own TLPs and disband Hadoop umbrella project
Todd Lipcon 2012-08-29, 21:18
Have we not learned our lessons from the last attempts to split?

The issues in our community, which I think Chris is referring to, do
not generally revolve around project boundaries. It's not the case
that the HDFS community wants to go one way and the MR/YARN community
wants to go another, and we get into a conflict around it. If it were,
then splitting into separate TLPs would make a ton of sense.

Instead, the issues are usually _within_ a component. So, if we split
into 3 TLPs, then we'll just have 3 TLPs, each of which is just as
contentious as before.

Let's just embrace contention as a fact of life on a high-profile
high-stakes project and get back to work.

I wasted nearly a month undoing the mess of the last attempt, and I
don't see why this time it would go any better. -1 from my perspective
on splitting again at this point. Perhaps if we get to the point that
we're never making cross-project commits it makes sense, but we're not
there still.

-Todd

On Wed, Aug 29, 2012 at 1:40 PM, Alejandro Abdelnur <[EMAIL PROTECTED]> wrote:
> I volunteer to help cleanup/normalize Maven stuff.
>
> Thx
>
> On Wed, Aug 29, 2012 at 1:34 PM, Tom White <[EMAIL PROTECTED]> wrote:
>> Eric - I agree with Common being included in HDFS. That's what I meant
>> by Common not having a clear enough mission to be a TLP by itself.
>>
>> Arun - I'm happy to RM some of the upcoming MR releases too. Also to
>> help out with the work on audience annotations and compatibility.
>>
>> Cheers,
>> Tom
>>
>> On Wed, Aug 29, 2012 at 7:22 PM, Arun C Murthy <[EMAIL PROTECTED]> wrote:
>>> On Aug 29, 2012, at 10:04 AM, Arun C Murthy wrote:
>>>> On Aug 29, 2012, at 10:02 AM, Suresh Srinivas wrote:
>>>>>
>>>>> Robert and Alejandro have brought up good questions. Here are my thoughts:
>>>>> - For first one or two releases all the projects can coordinate and do the
>>>>> releases together. This should help simplify the immediate work needed.
>>>>> This should also help in us meeting the release timelines that we are
>>>>> working towards. As the split makes progress, this cross project
>>>>> coordination will no longer be necessary. I volunteer to RM these releases
>>>>> and do the needed co-ordination from HDFS.
>>>>
>>>>
>>>> +1 seems like a reasonable first step. Thanks for volunteering Suresh.
>>>
>>> Also, I'd say we make at least 3-4 alpha/beta releases in this shape.
>>>
>>> I volunteer to RM for MR/YARN releases and work with Suresh.
>>>
>>> Arun
>>>
>
>
>
> --
> Alejandro

--
Todd Lipcon
Software Engineer, Cloudera