Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> [VOTE] Release hadoop-2.0.0-alpha


Copy link to this message
-
Re: [VOTE] Release hadoop-2.0.0-alpha
Hey Arun,

One more thing on the rc tarball: the source artifact doesn't appear
to be an exact svn export, based on a diff. For example, it includes
the README, NOTICE, and LICENSE files, as well as a few other things
which appear to be build artifacts (eg
hadoop-hdfs-project/hadoop-hdfs/downloads,
hadoop-hdfs-project/hadoop-hdfs/test_edit_log, etc).

It seems like we _should_ have the various README style files, but we
shouldn't have the test artifacts in our source release.

In order to get our source release to match svn, perhaps we should
move NOTICE, README, LICENSE, etc to the top level of our svn repo,
such that a pure svn export would be a releaseable source artifact?

-Todd

On Mon, May 14, 2012 at 2:14 PM, Siddharth Seth
<[EMAIL PROTECTED]> wrote:
> Do we want to get MAPREDUCE-4067 in as well ? It affects folks who may be
> writing their own AMs. Shouldn't affect MR clients though. I believe 2.0
> alpha doesn't freeze the Yarn protocols for the 2.0 branch, so probably not
> critical.
>
> Thanks
> - Sid
>
> On Mon, May 14, 2012 at 1:32 PM, Eli Collins <[EMAIL PROTECTED]> wrote:
>
>> As soon as jira is back up and I can post an updated patch I'll merge
>> HDFS-3418 (also incompatible).
>>
>>
>> On Mon, May 14, 2012 at 12:16 PM, Tsz Wo Sze <[EMAIL PROTECTED]> wrote:
>> > I just have merged HADOOP-8285 and HADOOP-8366.  I also have merged
>> HDFS-3211 since it is an incompatible protocol change (without it,
>> 2.0.0-alphaand 2.0.0 will be incompatible.)
>> >
>> > Tsz-Wo
>> >
>> >
>> >
>> > ----- Original Message -----
>> > From: Tsz Wo Sze <[EMAIL PROTECTED]>
>> > To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> > Cc:
>> > Sent: Monday, May 14, 2012 11:07 AM
>> > Subject: Re: [VOTE] Release hadoop-2.0.0-alpha
>> >
>> > Let me merge HADOOP-8285 and HADOOP-8366.  Thanks.
>> > Tsz-Wo
>> >
>> >
>> >
>> > ----- Original Message -----
>> > From: Uma Maheswara Rao G <[EMAIL PROTECTED]>
>> > To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> > Cc:
>> > Sent: Monday, May 14, 2012 10:56 AM
>> > Subject: RE: [VOTE] Release hadoop-2.0.0-alpha
>> >
>> >> a) Revert HDFS-3157 and commit HADOOP-8285 and HADOOP-8366 on
>> >> branch-2.0.0-alpha, so these are the only changes since rc0. Roll a
>> >> new rc1 from here.
>> > I have merged HDFS-3157 revert.
>> > Do you mind taking a look at HADOOP-8285 and HADOOP-8366?
>> >
>> > Thanks,
>> > Uma
>> > ________________________________________
>> > From: Arun C Murthy [[EMAIL PROTECTED]]
>> > Sent: Monday, May 14, 2012 10:24 PM
>> > To: [EMAIL PROTECTED]
>> > Subject: Re: [VOTE] Release hadoop-2.0.0-alpha
>> >
>> > Todd,
>> >
>> > Please go ahead and merge changes into branch-2.0.0-alpha and I'll roll
>> RC1.
>> >
>> > thanks,
>> > Arun
>> >
>> > On May 12, 2012, at 10:05 PM, Todd Lipcon wrote:
>> >
>> >> Looking at the release tag vs the current state of branch-2, I have
>> >> two concerns from the point of view of HDFS:
>> >>
>> >> 1) We reverted HDFS-3157 in branch-2 because it sends deletions for
>> >> corrupt replicas without properly going through the "corrupt block"
>> >> path. We saw this cause data loss in TestPipelinesFailover. So, I'm
>> >> nervous about putting it in a release, even labeled as alpha.
>> >>
>> >> 2) HADOOP-8285 and HADOOP-8366 changed the wire format for the RPC
>> >> envelope in branch-2, but didn't make it into this rc. So, that would
>> >> mean that future alphas would not be protocol-compatible with this
>> >> alpha. Per a discussion a few weeks ago, I think we all were in
>> >> agreement that, if possible, we'd like all 2.x to be compatible for
>> >> client-server communication, at least (even if we don't support
>> >> cross-version for the intra-cluster protocols)
>> >>
>> >> Do other folks think it's worth rolling an rc1? I would propose either:
>> >> a) Revert HDFS-3157 and commit HADOOP-8285 and HADOOP-8366 on
>> >> branch-2.0.0-alpha, so these are the only changes since rc0. Roll a
>> >> new rc1 from here.
>>
Todd Lipcon
Software Engineer, Cloudera