-
Re: Instructions on how to run Apache Hadoop 2.0.2-alpha?Glen Mazza 2013-01-04, 23:44
Wow. Thanks for the explanation, very helpful.
Glen
On 01/04/2013 06:28 PM, Robert Evans wrote:
> It is very long and confusing. Here is my understanding of what
> happened even though I was not around for all of it.
>
> 0.1 - 0.20 was mostly main line development. At that point there was
> a split and 0.20 was forked to add security, 0.20-security, and also
> to add in append support for H-BASE 0.20-append. For a long time
> these branches were maintained and has bug fixes added to it while
> main line development went on with 0.21 and 0.22. 0.20-security was
> merged with 0.20-append and was renamed 1.0. It has continued with
> bug fixes and some new feature work back ported from trunk.
>
> But development did not stop at 0.22. 0.23 was created to support
> YARN/MR-V2. At about the same time 0.24 was made for trunk. When
> 0.20-security+append became 1.0, 0.23 became 2.0 and 0.24 became 3.0.
> We at Yahoo! Have been in the process of stabilizing YARN for about a
> year or so. Because 2.0 looked like new features were going to
> continue to go in we decided to keep 0.23 alive for stabilization
> purposes while 2.0 continued on. It has since gotten several new
> features like HDFS-HA and protocol buffer based RPC for HDFS, and a
> few new features for YARN/MR. So you can almost think of 0.23 as
> 2.0--. We hope to move to 2.0 in the near future once it stabilizes
> and loses the alpha tag, at which point 0.23 would go away.
>
> --Bobby Evans
>
> From: Glen Mazza <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> Reply-To: "[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>"
> <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> Date: Friday, January 4, 2013 10:30 AM
> To: "[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>"
> <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> Subject: Re: Instructions on how to run Apache Hadoop 2.0.2-alpha?
>
> OK, looking at the Hadoop branches:
> http://svn.apache.org/viewvc/hadoop/common/branches/
> <http://svn.apache.org/viewvc/hadoop/common/branches/> and tags:
> http://svn.apache.org/viewvc/hadoop/common/tags/
> <http://svn.apache.org/viewvc/hadoop/common/tags/>, it's thankfully
> not that bad.
> There is no 0.24 in Hadoop, and the Maven pom files for the
> 2.0.2-alpha branch indeed say 2.0.2-alpha. The Cloudera article
> linked to below mentions 0.24, but it's from 2011 and may have been at
> a time before the Hadoop team decided to relabel to 2.0 instead.
> Looking at this again:
> http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/SingleCluster.html,
> it appears to provide workable instructions, I'll try again with it.
> Thanks for your assistance.
>
> Glen
>
> On 01/04/2013 11:17 AM, Chen He wrote:
>> Hi Glen
>>
>> I agree with you. There are many versions and confusing. If you
>> really want to know, you can check the developing and publishing
>> documents. In 0.23's document, they must announced how many patches
>> are included, as well as the 2.0.x.
>>
>> Then you will exactly understand which one is which one.
>>
>> Chen
>>
>> On Fri, Jan 4, 2013 at 6:58 AM, Glen Mazza <[EMAIL PROTECTED]
>> <mailto:[EMAIL PROTECTED]>> wrote:
>>
>> Thanks for your response. That's pretty vital information--I'm
>> not used to separate development/publication versions. Is the
>> 0.23-->2.0.2 renumbering stated anywhere on the Hadoop website or
>> wiki? It's very confusing as people otherwise think there are
>> three separate branches -- 0.2x.y, 1.x, and 2.x when there are
>> really just two.
>>
>> Also the releases page: http://hadoop.apache.org/releases.html
>> <http://hadoop.apache.org/releases.html> mentions *both* 0.23.x
>> and 2.0.2 releases -- wouldn't the former be numbered as the
>> latter, if as you're saying, 0.23 is published as 2.0.x?
>>
>> Thanks,
>> Glen
>>
>>
>> On 01/04/2013 07:02 AM, Chen He wrote:
>>> 0.24 is the developing version, 2.0.2 is the publication version.
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza
Glen
On 01/04/2013 06:28 PM, Robert Evans wrote:
> It is very long and confusing. Here is my understanding of what
> happened even though I was not around for all of it.
>
> 0.1 - 0.20 was mostly main line development. At that point there was
> a split and 0.20 was forked to add security, 0.20-security, and also
> to add in append support for H-BASE 0.20-append. For a long time
> these branches were maintained and has bug fixes added to it while
> main line development went on with 0.21 and 0.22. 0.20-security was
> merged with 0.20-append and was renamed 1.0. It has continued with
> bug fixes and some new feature work back ported from trunk.
>
> But development did not stop at 0.22. 0.23 was created to support
> YARN/MR-V2. At about the same time 0.24 was made for trunk. When
> 0.20-security+append became 1.0, 0.23 became 2.0 and 0.24 became 3.0.
> We at Yahoo! Have been in the process of stabilizing YARN for about a
> year or so. Because 2.0 looked like new features were going to
> continue to go in we decided to keep 0.23 alive for stabilization
> purposes while 2.0 continued on. It has since gotten several new
> features like HDFS-HA and protocol buffer based RPC for HDFS, and a
> few new features for YARN/MR. So you can almost think of 0.23 as
> 2.0--. We hope to move to 2.0 in the near future once it stabilizes
> and loses the alpha tag, at which point 0.23 would go away.
>
> --Bobby Evans
>
> From: Glen Mazza <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> Reply-To: "[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>"
> <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> Date: Friday, January 4, 2013 10:30 AM
> To: "[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>"
> <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> Subject: Re: Instructions on how to run Apache Hadoop 2.0.2-alpha?
>
> OK, looking at the Hadoop branches:
> http://svn.apache.org/viewvc/hadoop/common/branches/
> <http://svn.apache.org/viewvc/hadoop/common/branches/> and tags:
> http://svn.apache.org/viewvc/hadoop/common/tags/
> <http://svn.apache.org/viewvc/hadoop/common/tags/>, it's thankfully
> not that bad.
> There is no 0.24 in Hadoop, and the Maven pom files for the
> 2.0.2-alpha branch indeed say 2.0.2-alpha. The Cloudera article
> linked to below mentions 0.24, but it's from 2011 and may have been at
> a time before the Hadoop team decided to relabel to 2.0 instead.
> Looking at this again:
> http://hadoop.apache.org/docs/r2.0.2-alpha/hadoop-yarn/hadoop-yarn-site/SingleCluster.html,
> it appears to provide workable instructions, I'll try again with it.
> Thanks for your assistance.
>
> Glen
>
> On 01/04/2013 11:17 AM, Chen He wrote:
>> Hi Glen
>>
>> I agree with you. There are many versions and confusing. If you
>> really want to know, you can check the developing and publishing
>> documents. In 0.23's document, they must announced how many patches
>> are included, as well as the 2.0.x.
>>
>> Then you will exactly understand which one is which one.
>>
>> Chen
>>
>> On Fri, Jan 4, 2013 at 6:58 AM, Glen Mazza <[EMAIL PROTECTED]
>> <mailto:[EMAIL PROTECTED]>> wrote:
>>
>> Thanks for your response. That's pretty vital information--I'm
>> not used to separate development/publication versions. Is the
>> 0.23-->2.0.2 renumbering stated anywhere on the Hadoop website or
>> wiki? It's very confusing as people otherwise think there are
>> three separate branches -- 0.2x.y, 1.x, and 2.x when there are
>> really just two.
>>
>> Also the releases page: http://hadoop.apache.org/releases.html
>> <http://hadoop.apache.org/releases.html> mentions *both* 0.23.x
>> and 2.0.2 releases -- wouldn't the former be numbered as the
>> latter, if as you're saying, 0.23 is published as 2.0.x?
>>
>> Thanks,
>> Glen
>>
>>
>> On 01/04/2013 07:02 AM, Chen He wrote:
>>> 0.24 is the developing version, 2.0.2 is the publication version.
Glen Mazza
Talend Community Coders - coders.talend.com
blog: www.jroller.com/gmazza
