Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> Content request for 0.20.205 Sustaining Release


Copy link to this message
-
Re: Content request for 0.20.205 Sustaining Release
Agree, +1.

It will be good to ensure we get a more modern version of
FairScheduler for interested folks.

Arun

Sent from my iPhone

On Sep 2, 2011, at 5:55 PM, Matei Zaharia <[EMAIL PROTECTED]> wrote:

> Hi Matt,
>
> I'd like to propose backporting some of the new fair scheduler features that have been out for almost 2 years now (in the 0.21 branch and trunk) into 0.20.205, especially https://issues.apache.org/jira/browse/MAPREDUCE-551 and https://issues.apache.org/jira/browse/MAPREDUCE-706. I will try to put together a patch for this. It should be a matter of taking the trunk fairscheduler directory and just tweaking anything that might be required to compile on 0.20.205; I don't think there are other major differences.
>
> Matei
>
> On Sep 1, 2011, at 11:48 AM, Arun C Murthy wrote:
>
>> Thanks for the input guys - I'll look at MAPREDUCE-2601,MAPREDUCE-2779 & HADOOP-7602.
>>
>> Arun
>>
>> On Sep 1, 2011, at 11:02 AM, John George wrote:
>>
>>> Hi Matt,
>>> I would like to bring HADOOP-7602 to your attention. I just filed it today
>>> and have a patch uploaded, but I think it should go in to 205.
>>> Thank you for considering.
>>>
>>> Regads,
>>> John George
>>>
>>>
>>> On 9/1/11 11:08 AM, "Rottinghuis, Joep" <[EMAIL PROTECTED]> wrote:
>>>
>>>> Could you please add MAPREDUCE-2779 to the list as well?
>>>> This one has a patch as well.
>>>>
>>>> Thanks,
>>>>
>>>> Joep
>>>> ________________________________________
>>>> From: Rottinghuis, Joep [[EMAIL PROTECTED]]
>>>> Sent: Thursday, September 01, 2011 9:04 AM
>>>> To: [EMAIL PROTECTED]
>>>> Subject: RE: Content request for 0.20.205 Sustaining Release
>>>>
>>>> Hi Matt,
>>>>
>>>> IMHO MAPREDUCE-2610 should be included in 205 as well.
>>>> We applied it to our branch because our users had problems with getting queue
>>>> information.
>>>>
>>>> Thanks,
>>>>
>>>> Joep
>>>> ________________________________________
>>>> From: Matt Foley [[EMAIL PROTECTED]]
>>>> Sent: Wednesday, August 31, 2011 11:16 AM
>>>> To: [EMAIL PROTECTED]
>>>> Subject: Re: Content request for 0.20.205 Sustaining Release
>>>>
>>>> Thank you, Nathan.  And thanks for combining these requests, it's much
>>>> easier to review a single list than 10 or more emails.
>>>>
>>>> Does anyone else have requests for items to include in 0.20.205 - either
>>>> already submitted to 0.20-security, or pending work?
>>>>
>>>> Thanks,
>>>> --Matt
>>>>
>>>> On Wed, Aug 31, 2011 at 8:25 AM, Nathan Roberts <[EMAIL PROTECTED]>wrote:
>>>>
>>>>> Hi Matt,
>>>>>
>>>>> My colleagues with experience running 0.20.203 (as well as many previous
>>>>> releases of Hadoop) in Yahoo!'s production environment are requesting that
>>>>> the following items be included as high priority sustaining improvements in
>>>>> 0.20.205.  Rather than contributors sending in several separate requests to
>>>>> this mailing list, this email aggregates contributions from the following
>>>>> individuals: Daryn Sharp, Jeffrey Naisbitt, Kihwal Lee, Sherry Chen, Thomas
>>>>> Graves, Bharath Mundlapudi, Robert Joseph Evans, Anupam Seth, Eric Payne,
>>>>> John George.
>>>>>
>>>>> Recommendations and suggestions for this list of jiras came from folks with
>>>>> significant experience working with large scale Hadoop clusters within
>>>>> Yahoo! production environments, including Service Engineering teams, Quality
>>>>> Engineering teams, Solutions Engineering teams, and Development teams.
>>>>>
>>>>> Notes on the items listed below:
>>>>>
>>>>> *   All the Jiras listed with the exception of HADOOP-7510,
>>>>> MAPREDUCE-2764, MAPREDUCE-2915, and HDFS-2257 have been committed to
>>>>> 0.20-security. These remaining four jiras are in-progress and should wrap up
>>>>> over the next few days.
>>>>> *   All of the jiras listed have been fixed in trunk with the following
>>>>> exceptions:
>>>>> *   The four jiras listed above which are still being worked
>>>>> *   MAPREDUCE-2780 - Similar to previous bullet. In progress now.
>>>>> *   MAPREDUCE-2324 - Has a strong interaction with MR279 so filed