Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845


Copy link to this message
-
Re: Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845
build slaves hadoop1-hadoop9 now has libprotoc 2.5.0

-Giri
On Fri, Aug 9, 2013 at 10:56 PM, Giridharan Kesavan <
[EMAIL PROTECTED]> wrote:

> Alejandro,
>
> I'm upgrading protobuf on slaves hadoop1-hadoop9.
>
> -Giri
>
>
> On Fri, Aug 9, 2013 at 1:15 PM, Alejandro Abdelnur <[EMAIL PROTECTED]>wrote:
>
>> pinging again, I need help from somebody with sudo access to the hadoop
>> jenkins boxes to do this or to get sudo access for a couple of hours to
>> set
>> up myself.
>>
>> Please!!!
>>
>> thx
>>
>>
>> On Thu, Aug 8, 2013 at 2:29 PM, Alejandro Abdelnur <[EMAIL PROTECTED]
>> >wrote:
>>
>> > To move forward with this we need protoc 2.5.0 in the apache hadoop
>> > jenkins boxes.
>> >
>> > Who can help with this? I assume somebody at Y!, right?
>> >
>> > Thx
>> >
>> >
>> > On Thu, Aug 8, 2013 at 2:24 PM, Elliott Clark <[EMAIL PROTECTED]>
>> wrote:
>> >
>> >> In HBase land we've pretty well discovered that we'll need to have the
>> >> same version of protobuf that the HDFS/Yarn/MR servers are running.
>> >> That is to say there are issues with ever having 2.4.x and 2.5.x on
>> >> the same class path.
>> >>
>> >> Upgrading to 2.5.x would be great, as it brings some new classes we
>> >> could use.  With that said HBase is getting pretty close to a rather
>> >> large release (0.96.0 aka The Singularity) so getting this in sooner
>> >> rather than later would be great.  If we could get this into 2.1.0 it
>> >> would be great as that would allow us to have a pretty easy story to
>> >> users with regards to protobuf version.
>> >>
>> >> On Thu, Aug 8, 2013 at 8:18 AM, Kihwal Lee <[EMAIL PROTECTED]>
>> wrote:
>> >> > Sorry to hijack the thread but, I also wanted to mention Avro. See
>> >> HADOOP-9672.
>> >> > The version we are using has memory leak and inefficiency issues.
>> We've
>> >> seen users running into it.
>> >> >
>> >> > Kihwal
>> >> >
>> >> >
>> >> > ________________________________
>> >> >  From: Tsuyoshi OZAWA <[EMAIL PROTECTED]>
>> >> > To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> >> > Cc: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>; "
>> >> [EMAIL PROTECTED]" <[EMAIL PROTECTED]>; "
>> >> [EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> >> > Sent: Thursday, August 8, 2013 1:59 AM
>> >> > Subject: Re: Upgrade to protobuf 2.5.0 for the 2.1.0 release,
>> >> HADOOP-9845
>> >> >
>> >> >
>> >> > Hi,
>> >> >
>> >> > About Hadoop, Harsh is dealing with this problem in HADOOP-9346.
>> >> > For more detail, please see the JIRA ticket:
>> >> > https://issues.apache.org/jira/browse/HADOOP-9346
>> >> >
>> >> > - Tsuyoshi
>> >> >
>> >> > On Thu, Aug 8, 2013 at 1:49 AM, Alejandro Abdelnur <
>> [EMAIL PROTECTED]>
>> >> wrote:
>> >> >> I' like to upgrade to protobuf 2.5.0 for the 2.1.0 release.
>> >> >>
>> >> >> As mentioned in HADOOP-9845, Protobuf 2.5 has significant benefits
>> to
>> >> >> justify the upgrade.
>> >> >>
>> >> >> Doing the upgrade now, with the first beta, will make things easier
>> for
>> >> >> downstream projects (like HBase) using protobuf and adopting Hadoop
>> 2.
>> >> If
>> >> >> we do the upgrade later, downstream projects will have to support 2
>> >> >> different versions and they my get in nasty waters due to classpath
>> >> issues.
>> >> >>
>> >> >> I've locally tested the patch in a pseudo deployment of 2.1.0-beta
>> >> branch
>> >> >> and it works fine (something is broken in trunk in the RPC layer
>> >> YARN-885).
>> >> >>
>> >> >> Now, to do this it will require a few things:
>> >> >>
>> >> >> * Make sure protobuf 2.5.0 is available in the jenkins box
>> >> >> * A follow up email to dev@ aliases indicating developers should
>> >> install
>> >> >> locally protobuf 2.5.0
>> >> >>
>> >> >> Thanks.
>> >> >>
>> >> >> --
>> >> >> Alejandro
>> >>
>> >
>> >
>> >
>> > --
>> > Alejandro
>> >
>>
>>
>>
>> --
>> Alejandro
>>
>
>