Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845


Copy link to this message
-
Re: Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845
pinging again, I need help from somebody with sudo access to the hadoop
jenkins boxes to do this or to get sudo access for a couple of hours to set
up myself.

Please!!!

thx
On Thu, Aug 8, 2013 at 2:29 PM, Alejandro Abdelnur <[EMAIL PROTECTED]>wrote:

> To move forward with this we need protoc 2.5.0 in the apache hadoop
> jenkins boxes.
>
> Who can help with this? I assume somebody at Y!, right?
>
> Thx
>
>
> On Thu, Aug 8, 2013 at 2:24 PM, Elliott Clark <[EMAIL PROTECTED]> wrote:
>
>> In HBase land we've pretty well discovered that we'll need to have the
>> same version of protobuf that the HDFS/Yarn/MR servers are running.
>> That is to say there are issues with ever having 2.4.x and 2.5.x on
>> the same class path.
>>
>> Upgrading to 2.5.x would be great, as it brings some new classes we
>> could use.  With that said HBase is getting pretty close to a rather
>> large release (0.96.0 aka The Singularity) so getting this in sooner
>> rather than later would be great.  If we could get this into 2.1.0 it
>> would be great as that would allow us to have a pretty easy story to
>> users with regards to protobuf version.
>>
>> On Thu, Aug 8, 2013 at 8:18 AM, Kihwal Lee <[EMAIL PROTECTED]> wrote:
>> > Sorry to hijack the thread but, I also wanted to mention Avro. See
>> HADOOP-9672.
>> > The version we are using has memory leak and inefficiency issues. We've
>> seen users running into it.
>> >
>> > Kihwal
>> >
>> >
>> > ________________________________
>> >  From: Tsuyoshi OZAWA <[EMAIL PROTECTED]>
>> > To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> > Cc: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>; "
>> [EMAIL PROTECTED]" <[EMAIL PROTECTED]>; "
>> [EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> > Sent: Thursday, August 8, 2013 1:59 AM
>> > Subject: Re: Upgrade to protobuf 2.5.0 for the 2.1.0 release,
>> HADOOP-9845
>> >
>> >
>> > Hi,
>> >
>> > About Hadoop, Harsh is dealing with this problem in HADOOP-9346.
>> > For more detail, please see the JIRA ticket:
>> > https://issues.apache.org/jira/browse/HADOOP-9346
>> >
>> > - Tsuyoshi
>> >
>> > On Thu, Aug 8, 2013 at 1:49 AM, Alejandro Abdelnur <[EMAIL PROTECTED]>
>> wrote:
>> >> I' like to upgrade to protobuf 2.5.0 for the 2.1.0 release.
>> >>
>> >> As mentioned in HADOOP-9845, Protobuf 2.5 has significant benefits to
>> >> justify the upgrade.
>> >>
>> >> Doing the upgrade now, with the first beta, will make things easier for
>> >> downstream projects (like HBase) using protobuf and adopting Hadoop 2.
>> If
>> >> we do the upgrade later, downstream projects will have to support 2
>> >> different versions and they my get in nasty waters due to classpath
>> issues.
>> >>
>> >> I've locally tested the patch in a pseudo deployment of 2.1.0-beta
>> branch
>> >> and it works fine (something is broken in trunk in the RPC layer
>> YARN-885).
>> >>
>> >> Now, to do this it will require a few things:
>> >>
>> >> * Make sure protobuf 2.5.0 is available in the jenkins box
>> >> * A follow up email to dev@ aliases indicating developers should
>> install
>> >> locally protobuf 2.5.0
>> >>
>> >> Thanks.
>> >>
>> >> --
>> >> Alejandro
>>
>
>
>
> --
> Alejandro
>

--
Alejandro