Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # dev - Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845


Copy link to this message
-
Re: Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845
Giridharan Kesavan 2013-08-12, 18:30
Like I said protoc is upgraded from 2.4 to 2.5. 2.5 is in the default path.
If we still need 2.4 I may have to install it. Let me know

-Giri
On Sat, Aug 10, 2013 at 7:01 AM, Alejandro Abdelnur <[EMAIL PROTECTED]>wrote:

> thanks giri, how do we set 2.4 or 2.5., what is the path to both so we can
> use and env to set it in the jobs?
>
> thx
>
> Alejandro
> (phone typing)
>
> On Aug 9, 2013, at 23:10, Giridharan Kesavan <[EMAIL PROTECTED]>
> wrote:
>
> > build slaves hadoop1-hadoop9 now has libprotoc 2.5.0
> >
> >
> >
> > -Giri
> >
> >
> > On Fri, Aug 9, 2013 at 10:56 PM, Giridharan Kesavan <
> > [EMAIL PROTECTED]> wrote:
> >
> >> Alejandro,
> >>
> >> I'm upgrading protobuf on slaves hadoop1-hadoop9.
> >>
> >> -Giri
> >>
> >>
> >> On Fri, Aug 9, 2013 at 1:15 PM, Alejandro Abdelnur <[EMAIL PROTECTED]
> >wrote:
> >>
> >>> pinging again, I need help from somebody with sudo access to the hadoop
> >>> jenkins boxes to do this or to get sudo access for a couple of hours to
> >>> set
> >>> up myself.
> >>>
> >>> Please!!!
> >>>
> >>> thx
> >>>
> >>>
> >>> On Thu, Aug 8, 2013 at 2:29 PM, Alejandro Abdelnur <[EMAIL PROTECTED]
> >>>> wrote:
> >>>
> >>>> To move forward with this we need protoc 2.5.0 in the apache hadoop
> >>>> jenkins boxes.
> >>>>
> >>>> Who can help with this? I assume somebody at Y!, right?
> >>>>
> >>>> Thx
> >>>>
> >>>>
> >>>> On Thu, Aug 8, 2013 at 2:24 PM, Elliott Clark <[EMAIL PROTECTED]>
> >>> wrote:
> >>>>
> >>>>> In HBase land we've pretty well discovered that we'll need to have
> the
> >>>>> same version of protobuf that the HDFS/Yarn/MR servers are running.
> >>>>> That is to say there are issues with ever having 2.4.x and 2.5.x on
> >>>>> the same class path.
> >>>>>
> >>>>> Upgrading to 2.5.x would be great, as it brings some new classes we
> >>>>> could use.  With that said HBase is getting pretty close to a rather
> >>>>> large release (0.96.0 aka The Singularity) so getting this in sooner
> >>>>> rather than later would be great.  If we could get this into 2.1.0 it
> >>>>> would be great as that would allow us to have a pretty easy story to
> >>>>> users with regards to protobuf version.
> >>>>>
> >>>>> On Thu, Aug 8, 2013 at 8:18 AM, Kihwal Lee <[EMAIL PROTECTED]>
> >>> wrote:
> >>>>>> Sorry to hijack the thread but, I also wanted to mention Avro. See
> >>>>> HADOOP-9672.
> >>>>>> The version we are using has memory leak and inefficiency issues.
> >>> We've
> >>>>> seen users running into it.
> >>>>>>
> >>>>>> Kihwal
> >>>>>>
> >>>>>>
> >>>>>> ________________________________
> >>>>>> From: Tsuyoshi OZAWA <[EMAIL PROTECTED]>
> >>>>>> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> >>>>>> Cc: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>; "
> >>>>> [EMAIL PROTECTED]" <[EMAIL PROTECTED]>; "
> >>>>> [EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> >>>>>> Sent: Thursday, August 8, 2013 1:59 AM
> >>>>>> Subject: Re: Upgrade to protobuf 2.5.0 for the 2.1.0 release,
> >>>>> HADOOP-9845
> >>>>>>
> >>>>>>
> >>>>>> Hi,
> >>>>>>
> >>>>>> About Hadoop, Harsh is dealing with this problem in HADOOP-9346.
> >>>>>> For more detail, please see the JIRA ticket:
> >>>>>> https://issues.apache.org/jira/browse/HADOOP-9346
> >>>>>>
> >>>>>> - Tsuyoshi
> >>>>>>
> >>>>>> On Thu, Aug 8, 2013 at 1:49 AM, Alejandro Abdelnur <
> >>> [EMAIL PROTECTED]>
> >>>>> wrote:
> >>>>>>> I' like to upgrade to protobuf 2.5.0 for the 2.1.0 release.
> >>>>>>>
> >>>>>>> As mentioned in HADOOP-9845, Protobuf 2.5 has significant benefits
> >>> to
> >>>>>>> justify the upgrade.
> >>>>>>>
> >>>>>>> Doing the upgrade now, with the first beta, will make things easier
> >>> for
> >>>>>>> downstream projects (like HBase) using protobuf and adopting Hadoop
> >>> 2.
> >>>>> If
> >>>>>>> we do the upgrade later, downstream projects will have to support 2
> >>>>>>> different versions and they my get in nasty waters due to classpath
> >>>>> issues.
> >>>>>>>
> >>>