Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - Flume 1.3 package


+
Rahul Ravindran 2012-12-19, 17:34
+
Brock Noland 2012-12-19, 17:41
+
Rahul Ravindran 2012-12-20, 11:31
+
Alexander Alten-Lorenz 2012-12-20, 12:15
+
Rahul Ravindran 2012-12-20, 13:18
+
Alexander Alten-Lorenz 2012-12-20, 13:45
Copy link to this message
-
Re: Flume 1.3 package
Juhani Connolly 2012-12-21, 04:17
We use our own packaging of flume on top of CDH(versions vary as we have
a few hadoop clusters), without any problems.

Most of flume apart from the HDFS/HBase sink is independent of any
hadoop distribution. You *might* need to recompile with a different
hadoop profile(we have just been using the default). Perhaps someone
from cloudera can comment on this.

On 12/20/2012 10:18 PM, Rahul Ravindran wrote:
> Thanks Alexander.
>
> So, in the interim would installing the dependencies for Flume 1.2
> from CDH 4.1(see below) and un-tarring the 1.3 Flume tarball, be a
> reasonable alternative? Did we change any version on which flume-ng
> was dependent on when moving from 1.2 to 1.3?
>
> With this, I would look to install the packages adduser, hadoop-hdfs
> and bigtop-utils and then subsequently, use the 1.3 tarball
>
> $ apt-cache depends flume-ng
> flume-ng
>   Depends: adduser
>   Depends: hadoop-hdfs
>   Depends: bigtop-utils
>
> ------------------------------------------------------------------------
> *From:* Alexander Alten-Lorenz <[EMAIL PROTECTED]>
> *To:* [EMAIL PROTECTED]; Rahul Ravindran <[EMAIL PROTECTED]>
> *Sent:* Thursday, December 20, 2012 5:45 PM
> *Subject:* Re: Flume 1.3 package
>
> Should be in the first quarter 2013, according to the previous release
> cycles.
>
>
> On Dec 20, 2012, at 12:31 PM, Rahul Ravindran <[EMAIL PROTECTED]
> <mailto:[EMAIL PROTECTED]>> wrote:
>
> > Any ETA on when CDH 4.2 will be available?
> >
> >
> > ________________________________
> > From: Brock Noland <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> > To: "[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>"
> <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>; Rahul
> Ravindran <[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>>
> > Sent: Wednesday, December 19, 2012 11:11 PM
> > Subject: Re: Flume 1.3 package
> >
> > Hi,
> >
> > Yes Flume 1.3. will be included in CDH 4.2.
> >
> > Brock
> >
> > On Wed, Dec 19, 2012 at 11:34 AM, Rahul Ravindran <[EMAIL PROTECTED]
> <mailto:[EMAIL PROTECTED]>> wrote:
> >> Hi,
> >>    Is Flume 1.3 part of CDH4? Is Flume 1.3 part of any debian repo for
> >> installation? I have the link for http://flume.apache.org/download.html
> >> which gives me the tar file. However, this does not install Flume's
> >> dependencies.
> >> Thanks,
> >> ~Rahul.
> >
> >
> >
> > --
> > Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
>
>
>