Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Moving from Flume OG to Flume NG

Kumar, Deepak8 2012-10-05, 11:19
Brock Noland 2012-10-05, 14:35
Kumar, Deepak8 2012-10-05, 15:08
Brock Noland 2012-10-05, 15:17
Kumar, Deepak8 2012-10-05, 15:28
Brock Noland 2012-10-08, 16:02
Kumar, Deepak8 2012-10-09, 06:03
Brock Noland 2012-10-09, 14:51
Kumar, Deepak8 2012-09-18, 18:02
Brock Noland 2012-09-18, 18:05
Shumin Wu 2012-09-18, 18:10
Copy link to this message
RE: Moving from Flume OG to Flume NG
Hi Shumin,
I have gone through the documentation, but it don't have much. Do you have any use case in which you are using CustomSource? As in flume 0.9.4, we do have flume master url where we can see the source/sinks/decorators etc. How we can verify here whether our custom source is fine & up or have any errors?

It would be much help if you please guide me a bit.


From: Shumin Wu [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, September 18, 2012 2:11 PM
Subject: Re: Moving from Flume OG to Flume NG

Hi Deepark,

I had hard time switching from OG to NG in the beginning, too. The new way in NG to make your custom source would look like this:

public class CustomSource extends AbstractSource implements PollableSource, Configurable


public class CustomSource extends AbstractSource implements EventDrivenSource, Configurable

, depending on your source type.

Brock's link is a good reading resource.

On Tue, Sep 18, 2012 at 11:05 AM, Brock Noland <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

The flume developer guide as these details:



On Tue, Sep 18, 2012 at 1:02 PM, Kumar, Deepak8 <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
> Hi,
> I am trying to switch from Flume 0.94 to Flume NG. In previous version we do have the static class EventSource.Base through which we can create our own Source or Sink. I don't find anything as such here in flume NG.
> Could you please guide me how do we create our own Sources here in Flume NG?
> Regards,
> Deepak
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Shumin Wu 2012-10-03, 14:10