Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - "single source - multi channel" scenario  and applying interceptor while writing to only one channel and not on others...possible approaches


Copy link to this message
-
Re: "single source - multi channel" scenario  and applying interceptor while writing to only one channel and not on others...possible approaches
Jagadish Bihani 2013-04-17, 06:12
Hi

If anybody has any inputs on this that will surely help.

Regards,
Jagadish

On 04/16/2013 12:06 PM, Jagadish Bihani wrote:
> Hi
>
> We have a use case in which
> 1. spooling source reads data.
> 2. It needs to write events into multiple channels. It should apply
> interceptor only when putting into one channel and should put
> the event as it is while putting into another channel.
>
> Possible approach we have thought:
>
> 1. Create  2 different sources and then apply interceptor on one and dont
> apply on other. But that duplicates reads and increases IO.
>
> Is there any better way of achieving this use case?
>
> Regards,
> Jagadish
>