Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - "single source - multi channel" scenario  and applying interceptor while writing to only one channel and not on others...possible approaches


Copy link to this message
-
"single source - multi channel" scenario  and applying interceptor while writing to only one channel and not on others...possible approaches
Jagadish Bihani 2013-04-16, 06:36
Hi

We have a use case in which
1. spooling source reads data.
2. It needs to write events into multiple channels. It should apply
interceptor only when putting into one channel and should put
the event as it is while putting into another channel.

Possible approach we have thought:

1. Create  2 different sources and then apply interceptor on one and dont
apply on other. But that duplicates reads and increases IO.

Is there any better way of achieving this use case?

Regards,
Jagadish
+
Jagadish Bihani 2013-04-17, 06:12
+
Jeff Lord 2013-04-19, 16:34
+
Jeff Lord 2013-04-19, 18:14
+
Connor Woodson 2013-04-23, 06:52
+
Connor Woodson 2013-04-23, 06:57
+
Jagadish Bihani 2013-04-23, 09:02
+
Israel Ekpo 2013-04-23, 14:15
+
Connor Woodson 2013-04-26, 05:15