| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
47 (2.988s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: "single source - multi channel" scenario and applying interceptor while writing to only one channel and not on others...possible approaches - Flume - [mail # user]
|
|
...Hi Thanks Jeff and Connor. That was helpful. @Connor : Scenario: ====== We have a scenario where we receive logs where each record contains several field...
|
|
|
Author: Jagadish Bihani,
2013-04-23, 09:02
|
|
|
Re: "single source - multi channel" scenario and applying interceptor while writing to only one channel and not on others...possible approaches - Flume - [mail # user]
|
|
...Hi If anybody has any inputs on this that will surely help. Regards, Jagadish On 04/16/2013 12:06 PM, Jagadish Bihani wrote:...
|
|
|
Author: Jagadish Bihani,
2013-04-17, 06:12
|
|
|
"single source - multi channel" scenario and applying interceptor while writing to only one channel and not on others...possible approaches - Flume - [mail # user]
|
|
...Hi We have a use case in which 1. spooling source reads data. 2. It needs to write events into multiple channels. It should apply interceptor only when putting into one channel and sho...
|
|
|
Author: Jagadish Bihani,
2013-04-16, 06:36
|
|
|
Re: In flume-ng is there any advantages of 2-tier topology in a cluster of 30-40 nodes? - Flume - [mail # user]
|
|
...Thanks. So to conclude from our discussion: 1. Flume 2-tier architecture is useful (mainly if number of nodes in a cluster are large.) as it wont stress out the netwo...
|
|
|
Author: Jagadish Bihani,
2013-02-01, 13:27
|
|
|
Re: In flume-ng is there any advantages of 2-tier topology in a cluster of 30-40 nodes? - Flume - [mail # user]
|
|
...Hi Does someone have any inputs on this? Just to summarize the questions again.... to use only 1 tier architecture in flume? environment? Regards, Jagadish On 0...
|
|
|
Author: Jagadish Bihani,
2013-02-01, 11:08
|
|
|
Re: In flume-ng is there any advantages of 2-tier topology in a cluster of 30-40 nodes? - Flume - [mail # user]
|
|
...Hi Thanks Alexander for the reply. I have added my thoughts in line. On 01/30/2013 11:56 AM, Alexander Alten-Lorenz wrote: sense to write directly? Because ultimately purpo...
|
|
|
Author: Jagadish Bihani,
2013-01-30, 14:43
|
|
|
In flume-ng is there any advantages of 2-tier topology in a cluster of 30-40 nodes? - Flume - [mail # user]
|
|
...Hi In our scenario there are around 30 machines from which we want to put data into HDFS. Now the approach we thought of initially was: 1. First tier : Agent wh...
|
|
|
Author: Jagadish Bihani,
2013-01-30, 06:05
|
|
|
about SpoolingFileLineReader changes - Flume - [mail # dev]
|
|
...Hi I want to write the external RPC client which reads files from a directory. SpolingDirectory source can serve my purpose. But I am writing this to reach close to "exactly once deliv...
|
|
|
Author: Jagadish Bihani,
2013-01-02, 06:49
|
|
|
Efficient way of handling of duplicates/Deduplication strategy - Flume - [mail # user]
|
|
...Hi I was thinking of 2 possible approaches for this : Approach 1. Deduplication at destination- Using spooling dir source -file channel - hdfs sink combination: =====...
|
|
|
Author: Jagadish Bihani,
2012-12-24, 07:49
|
|
|
Re: Recommendation of parameters for better performance with File Channel - Flume - [mail # user]
|
|
...Hi Thanks for the inputs Hari and Brock. I had tried for batch size 10000; and throughput increased to 1.8 from 1.5 MB/sec. Then I used multiple HDFS sinks which read from ...
|
|
|
Author: Jagadish Bihani,
2012-12-18, 11:05
|
|
|
|