Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 23 (0.046s).
Loading phrases to help you
refine your search...
Re: Problem reading file with spooling directory - Flume - [mail # user]
...I too had the same problem (in flume 1.4). We had checked that the input data is actually  utf-8. When we used input charset as 'unicode' it worked. By "worked" I mean, it didn't give t...
   Author: Jagadish Bihani, 2013-08-08, 06:29
Apache flume 1.4.0 - Spooling directory issue - Flume - [mail # user]
...Hi  I am using spooling directory source with apache flume 1.4.0 and having  the problem that *same configuration works on some machines and doesn't work on some  machines.* &...
   Author: Jagadish Bihani, 2013-07-18, 09:48
HDFS sink data loss possible ? - Flume - [mail # user]
...Hi  Based on our observations on our production setup in flume:  We have seen file roll sink delivering almost 1% events greater than those delivered by HDFS sink per day. (We have...
   Author: Jagadish Bihani, 2013-05-29, 14:12
Re: "single source - multi channel" scenario and applying interceptor while writing to only one channel and not on others...possible approaches - Flume - [mail # user]
...Hi  Thanks Jeff and Connor. That was helpful.  @Connor :  Scenario: ======   We have  a scenario where we receive logs where each record contains  several field...
   Author: Jagadish Bihani, 2013-04-23, 09:02
Re: In flume-ng is there any advantages of 2-tier topology in  a cluster of  30-40 nodes? - Flume - [mail # user]
...Thanks.  So to conclude from our discussion:  1. Flume 2-tier architecture is useful (mainly if number of nodes in a  cluster are large.)  as it wont stress out the netwo...
   Author: Jagadish Bihani, 2013-02-01, 13:27
about SpoolingFileLineReader changes - Flume - [mail # dev]
...Hi  I want to write the external RPC client which reads files from a directory. SpolingDirectory source can serve my purpose. But I am writing this to reach close to "exactly once deliv...
   Author: Jagadish Bihani, 2013-01-02, 06:49
Efficient way of handling of duplicates/Deduplication strategy - Flume - [mail # user]
...Hi  I was thinking of 2 possible approaches for this :  Approach 1.  Deduplication at destination- Using spooling dir source  -file channel - hdfs sink combination: =====...
   Author: Jagadish Bihani, 2012-12-24, 07:49
Re: Recommendation of parameters for better performance with File Channel - Flume - [mail # user]
...Hi  Thanks for the inputs Hari and Brock. I had tried for batch size 10000; and throughput increased to 1.8 from  1.5 MB/sec. Then I  used multiple HDFS sinks which read from ...
   Author: Jagadish Bihani, 2012-12-18, 11:05
Re: Flume bz2 issue while processing by a map reduce job - Flume - [mail # user]
...Hi Mike  Thanks for the valuable inputs. That was driving us crazy. But I had tested that this issue doesn't happen with compression format   lzo/lzop (tested on hadoop 1.0.3). &nb...
   Author: Jagadish Bihani, 2012-11-03, 11:32
Re: Flume compression peculiar behaviour while processing compressed files by a map reduce job - Flume - [mail # user]
...Does anyone have any inputs about why below mentioned behaviour might  have happened?  On 10/26/2012 06:32 PM, Jagadish Bihani wrote:...
   Author: Jagadish Bihani, 2012-10-30, 03:06
Sort:
project
Flume (23)
type
mail # user (22)
mail # dev (1)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (23)
author
Hari Shreedharan (370)
Jonathan Hsieh (365)
Mike Percy (272)
Brock Noland (225)
Disabled imported user (213)
E. Sammer (112)
Will McQueen (91)
Alexander Alten-Lorenz (90)
Roshan Naik (86)
Arvind Prabhakar (79)
Juhani Connolly (54)
Bruce Mitchener (48)
Denny Ye (44)
Israel Ekpo (36)
Jeff Lord (32)
Jagadish Bihani