Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 23 (0.083s).
Loading phrases to help you
refine your search...
Re: Problem reading file with spooling directory - Flume - [mail # user]
...I too had the same problem (in flume 1.4). We had checked that the input data is actually  utf-8. When we used input charset as 'unicode' it worked. By "worked" I mean, it didn't give t...
   Author: Jagadish Bihani, 2013-08-08, 06:29
Apache flume 1.4.0 - Spooling directory issue - Flume - [mail # user]
...Hi  I am using spooling directory source with apache flume 1.4.0 and having  the problem that *same configuration works on some machines and doesn't work on some  machines.* &...
   Author: Jagadish Bihani, 2013-07-18, 09:48
HDFS sink data loss possible ? - Flume - [mail # user]
...Hi  Based on our observations on our production setup in flume:  We have seen file roll sink delivering almost 1% events greater than those delivered by HDFS sink per day. (We have...
   Author: Jagadish Bihani, 2013-05-29, 14:12
[expand - 2 more] - Re: "single source - multi channel" scenario and applying interceptor while writing to only one channel and not on others...possible approaches - Flume - [mail # user]
...Hi  Thanks Jeff and Connor. That was helpful.  @Connor :  Scenario: ======   We have  a scenario where we receive logs where each record contains  several field...
   Author: Jagadish Bihani, 2013-04-23, 09:02
[expand - 3 more] - Re: In flume-ng is there any advantages of 2-tier topology in  a cluster of  30-40 nodes? - Flume - [mail # user]
...Thanks.  So to conclude from our discussion:  1. Flume 2-tier architecture is useful (mainly if number of nodes in a  cluster are large.)  as it wont stress out the netwo...
   Author: Jagadish Bihani, 2013-02-01, 13:27
about SpoolingFileLineReader changes - Flume - [mail # dev]
...Hi  I want to write the external RPC client which reads files from a directory. SpolingDirectory source can serve my purpose. But I am writing this to reach close to "exactly once deliv...
   Author: Jagadish Bihani, 2013-01-02, 06:49
Efficient way of handling of duplicates/Deduplication strategy - Flume - [mail # user]
...Hi  I was thinking of 2 possible approaches for this :  Approach 1.  Deduplication at destination- Using spooling dir source  -file channel - hdfs sink combination: =====...
   Author: Jagadish Bihani, 2012-12-24, 07:49
[expand - 2 more] - Re: Recommendation of parameters for better performance with File Channel - Flume - [mail # user]
...Hi  Thanks for the inputs Hari and Brock. I had tried for batch size 10000; and throughput increased to 1.8 from  1.5 MB/sec. Then I  used multiple HDFS sinks which read from ...
   Author: Jagadish Bihani, 2012-12-18, 11:05
[expand - 4 more] - Re: Flume bz2 issue while processing by a map reduce job - Flume - [mail # user]
...Hi Mike  Thanks for the valuable inputs. That was driving us crazy. But I had tested that this issue doesn't happen with compression format   lzo/lzop (tested on hadoop 1.0.3). &nb...
   Author: Jagadish Bihani, 2012-11-03, 11:32
Re: Flume compression peculiar behaviour while processing compressed files by a map reduce job - Flume - [mail # user]
...Does anyone have any inputs about why below mentioned behaviour might  have happened?  On 10/26/2012 06:32 PM, Jagadish Bihani wrote:...
   Author: Jagadish Bihani, 2012-10-30, 03:06
Flume (23)
Kafka (1)
mail # user (22)
mail # dev (1)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (23)
Jonathan Hsieh (365)
Hari Shreedharan (331)
Disabled imported user (213)
Mike Percy (204)
Brock Noland (164)
E. Sammer (112)
Roshan Naik (99)
Will McQueen (87)
Arvind Prabhakar (83)
Alexander Alten-Lorenz (61)
Bruce Mitchener (48)
Juhani Connolly (47)
Denny Ye (44)
Jeff Lord (38)
Ashish (36)
Israel Ekpo (31)
Mubarak Seyed (30)
Jarek Jarcec Cecho (29)
Prasad Mujumdar (25)
Nicholas Verbeck (20)
Otis Gospodnetic (19)
Patrick Hunt (19)
Patrick Wendell (19)
Dani Abel Rayan (17)
Wolfgang Hoschek (17)
Jagadish Bihani