Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 24 (0.255s).
Loading phrases to help you
refine your search...
About peculiar scenario in kafka camus consumer - Kafka - [mail # user]
...HiI have observed a peculiar scenario in production environment in which a mapper task for a particular topic-partition combination always fails with the exception  'Task attempt failed...
   Author: Jagadish Bihani, 2014-06-07, 14:56
Re: Problem reading file with spooling directory - Flume - [mail # user]
...I too had the same problem (in flume 1.4). We had checked that the input data is actually  utf-8. When we used input charset as 'unicode' it worked. By "worked" I mean, it didn't give t...
   Author: Jagadish Bihani, 2013-08-08, 06:29
Apache flume 1.4.0 - Spooling directory issue - Flume - [mail # user]
...Hi  I am using spooling directory source with apache flume 1.4.0 and having  the problem that *same configuration works on some machines and doesn't work on some  machines.* &...
   Author: Jagadish Bihani, 2013-07-18, 09:48
HDFS sink data loss possible ? - Flume - [mail # user]
...Hi  Based on our observations on our production setup in flume:  We have seen file roll sink delivering almost 1% events greater than those delivered by HDFS sink per day. (We have...
   Author: Jagadish Bihani, 2013-05-29, 14:12
[expand - 2 more] - Re: "single source - multi channel" scenario and applying interceptor while writing to only one channel and not on others...possible approaches - Flume - [mail # user]
...Hi  Thanks Jeff and Connor. That was helpful.  @Connor :  Scenario: ======   We have  a scenario where we receive logs where each record contains  several field...
   Author: Jagadish Bihani, 2013-04-23, 09:02
[expand - 3 more] - Re: In flume-ng is there any advantages of 2-tier topology in  a cluster of  30-40 nodes? - Flume - [mail # user]
...Thanks.  So to conclude from our discussion:  1. Flume 2-tier architecture is useful (mainly if number of nodes in a  cluster are large.)  as it wont stress out the netwo...
   Author: Jagadish Bihani, 2013-02-01, 13:27
about SpoolingFileLineReader changes - Flume - [mail # dev]
...Hi  I want to write the external RPC client which reads files from a directory. SpolingDirectory source can serve my purpose. But I am writing this to reach close to "exactly once deliv...
   Author: Jagadish Bihani, 2013-01-02, 06:49
Efficient way of handling of duplicates/Deduplication strategy - Flume - [mail # user]
...Hi  I was thinking of 2 possible approaches for this :  Approach 1.  Deduplication at destination- Using spooling dir source  -file channel - hdfs sink combination: =====...
   Author: Jagadish Bihani, 2012-12-24, 07:49
[expand - 2 more] - Re: Recommendation of parameters for better performance with File Channel - Flume - [mail # user]
...Hi  Thanks for the inputs Hari and Brock. I had tried for batch size 10000; and throughput increased to 1.8 from  1.5 MB/sec. Then I  used multiple HDFS sinks which read from ...
   Author: Jagadish Bihani, 2012-12-18, 11:05
[expand - 4 more] - Re: Flume bz2 issue while processing by a map reduce job - Flume - [mail # user]
...Hi Mike  Thanks for the valuable inputs. That was driving us crazy. But I had tested that this issue doesn't happen with compression format   lzo/lzop (tested on hadoop 1.0.3). &nb...
   Author: Jagadish Bihani, 2012-11-03, 11:32
Flume (23)
Kafka (1)
mail # user (23)
mail # dev (1)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (1)
last 9 months (24)
Ted Yu (1699)
Harsh J (1296)
Todd Lipcon (994)
Stack (978)
Jun Rao (969)
Jonathan Ellis (844)
Andrew Purtell (816)
Jean-Daniel Cryans (753)
Yusaku Sako (718)
stack (714)
Jarek Jarcec Cecho (703)
Eric Newton (688)
Jonathan Hsieh (673)
Roman Shaposhnik (662)
Namit Jain (649)
Hitesh Shah (627)
Owen O'Malley (625)
Steve Loughran (624)
Siddharth Seth (614)
Josh Elser (557)
Brock Noland (549)
Eli Collins (545)
Neha Narkhede (544)
Arun C Murthy (543)
Doug Cutting (533)
Jagadish Bihani