Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 10 (0.074s).
Loading phrases to help you
refine your search...
Issues around HDFS and File Channels - Flume - [mail # dev]
...My team has been battling severe problems with our Flume clusters on EC2over the last several weeks - I wanted to share some of the pains we arehaving and see if there are any configuration/...
   Author: Gary Malouf, 2014-08-21, 00:12
[expand - 4 more] - Re: FileChannel Replays consistently take a long time - Flume - [mail # user]
...Hi Hari,I wanted to provide more details on the issues we are seeing as there maybe better actions we can take.As mentioned earlier, we are on the Flume 1.4 release that is packaged withthe ...
   Author: Gary Malouf, 2014-08-20, 18:59
Fwd: FileChannel Replays consistently take a long time - Flume - [mail # user]
...We run on ssd ephemeral storage.You can see from the timestamps below how long the replay ended up taking a20 Aug 2014 04:05:20,520 INFO  [lifecycleSupervisor-1-1](org.apache.flume.chan...
   Author: Gary Malouf, 2014-08-20, 04:51
Necessity of using failover sinks - Flume - [mail # user]
...I have a tough time seeing why one would need a failover sink where bothwrite to the same HDFS cluster.  Can one describe to me why this is a goodidea? ...
   Author: Gary Malouf, 2014-08-14, 16:12
[expand - 1 more] - Re: Flume log rolling when you need to do rollups for multiple time zones - Flume - [mail # user]
...Hi Hari,Below is the config for one of our source-channel-sink combos.  Inhadoop/spark world, how do you then handle the events that arrive late tothe bucket?  That is, events for ...
   Author: Gary Malouf, 2014-07-29, 16:02
Strange Http Monitoring Results - Flume - [mail # user]
...In our test environment, we have a few flume 1.4 instances running.  We areseeing the following when using the Http Json Monitoring:1) Despite having multiple, distinct source-channel-s...
   Author: Gary Malouf, 2014-07-07, 22:21
[expand - 1 more] - Re: Embedded Agent vs Client SDK - Flume - [mail # user]
...Google searching and the wiki did not pick that up, thanks for the help!  Ithink it would be good to have these use cases directly on Flume's website.On Thu, Feb 13, 2014 at 11:33 PM, J...
   Author: Gary Malouf, 2014-02-14, 04:59
[expand - 1 more] - Re: Flume-ng 1.3.x HDFSSink - override Hadoop default size for only one of my sinks - Flume - [mail # user]
...If it is not clear, I meant to type default block size.   On Fri, May 17, 2013 at 7:46 PM, Gary Malouf  wrote:  ...
   Author: Gary Malouf, 2013-05-17, 23:48
[expand - 2 more] - Re: What does HDFSSink batch size actually effect? - Flume - [mail # user]
...Okay, so the display of there being 0 bytes in the file is a misnomer in all likelihood.  This is a bit unfortunate as for our use case we then need to wait an hour to find out how much...
   Author: Gary Malouf, 2013-05-15, 14:50
[expand - 3 more] - Re: Writing to HDFS from multiple HDFS agents (separate machines) - Flume - [mail # user]
...Thanks for the pointer Mike.  Any thoughts on how you choose how many consumers per channel?  I will eventually find the optimal number via perf testing, but it would be good to st...
   Author: Gary Malouf, 2013-03-15, 02:42
Spark (15)
Flume (10)
Zookeeper (1)
mail # user (9)
mail # dev (1)
last 7 days (4)
last 30 days (5)
last 90 days (6)
last 6 months (6)
last 9 months (10)
Hari Shreedharan (395)
Jonathan Hsieh (365)
Mike Percy (278)
Brock Noland (228)
Disabled imported user (213)
E. Sammer (112)
Roshan Naik (99)
Will McQueen (91)
Alexander Alten-Lorenz (90)
Arvind Prabhakar (82)
Juhani Connolly (54)
Bruce Mitchener (48)
Denny Ye (44)
Jeff Lord (37)
Israel Ekpo (36)
Mubarak Seyed (32)
Ashish Paliwal (31)
Jarek Jarcec Cecho (30)
Ashish (27)
Prasad Mujumdar (25)
Nicholas Verbeck (20)
Edward Sargisson (19)
Patrick Hunt (19)
Patrick Wendell (19)
Dani Abel Rayan (17)
Gary Malouf