| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
36 (0.091s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Max events per RPC call from across sink to Avro source - Flume - [mail # user]
|
|
...I believe that comment is indicating the default value, not the max. Perhaps your config is not correct? On Tue, Apr 16, 2013 at 4:16 PM, Madhu Gmail wrote: ...
|
|
|
Author: Chris Neal,
2013-04-16, 21:45
|
|
|
Re: flume.EventDeliveryException: Failed to send events - Flume - [mail # user]
|
|
...Yeah, I can script something up. Maybe increasing the timeouts was all it needed and you'll never see another reply to this thread... ;) But, if not, I'll post the thread dump ne...
|
|
|
Author: Chris Neal,
2013-04-16, 20:05
|
|
|
Re: flume.EventDeliveryException: Failed to send events - Flume - [mail # user]
|
|
...Thanks for all the input guys. :) @Hari: The FileChannel at the AvroSource is on a SAN disk, so I don't think it is the bottleneck in my case. It is the same disk for both checkp...
|
|
|
Author: Chris Neal,
2013-04-16, 19:49
|
|
|
Re: flume.EventDeliveryException: Failed to send events - Flume - [mail # user]
|
|
...Thanks Hari. I increased both the connect and request timeouts to 40000ms, and I'm testing that now. I am talking on a LAN though, which is part of the reason I'm concerned. &nbs...
|
|
|
Author: Chris Neal,
2013-04-16, 19:07
|
|
|
Re: flume.EventDeliveryException: Failed to send events - Flume - [mail # user]
|
|
...I'm seeing the same thing :) Mine is all on a local LAN though, so the fact that an RPC call doesn't reply in 10000ms or 20000ms is quite odd. My configuration is for the most pa...
|
|
|
Author: Chris Neal,
2013-04-16, 18:38
|
|
|
Simple HDFS Sink file rolling question please. - Flume - [mail # user]
|
|
...Hi :) I have an ExecSource running a tail -F on a bunch of log files that get rotated nightly by log4J. I want my HDFS Sink to roll them when log4J rolls them. I tried sett...
|
|
|
Author: Chris Neal,
2013-03-21, 20:21
|
|
|
Re: Best way to increase throughput of Exec->Memory->Avro agent. - Flume - [mail # user]
|
|
...So, in a 4 channel setup, would I bind each of the 124 sources to all of the 4 channels, or divide them up and put 31 sources on each individual channel? :) On Tue, Mar 12, 2013 at 4:...
|
|
|
Author: Chris Neal,
2013-03-12, 21:55
|
|
|
Re: Best way to increase throughput of Exec->Memory->Avro agent. - Flume - [mail # user]
|
|
...Beautiful. Will try 4 channels in one Agent first. Thanks! On Tue, Mar 12, 2013 at 4:35 PM, Roshan Naik wrote: ...
|
|
|
Author: Chris Neal,
2013-03-12, 21:40
|
|
|
Re: Best way to increase throughput of Exec->Memory->Avro agent. - Flume - [mail # user]
|
|
...Thanks for the reply. You're definitely on to something with the ever-increasing number of sinks. :) I scaled it back to 16 AvroSinks, and used a MemoryChannel.transactionC...
|
|
|
Author: Chris Neal,
2013-03-12, 21:24
|
|
|
Best way to increase throughput of Exec->Memory->Avro agent. - Flume - [mail # user]
|
|
...Hi all. I've been working on this for quite some time, and need some advice from the experts. I have a two tiered Flume architecture: App Tier (all on one server): 12...
|
|
|
Author: Chris Neal,
2013-03-12, 20:43
|
|
|
|
