| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
36 (0.09s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: ExecSource->MemoryChannel->AvroSink->AvroSource->FileChannel->HDFSSink throughput question - Flume - [mail # user]
|
|
...Perfect. Again, thank you so much for your time. :) The timeout increase bought be some time, but it still ended up with the Exception. I love the multiple sinks idea...I should have t...
|
|
|
Author: Chris Neal,
2013-02-05, 15:57
|
|
|
Re: ExecSource->MemoryChannel->AvroSink->AvroSource->FileChannel->HDFSSink throughput question - Flume - [mail # user]
|
|
...Thanks for the help Juhani :) I'll take a look with Ganglia and see what things look like. Any thoughts on keeping the ExecSource.batchSize, MemoryChannel.transactionCapacity, Av...
|
|
|
Author: Chris Neal,
2013-02-01, 16:40
|
|
|
ExecSource->MemoryChannel->AvroSink->AvroSource->FileChannel->HDFSSink throughput question - Flume - [mail # user]
|
|
...Hi all. I need some thoughts on sizing/tuning of the above (common) route in FlumeNG to maximize throughput. Here is my setup: *Source JVM (ExecSource/MemoryChannel/AvroSin...
|
|
|
Author: Chris Neal,
2013-01-31, 17:01
|
|
|
Re: HDFS sink leaves .tmp files - Flume - [mail # user]
|
|
...Just to follow up, the .tmp file problem did go away using 1.3.0-SNAPSHOT on the HDFS sink agent. Thanks again Kathleen :) On Mon, Sep 10, 2012 at 8:38 PM, Chris Neal wrote...
|
|
|
Author: Chris Neal,
2012-09-13, 14:38
|
|
|
Re: data saved in hdfs by flume ng is garbled - Flume - [mail # user]
|
|
...Hi, The log4J appender doesn't pay any attention to the PatternLayout, at least up through 1.3.0-SNAPSHOT. That's why you only see %m and nothing else. As for the garbled t...
|
|
|
Author: Chris Neal,
2012-09-12, 14:27
|
|
|
Re: HDFS sink leaves .tmp files - Flume - [mail # user]
|
|
...Thanks Kathleen! I'll download that build tomorrow morning and give it a whirl. Chris On Mon, Sep 10, 2012 at 5:09 PM, Kathleen Ting wrote: ...
|
|
|
Author: Chris Neal,
2012-09-11, 01:38
|
|
|
Re: HDFS sink leaves .tmp files - Flume - [mail # user]
|
|
...Just checked, and from Cloudera, 1.1.0+121-1.cdh4.0.1.p0.1.el6 is still the latest from their yum repo. On Mon, Sep 10, 2012 at 1:59 PM, Chris Neal wrote: ...
|
|
|
Author: Chris Neal,
2012-09-10, 19:01
|
|
|
Re: HDFS sink leaves .tmp files - Flume - [mail # user]
|
|
...I'm using a combination :) The application tier is 1.3.0-SNAPSHOT The HDFS tier is CentOS, and I grabbed the latest (at the time) from the CDH repo. It's version is: 1.1.0+...
|
|
|
Author: Chris Neal,
2012-09-10, 18:59
|
|
|
Re: HDFS sink leaves .tmp files - Flume - [mail # user]
|
|
...Glad to know it's not just me :) On Mon, Sep 10, 2012 at 10:16 AM, Eran Kutner wrote: ...
|
|
|
Author: Chris Neal,
2012-09-10, 15:21
|
|
|
Re: HDFS sink leaves .tmp files - Flume - [mail # user]
|
|
...I'm still seeing this consistently every 24 hour period. Does this sound like a configuration issue, an issue with the Exec source, or an issue with the HDFS sink? Thanks! ...
|
|
|
Author: Chris Neal,
2012-09-10, 15:02
|
|
|
|
