Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - speeding up replay log


Copy link to this message
-
speeding up replay log
Edwin Chiu 2013-08-08, 19:48
Hi there!

I'm using flume-ng 1.3.1 (Hortonworks latest production stable version as
of now) on centos 6 with jdk 1.6.

I'm wondering how to speed up the replay of logs after changing file
channel parameters in flume.conf -- capacity and transactionCapacity.

it takes hours for the node to catch up and able to receive and send events
again.

use-fast-replay = true with a ridiculous amount of max memory doesn't speed
things up.

Any recommendations to avoid the down time?

thanks!

Ed