Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> speeding up replay log

Copy link to this message
speeding up replay log
Hi there!

I'm using flume-ng 1.3.1 (Hortonworks latest production stable version as
of now) on centos 6 with jdk 1.6.

I'm wondering how to speed up the replay of logs after changing file
channel parameters in flume.conf -- capacity and transactionCapacity.

it takes hours for the node to catch up and able to receive and send events

use-fast-replay = true with a ridiculous amount of max memory doesn't speed
things up.

Any recommendations to avoid the down time?