Search Hadoop and all its sub project:

Switch to Threaded View
Subject: Blocking Source if Channel is full?

Is it possible to configure Flume to block on reading from the Sink when
the Channel is full?
For example, if the source is a file being tailed, and the sink is HDFS,
and writing to HDFS is not working for whatever reason, then the Channel
will fill up.... right?

Once the Channel is full, what happens with new data that comes from the
file being tailed?  Can it be blocked?  I doubt it, because tailing is done
with exec + tail -F, and I think that can't be blocked.... but who knows!

Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support *

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB