Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Is it possible to check if there are events in a channel?


Copy link to this message
-
Re: Is it possible to check if there are events in a channel?
You can get the channel capacity and fill percentage using jmx. You'd
need to regularly poll the fill percentage.

On 08/26/2013 08:41 PM, Andrei wrote:
> Are there any tools to monitor state of a Flume channel and,
> specifically, determine the moment when there are no more events?
>
> To give you some context: I have a batch of events that I want to pass
> through Flume and eventually get to HDFS via corresponding sink. When
> all events of the batch are dumped, I want to perform post-processing
> routine on the entire batch. My assumption is that if channel is empty
> for a while, all events of the batch are dumped and I can start the
> routing. But how can I determine if channel is empty?
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB