Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Is it possible to check if there are events in a channel?


Copy link to this message
-
Is it possible to check if there are events in a channel?
Are there any tools to monitor state of a Flume channel and, specifically,
determine the moment when there are no more events?

To give you some context: I have a batch of events that I want to pass
through Flume and eventually get to HDFS via corresponding sink. When all
events of the batch are dumped, I want to perform post-processing routine
on the entire batch. My assumption is that if channel is empty for a while,
all events of the batch are dumped and I can start the routing. But how can
I determine if channel is empty?
+
Juhani Connolly 2013-08-27, 08:24
+
Andrei 2013-08-27, 10:22
+
Israel Ekpo 2013-08-27, 14:33
+
Andrei 2013-08-27, 14:42
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB