Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Is it possible to check if there are events in a channel?


Copy link to this message
-
Re: Is it possible to check if there are events in a channel?
Thanks, it looks interesting. I'll play around with it a bit and see if I
can get information I need.
On Tue, Aug 27, 2013 at 5:33 PM, Israel Ekpo <[EMAIL PROTECTED]> wrote:

> Andrei,
>
> Check out the monitoring tool here and see if it helps
>
> http://flume.apache.org/FlumeUserGuide.html#monitoring
>
>
> *Author and Instructor for the Upcoming Book and Lecture Series*
> *Massive Log Data Aggregation, Processing, Searching and Visualization
> with Open Source Software*
> *http://massivelogdata.com*
>
>
> On 27 August 2013 06:22, Andrei <[EMAIL PROTECTED]> wrote:
>
>> Hi Juhani,
>>
>> thanks for your answer. Can you please tell me how can I use JMX to get
>> fill percentage? I have very poor knowledge of JMX, but as far as I
>> understand it helps to monitor specific resources used by JVM. So what
>> resource should I monitor to to get fill percentage?
>>
>>
>> On Tue, Aug 27, 2013 at 11:24 AM, Juhani Connolly <
>> [EMAIL PROTECTED]> wrote:
>>
>>> You can get the channel capacity and fill percentage using jmx. You'd
>>> need to regularly poll the fill percentage.
>>>
>>>
>>> On 08/26/2013 08:41 PM, Andrei wrote:
>>>
>>>> Are there any tools to monitor state of a Flume channel and,
>>>> specifically, determine the moment when there are no more events?
>>>>
>>>> To give you some context: I have a batch of events that I want to pass
>>>> through Flume and eventually get to HDFS via corresponding sink. When all
>>>> events of the batch are dumped, I want to perform post-processing routine
>>>> on the entire batch. My assumption is that if channel is empty for a while,
>>>> all events of the batch are dumped and I can start the routing. But how can
>>>> I determine if channel is empty?
>>>>
>>>
>>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB