Hi guys,

How do you monitor a topic, and alert if it has no messages for some time?

I would like to monitor a topic , and  report   to Nagios so I could get
an alert when something is wrong.
What do you think?

You can potentially build alerting using our tool ConsumerOffsetChecker.
See http://incubator.apache.org/kafka/faq.html on how to use the tool.

Thanks,

Jun

On Tue, Jul 10, 2012 at 8:21 AM, Guy Doulberg <[EMAIL PROTECTED]>wrote:

> Hi guys,
>
> How do you monitor a topic, and alert if it has no messages for some time?
>
> I would like to monitor a topic , and  report   to Nagios so I could get
> an alert when something is wrong.
>
>
> What do you think?
>
>
>

I will do so,
After I will do so, I will publish this code for anyone use
On 07/10/2012 06:36 PM, Jun Rao wrote:
> You can potentially build alerting using our tool ConsumerOffsetChecker.
> See http://incubator.apache.org/kafka/faq.html on how to use the tool.
>
> Thanks,
>
> Jun
>
> On Tue, Jul 10, 2012 at 8:21 AM, Guy Doulberg <[EMAIL PROTECTED]>wrote:
>
>> Hi guys,
>>
>> How do you monitor a topic, and alert if it has no messages for some time?
>>
>> I would like to monitor a topic , and  report   to Nagios so I could get
>> an alert when something is wrong.
>>
>>
>> What do you think?
>>
>>
>>

Hi guys,
I built a tool in my kafka tools repository that gets a topic a zookeepr
and file, and checks for each topic/partition if the topic is "DRY".

It basically writes to the file the current offsets in each broker, if
the combination of the (topic,broker,partition) existed in the file
prior to the run, it will compare the current offset of the
(topic,broker,partition) with the in the file (previous), if it didn't
got larger it will return the status stuck for this
(topic,broker,partition), otherwise (1. there was no file 2. the
(topic,broker,partition) was not reported 3. the value of the previous
(topic,broker,partition) is lesser than the current) it returns the
status OK

This output can be processed by a monitoring tool such as Nagios,

Thanks

On 07/11/2012 09:21 AM, Guy Doulberg wrote:
> I will do so,
> After I will do so, I will publish this code for anyone use
>
>
> On 07/10/2012 06:36 PM, Jun Rao wrote:
>> You can potentially build alerting using our tool ConsumerOffsetChecker.
>> See http://incubator.apache.org/kafka/faq.html on how to use the tool.
>>
>> Thanks,
>>
>> Jun
>>
>> On Tue, Jul 10, 2012 at 8:21 AM, Guy Doulberg <[EMAIL PROTECTED]>wrote:
>>
>>> Hi guys,
>>>
>>> How do you monitor a topic, and alert if it has no messages for some time?
>>>
>>> I would like to monitor a topic , and  report   to Nagios so I could get
>>> an alert when something is wrong.
>>>
>>>
>>> What do you think?
>>>
>>>
>>>
>