Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Metrics Reporter not Valid


Copy link to this message
-
Re: Metrics Reporter not Valid
It seems to work for me. Here is what I added to my server.config:
kafka.csv.metrics.reporter.enabled=true
kafka.metrics.reporters=kafka.metrics.KafkaCSVMetricsReporter

It does spit out those warnings that I mentioned - although actually
the reason for that is in fact because we attempt to "verify" the
properties too early - before the server startup is complete. E.g.,
this diff would improve that I think:
https://gist.github.com/anonymous/6688293

Does this work for you?

Thanks,

Joel
On Tue, Sep 24, 2013 at 2:45 AM, Henry Ma <[EMAIL PROTECTED]> wrote:
> I understand that, but seems the property "kafka.metrics.reporters" cannot
> work, even using the default csvreporter.
>
>
> On Tue, Sep 24, 2013 at 1:46 PM, Joel Koshy <[EMAIL PROTECTED]> wrote:
>
>> These warnings are fine - we should think about how to get rid of them. I
>> think the issue is that there's a single bag of properties that is passed
>> to the server and to the metrics reporter. The server instantiation process
>> will will ignore these properties but will warn about properties that it
>> does not know of (since they really are meant to pass through to the
>> ganglia reporter).
>>
>>
>> On Mon, Sep 23, 2013 at 7:47 AM, Henry Ma
>> <[EMAIL PROTECTED]<javascript:;>>
>> wrote:
>> > no, I am using Kafka 0.8.0-beta1.
>> >
>> >
>> > On Mon, Sep 23, 2013 at 10:19 PM, Neha Narkhede <[EMAIL PROTECTED]
>> <javascript:;>
>> >wrote:
>> >
>> >> The metrics reporter was introduced in 0.8. Are you depending on Kafka
>> >> 0.7.x?
>> >>
>> >> Thanks,
>> >> Neha
>> >> On Sep 23, 2013 5:34 AM, "Henry Ma" <[EMAIL PROTECTED]
>> <javascript:;>>
>> wrote:
>> >>
>> >> > hi,
>> >> >
>> >> > In config/server.properties I added some properties for metrics report
>> >> > using ganglia reporter( https://github.com/criteo/kafka-ganglia ):
>> >> >
>> >> > kafka.metrics.reporters=com.criteo.kafka.KafkaGangliaMetricsReporter
>> >> > kafka.ganglia.metrics.reporter.enabled=true
>> >> > kafka.ganglia.metrics.host=localhost
>> >> > kafka.ganglia.metrics.port=2205
>> >> > kafka.ganglia.metrics.group=kafka
>> >> >
>> >> > After rebooting the broker, nothing reported,  and found these message
>> in
>> >> > server.log:
>> >> >
>> >> > [2013-09-23 19:57:19,570] WARN Property kafka.metrics.reporters is not
>> >> > valid (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,570] WARN Property
>> >> > kafka.metrics.polling.interval.secs is not valid
>> >> > (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,571] WARN Property kafka.ganglia.metrics.port is
>> not
>> >> > valid (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,571] WARN Property
>> >> > kafka.ganglia.metrics.reporter.enabled is not valid
>> >> > (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,572] WARN Property kafka.ganglia.metrics.group is
>> >> not
>> >> > valid (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,572] WARN Property kafka.ganglia.metrics.host is
>> not
>> >> > valid (kafka.utils.VerifiableProperties)
>> >> >
>> >> > Atteched is the whole config/server.properties file.
>> >> >
>> >> > Is there something wrong? Thanks for any help!
>> >> >
>> >> > --
>> >> > Best Regards,
>> >> > Henry Ma
>> >> >
>> >>
>> >
>> >
>> >
>> > --
>> > Best Regards,
>>
>
>
>
> --
> Best Regards,

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB