Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - Metrics Reporter not Valid


+
Henry Ma 2013-09-23, 12:34
+
Henry Ma 2013-09-24, 02:27
+
Neha Narkhede 2013-09-23, 14:20
+
Henry Ma 2013-09-23, 14:49
+
Joel Koshy 2013-09-24, 05:47
+
Henry Ma 2013-09-24, 10:09
Copy link to this message
-
Re: Metrics Reporter not Valid
Joel Koshy 2013-09-24, 17:31
It seems to work for me. Here is what I added to my server.config:
kafka.csv.metrics.reporter.enabled=true
kafka.metrics.reporters=kafka.metrics.KafkaCSVMetricsReporter

It does spit out those warnings that I mentioned - although actually
the reason for that is in fact because we attempt to "verify" the
properties too early - before the server startup is complete. E.g.,
this diff would improve that I think:
https://gist.github.com/anonymous/6688293

Does this work for you?

Thanks,

Joel
On Tue, Sep 24, 2013 at 2:45 AM, Henry Ma <[EMAIL PROTECTED]> wrote:
> I understand that, but seems the property "kafka.metrics.reporters" cannot
> work, even using the default csvreporter.
>
>
> On Tue, Sep 24, 2013 at 1:46 PM, Joel Koshy <[EMAIL PROTECTED]> wrote:
>
>> These warnings are fine - we should think about how to get rid of them. I
>> think the issue is that there's a single bag of properties that is passed
>> to the server and to the metrics reporter. The server instantiation process
>> will will ignore these properties but will warn about properties that it
>> does not know of (since they really are meant to pass through to the
>> ganglia reporter).
>>
>>
>> On Mon, Sep 23, 2013 at 7:47 AM, Henry Ma
>> <[EMAIL PROTECTED]<javascript:;>>
>> wrote:
>> > no, I am using Kafka 0.8.0-beta1.
>> >
>> >
>> > On Mon, Sep 23, 2013 at 10:19 PM, Neha Narkhede <[EMAIL PROTECTED]
>> <javascript:;>
>> >wrote:
>> >
>> >> The metrics reporter was introduced in 0.8. Are you depending on Kafka
>> >> 0.7.x?
>> >>
>> >> Thanks,
>> >> Neha
>> >> On Sep 23, 2013 5:34 AM, "Henry Ma" <[EMAIL PROTECTED]
>> <javascript:;>>
>> wrote:
>> >>
>> >> > hi,
>> >> >
>> >> > In config/server.properties I added some properties for metrics report
>> >> > using ganglia reporter( https://github.com/criteo/kafka-ganglia ):
>> >> >
>> >> > kafka.metrics.reporters=com.criteo.kafka.KafkaGangliaMetricsReporter
>> >> > kafka.ganglia.metrics.reporter.enabled=true
>> >> > kafka.ganglia.metrics.host=localhost
>> >> > kafka.ganglia.metrics.port=2205
>> >> > kafka.ganglia.metrics.group=kafka
>> >> >
>> >> > After rebooting the broker, nothing reported,  and found these message
>> in
>> >> > server.log:
>> >> >
>> >> > [2013-09-23 19:57:19,570] WARN Property kafka.metrics.reporters is not
>> >> > valid (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,570] WARN Property
>> >> > kafka.metrics.polling.interval.secs is not valid
>> >> > (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,571] WARN Property kafka.ganglia.metrics.port is
>> not
>> >> > valid (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,571] WARN Property
>> >> > kafka.ganglia.metrics.reporter.enabled is not valid
>> >> > (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,572] WARN Property kafka.ganglia.metrics.group is
>> >> not
>> >> > valid (kafka.utils.VerifiableProperties)
>> >> > [2013-09-23 19:57:19,572] WARN Property kafka.ganglia.metrics.host is
>> not
>> >> > valid (kafka.utils.VerifiableProperties)
>> >> >
>> >> > Atteched is the whole config/server.properties file.
>> >> >
>> >> > Is there something wrong? Thanks for any help!
>> >> >
>> >> > --
>> >> > Best Regards,
>> >> > Henry Ma
>> >> >
>> >>
>> >
>> >
>> >
>> > --
>> > Best Regards,
>>
>
>
>
> --
> Best Regards,