After retrieving a kafka stream or kafka message how to get the corresponding partition number to which it belongs ? I am using kafka version 0.7.2. More specifically kafka.consumer.KafkaStream and kafka.message.MessageAndMetaData classes, does not provide API to retrieve partition number. Are there any other API's to get the partition number ?
Thanks, Hussain ________________________________ NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.
Could you just use a topic for each stage? The nice thing about topics is you don't even have to tell the Kafka cluster about the topics beforehand, so if you a new stage appears, just start writing to that topic.
Kafka is great. :-)
On Thu, Jun 27, 2013 at 7:27 AM, Hussain Pirosha <[EMAIL PROTECTED]> wrote:
Hope creating too many topics does not have any performance impact on the broker. Will it ?
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext