Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> consuming only half the messages produced


Copy link to this message
-
Re: consuming only half the messages produced
In this case, you have a replication factor of 1. So, each partition has
only 1 replica.

There are two possibilities: (1) The producer didn't send all messages. (2)
The producer successfully sent all messages, but the consumer didn't
receive all messages. Could you first check the producer log and make sure
there are no errors? If so, check the consumer log. You should see sth like
"Consumer ???? selected partitions : ". See if all partitions are selected.
Also, check if there is any error in the consumer log.

To understand leader and isr, you can read the replication design in
http://kafka.apache.org/08/design.html

Thanks,

Jun
On Thu, May 2, 2013 at 6:32 AM, Rob Withers <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB