Home | About | Sematext search-lucene.com search-hadoop.com search-devops.com
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Kafka unable to process large number of messages


Copy link to this message
-
Re: Kafka unable to process large number of messages
Hi Jun,

I'm using async java producer. It works fine till the messages are in 100s
of thousands but starts failing for anything above a million. Each message
is around 2kb.

I've tried both with single producer and multiple producers. Rate of this
error is much less in single producer then in case of multiple producers.

Thanks,
Anand
On 29 March 2013 20:24, Jun Rao <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB