Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Throughput Questions


Copy link to this message
-
Re: Throughput Questions
I suspect this is something in your code as the high-level consumer uses
the simple consumer.
On Thu, Oct 31, 2013 at 5:33 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:

> Hi guys, I have some throughput questions.
>
> I try to test the throughput using both the High Level Consumer and Simple
> Consumer example from the document.  But I get much lower throughput of
> simple consumer than the high level consumer.
> I run the test in the cluster and I'm sure I distribute the leader broker
> and consumer reads on different machine. So Is there any suggestion for the
> high throughput?
>
> Another question is if produce rate of producer is much higher than
> consumer, what would happen? All the data would pile up in the broker?
>
> Thank you!
>
> Best,
> Siyuan
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB