Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Throughput Questions


Copy link to this message
-
Re: Throughput Questions
Kafka has a retention policy. Messages will to automatically deleted after
a certain period of time.

Thanks,

Jun
On Thu, Oct 31, 2013 at 5:33 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:

> Hi guys, I have some throughput questions.
>
> I try to test the throughput using both the High Level Consumer and Simple
> Consumer example from the document.  But I get much lower throughput of
> simple consumer than the high level consumer.
> I run the test in the cluster and I'm sure I distribute the leader broker
> and consumer reads on different machine. So Is there any suggestion for the
> high throughput?
>
> Another question is if produce rate of producer is much higher than
> consumer, what would happen? All the data would pile up in the broker?
>
> Thank you!
>
> Best,
> Siyuan
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB