Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Throughput Questions


Copy link to this message
-
Re: Throughput Questions
Jun Rao 2013-11-01, 04:42
Kafka has a retention policy. Messages will to automatically deleted after
a certain period of time.

Thanks,

Jun
On Thu, Oct 31, 2013 at 5:33 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:

> Hi guys, I have some throughput questions.
>
> I try to test the throughput using both the High Level Consumer and Simple
> Consumer example from the document.  But I get much lower throughput of
> simple consumer than the high level consumer.
> I run the test in the cluster and I'm sure I distribute the leader broker
> and consumer reads on different machine. So Is there any suggestion for the
> high throughput?
>
> Another question is if produce rate of producer is much higher than
> consumer, what would happen? All the data would pile up in the broker?
>
> Thank you!
>
> Best,
> Siyuan
>