Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Throughput Questions

hsy541@...> 2013-11-01, 00:33
Copy link to this message
Re: Throughput Questions
I suspect this is something in your code as the high-level consumer uses
the simple consumer.
On Thu, Oct 31, 2013 at 5:33 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:

> Hi guys, I have some throughput questions.
> I try to test the throughput using both the High Level Consumer and Simple
> Consumer example from the document.  But I get much lower throughput of
> simple consumer than the high level consumer.
> I run the test in the cluster and I'm sure I distribute the leader broker
> and consumer reads on different machine. So Is there any suggestion for the
> high throughput?
> Another question is if produce rate of producer is much higher than
> consumer, what would happen? All the data would pile up in the broker?
> Thank you!
> Best,
> Siyuan

Jun Rao 2013-11-01, 04:42