Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Re: a few questions about kafka usage


Copy link to this message
-
Re: a few questions about kafka usage
For #1, yes, a server restart is needed to pick up the new config.

For #2, which version of Kafka are your using?

Thanks,

Jun
On Fri, May 3, 2013 at 1:55 PM, Yu, Libo <[EMAIL PROTECTED]> wrote:

> More detail for question 2:
> For 5 topic case, 20 producers produce to each topic.
> For 10 topic case, 10 producers produce to each topic.
>
> Libo
>
> From: Yu, Libo [ICG-IT]
> Sent: Friday, May 03, 2013 4:48 PM
> To: '[EMAIL PROTECTED]'
> Subject: a few questions about kafka usage
>
> Hi,
>
> Question 1: If I changed server.properties and added or modified the
> following line:
>                           log.flush.intervals.ms.per.topic=topic1:1000,
> topic2:3000
>                       Do I have to restart the server to pick up the
> change?
>
> Question 2: I have three machines with one broker on each of them. 100
> producers are
>                       running on the same three machines. The producers
> will produce 1M
>                       20k-byte messages altogether. The batch size is
> fixed at 100. For 5 topics
>                       each with five partitions, the performance is
> extremely good. For each topic,
>                      30k messages were produced per second . For 10 topics
> with 10 partitions,
>                      the performance is really bad. For each topic, 400
> messages were produced
>                      per second. The gap is so huge. Any insight on what
> may cause the difference?
>
> Regards,
>
> Libo
>
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB