Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # dev >> [jira] [Updated] (KAFKA-959) DefaultEventHandler can send more produce requests than necesary


+
Guozhang Wang 2013-07-10, 20:53
Copy link to this message
-
[jira] [Updated] (KAFKA-959) DefaultEventHandler can send more produce requests than necesary

     [ https://issues.apache.org/jira/browse/KAFKA-959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Guozhang Wang updated KAFKA-959:
--------------------------------

    Status: Patch Available  (was: Open)
    
> DefaultEventHandler can send more produce requests than necesary
> ----------------------------------------------------------------
>
>                 Key: KAFKA-959
>                 URL: https://issues.apache.org/jira/browse/KAFKA-959
>             Project: Kafka
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 0.8
>            Reporter: Jun Rao
>            Assignee: Guozhang Wang
>         Attachments: KAFKA-959.v1.patch
>
>
> In DefaultEventHandler, for a batch of messages, it picks a random partition per message (when there is no key specified). This means that it can send up to P produce requests where P is the number of partitions in a topic. A better way is probably to pick a single random partition for the whole batch of messages. This will reduce the number of produce requests.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

 
+
Jun Rao 2013-07-25, 17:09