Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # dev >> [jira] [Commented] (KAFKA-671) DelayedProduce requests should not hold full producer request data


+
Jay Kreps 2012-12-22, 01:02
Copy link to this message
-
[jira] [Commented] (KAFKA-671) DelayedProduce requests should not hold full producer request data

    [ https://issues.apache.org/jira/browse/KAFKA-671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13554178#comment-13554178 ]

Sriram Subramanian commented on KAFKA-671:
------------------------------------------

2. I am not sure if it is an issue in the first place. Depends on how long these objects stay in the queue. If 5000 outstanding requests can be reached as suggested by Jay above then it does seem like an issue. Let me know what you find in your GC investigation. I agree it is ugly. Another option is to totally remove the request object dependency from DelayedItems but that would be a larger change.
                
> DelayedProduce requests should not hold full producer request data
> ------------------------------------------------------------------
>
>                 Key: KAFKA-671
>                 URL: https://issues.apache.org/jira/browse/KAFKA-671
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 0.8
>            Reporter: Joel Koshy
>            Assignee: Sriram Subramanian
>            Priority: Blocker
>             Fix For: 0.8.1
>
>         Attachments: outOfMemFix-v1.patch
>
>
> Per summary, this leads to unnecessary memory usage.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

 
+
Neha Narkhede 2013-01-21, 18:34
+
Jay Kreps 2013-01-30, 07:07
+
Sriram Subramanian 2013-01-31, 18:49
+
Jay Kreps 2013-02-05, 14:53
+
Jun Rao 2013-02-23, 19:48
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB