Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # dev >> [jira] [Updated] (KAFKA-918) Change log.retention.hours to be log.retention.mins


+
Alin Vasile 2013-10-23, 22:40
+
Jun Rao 2013-10-25, 15:13
Copy link to this message
-
[jira] [Updated] (KAFKA-918) Change log.retention.hours to be log.retention.mins

     [ https://issues.apache.org/jira/browse/KAFKA-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alin Vasile updated KAFKA-918:
------------------------------

    Attachment: issue_918.patch

New patch attached, unused imports are removed from KafkaConfigTest

> Change log.retention.hours to be log.retention.mins
> ---------------------------------------------------
>
>                 Key: KAFKA-918
>                 URL: https://issues.apache.org/jira/browse/KAFKA-918
>             Project: Kafka
>          Issue Type: New Feature
>          Components: config
>    Affects Versions: 0.7.2
>            Reporter: Jason Weiss
>              Labels: features, newbie
>         Attachments: issue_918.patch
>
>
> We stood up a cluster that is processing over 350,000 events per second, with each event a fixed payload size of 2K. The storage required to process that much data over an hour is beyond what we wanted to pay for at AWS. Additionally, we don't have a requirement to keep the files around for an extended period after processing.
> It would be tremendously valuable for us to be able to define the log.retention in minutes, not hours. For example, we would prefer to only keep 30 minutes of logs around.

--
This message was sent by Atlassian JIRA
(v6.1#6144)

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB