Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # dev - [jira] [Updated] (KAFKA-918) Change log.retention.hours to be log.retention.mins


Copy link to this message
-
[jira] [Updated] (KAFKA-918) Change log.retention.hours to be log.retention.mins
"Alin Vasile 2013-10-25, 07:36

     [ https://issues.apache.org/jira/browse/KAFKA-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alin Vasile updated KAFKA-918:
------------------------------

    Attachment: issue_918.patch

New patch attached, unused imports are removed from KafkaConfigTest

> Change log.retention.hours to be log.retention.mins
> ---------------------------------------------------
>
>                 Key: KAFKA-918
>                 URL: https://issues.apache.org/jira/browse/KAFKA-918
>             Project: Kafka
>          Issue Type: New Feature
>          Components: config
>    Affects Versions: 0.7.2
>            Reporter: Jason Weiss
>              Labels: features, newbie
>         Attachments: issue_918.patch
>
>
> We stood up a cluster that is processing over 350,000 events per second, with each event a fixed payload size of 2K. The storage required to process that much data over an hour is beyond what we wanted to pay for at AWS. Additionally, we don't have a requirement to keep the files around for an extended period after processing.
> It would be tremendously valuable for us to be able to define the log.retention in minutes, not hours. For example, we would prefer to only keep 30 minutes of logs around.

--
This message was sent by Atlassian JIRA
(v6.1#6144)