Kafka, mail # user - Re: log file flush? - 2013-02-19, 11:51
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Plain View
+
Jason Huang 2013-02-19, 11:28
Copy link to this message
-
Re: log file flush?
The messages for a topic are kept in the kafka broker's memory before they
are flushed to the disk. The flush happens based on size and time limits,
whichever is hit first. If you kill the kafka server process before any
message has been flushed to the disk, those messages will be lost. The
config (kafka.server.KafkaConfig) parameters log.flush.interval,
log.default.flush.scheduler.interval.ms and log.default.flush.interval.ms
at http://kafka.apache.org/configuration.html should help clarify this.

Thanks,
Swapnil

On 2/19/13 3:28 AM, "Jason Huang" <[EMAIL PROTECTED]> wrote:

 
+
Swapnil Ghike 2013-02-19, 11:54
+
Jason Huang 2013-02-19, 12:06
+
Jun Rao 2013-02-19, 16:26
+
Jay Kreps 2013-02-19, 18:00
+
Jason Huang 2013-02-20, 04:03
+
Jay Kreps 2013-02-20, 04:28
+
Jason Huang 2013-02-20, 07:06
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB