| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
6018 (0.133s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Consume more than produce - Kafka - [mail # user]
|
|
...Hey,After a year or so I have Kafka as my streaming layer in my production, I decided it is time to audit, and to test how many events do I lose, if I lose events at all.I discovered somethi...
|
|
|
|
|
|
|
|
[KAFKA-1566] Kafka environment configuration (kafka-env.sh) - Kafka - [issue]
|
|
...It would be useful (especially for automated deployments) to have an environment configuration file that could be sourced from the launcher files (e.g. kafka-run-server.sh). This is how this...
|
|
|
|
|
|
|
|
[KAFKA-1489] Global threshold on data retention size - Kafka - [issue]
|
|
...Currently, Kafka has per topic settings to control the size of one single log (log.retention.bytes). With lots of topics of different volume and as they grow in number, it could become tedio...
|
|
|
|
|
|
|
|
Re: undesirable log retention behavior - Kafka - [mail # user]
|
|
...This is a real problem you describe. Unfortunately adding thetimestamp to the file name won't help the case you describe asreplicas don't directly interact with files they just fetch message...
|
|
|
|
|
| |
|
|
Re: undesirable log retention behavior - Kafka - [mail # user]
|
|
...log.retention.bytes can somewhat help. but it is cumbersome to use becauseit is a per-topic config for partition limit.there was an earlier thread regarding global bytes limit. that will wor...
|
|
|
Author: Steven Wu,
2014-08-01, 04:56
|
|
|
Re: undesirable log retention behavior - Kafka - [mail # user]
|
|
...What version of Kafka are your using? Have you tried log.retention.bytes?Which ever comes first (ttl or bytes total) should do what you are lookingfor if I understand you right.http://kafka....
|
|
|
Author: Joe Stein,
2014-08-01, 02:39
|
|
|
undesirable log retention behavior - Kafka - [mail # user]
|
|
...it seems that log retention is purely based on last touch/modifiedtimestamp. This is undesirable for code push in aws/cloud.e.g. let's say retention window is 24 hours. disk size is 1 TB. di...
|
|
|
Author: Steven Wu,
2014-08-01, 01:52
|
|
|
|
|
[KAFKA-1510] Force offset commits when migrating consumer offsets from zookeeper to kafka - Kafka - [issue]
|
|
...When migrating consumer offsets from ZooKeeper to kafka, we have to turn on dual-commit (i.e., the consumers will commit offsets to both zookeeper and kafka) in addition to setting offsets.s...
|
|
|
|
|
|
|
|
Re: Apache Kafka error on windows - Couldnot find or load main class QuorumPeerMain - Kafka - [mail # user]
|
|
...How did you start ZK?Thanks,JunOn Wed, Jul 30, 2014 at 10:12 PM, wrote: ...
|
|
|
|
|
|
|
|
[KAFKA-1565] Transaction manager failover handling - Kafka - [issue]
|
|
...Transaction manager should guarantee that, once a pre-commit/pre-abort request is acknowledged, commit/abort request will be delivered to partitions involved in the transaction.In particular...
|
|
|
|
|
|
|
|
[KAFKA-1430] Purgatory redesign - Kafka - [issue]
|
|
...We have seen 2 main issues with the Purgatory.1. There is no atomic checkAndWatch functionality. So, a client typically first checks whether a request is satisfied or not and then register t...
|
|
|
|
|
|
|
|
Re: Zookeeper offset - Kafka - [mail # user]
|
|
...Do you have _any_ logs? i.e., does the consumer log say that it isrebalancing? If not, what is your log4j level setting?JoelOn Thu, Jul 31, 2014 at 08:40:45PM +0000, Srividhya Shanmugam wrot...
|
|
|
|
|
| |
|
|
Zookeeper offset - Kafka - [mail # user]
|
|
...Kafka Team,In the integration environment Kafka and zookeeper are running under supervision. Once in a while when zookeeper and kafka are shut-down and started back again, the consumers are ...
|
|
|
Author: Srividhya Shanmugam,
2014-07-31, 20:41
|
|
|
|
|
Re: Unable to read from the beginning using High level consumer API - Kafka - [mail # user]
|
|
...Set auto.offset.reset to "smallest"On Thu, Jul 31, 2014 at 08:25:35PM +0000, Srividhya Shanmugam wrote: ...
|
|
|
|
|
|
|
|
|
