| clear query|facets|time |
Search criteria: .
Results from 51 to 60 from
97 (0.1s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Solution for blocking fsync in 0.8 - Kafka - [mail # dev]
|
|
...In practise (at linkedin), how long do you see the calls blocked for during fsycs? On Thu, May 24, 2012 at 1:40 PM, Jay Kreps wrote: ...
|
|
|
Author: S Ahmed,
2012-05-25, 14:09
|
|
|
Re: Kafka events to S3? - Kafka - [mail # user]
|
|
...Is there a writeup on the algorithm used to do that? Sounds interesting :) Agreed, this sounds like more of a contrib. On Wed, May 23, 2012 at 1:49 PM, Jay Kreps wrote: &nb...
|
|
|
Author: S Ahmed,
2012-05-23, 18:19
|
|
|
Re: Kafka events to S3? - Kafka - [mail # user]
|
|
...What would be needed to do this? Just thinking off the top of my head: 1. create a zookeeper store to keep track of the last message offset persisted to s3, and which messages ea...
|
|
|
Author: S Ahmed,
2012-05-23, 15:21
|
|
|
Re: filter before flush to disk - Kafka - [mail # user]
|
|
...Say I am storing messages like this: sessionID, year-month-day-hour-minute-second, value Now say I only need to stats at the minute level, or hour level, this means that i could ...
|
|
|
Author: S Ahmed,
2012-05-17, 21:32
|
|
|
Re: filter before flush to disk - Kafka - [mail # user]
|
|
...Oh, maybe this isn't possible again since the object is mapped to a file, and it may already have flushed data at the os level? On Tue, May 15, 2012 at 11:43 AM, S Ahmed wrote: &...
|
|
|
Author: S Ahmed,
2012-05-17, 13:40
|
|
|
Re: filter before flush to disk - Kafka - [mail # user]
|
|
...One downside is if my logic was messed up, I don't have a timeframe of rolling the logic back (which was one of the benefits of kafka's design choice of having messages kept around for x day...
|
|
|
Author: S Ahmed,
2012-05-15, 15:43
|
|
|
Re: filter before flush to disk - Kafka - [mail # user]
|
|
...What do you mean? " I think the direction we are going is instead to just let you co-locate this processing on the same box. This gives the isolation of separate processes and th...
|
|
|
Author: S Ahmed,
2012-05-15, 15:42
|
|
|
filter before flush to disk - Kafka - [mail # user]
|
|
...Would it be possible to filter the collection before it gets flush to disk? Say I am tracking page views per user, and I could perform a rollup before it gets flushed to disk (using a ...
|
|
|
Author: S Ahmed,
2012-05-15, 13:38
|
|
|
Re: since flushes are batched, is it still io intensive? - Kafka - [mail # user]
|
|
...then why have an operations page? j/k thanks Jay! Just a note, and I hope nobody takes it the wrong way, but I was lookign at the flume project and I really appreciated how much ...
|
|
|
Author: S Ahmed,
2012-05-12, 01:21
|
|
|
Re: since flushes are batched, is it still io intensive? - Kafka - [mail # user]
|
|
...Do you tune the o/s dedicated memory for page cache? Or that's all automatic.... It would be cool if linkedin posted some of their server level tweaks if that is critical to gett...
|
|
|
Author: S Ahmed,
2012-05-11, 16:16
|
|
|
|
