Kafka, mail # user - Re: Keeping logs forever - 2013-02-22, 00:44
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Re: Keeping logs forever
Forever is a long time. The definition of replay and navigating through
different versions of kafka would be key.

Example:
If you are storing market data into kafka and have a cep engine running on
top and would like replay "transactions" to be fed back to ensure
replayability, then you would probably want to manage that through the same
mechanism as it existed at that time in the past. This might mean a
different kafka broker (perhaps 0.7) with a different set of consumers with
a potentially different JVM. This, of course, gets into a rat hole.

Regards
Milind
On Thu, Feb 21, 2013 at 4:29 PM, Eric Tschetter <[EMAIL PROTECTED]>wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB