Kafka, mail # user - Re: Retrieve most-recent-n messages from kafka topic - 2013-07-19, 12:17
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Plain View
+
Johan Lundahl 2013-07-19, 20:27
+
Shane Moriah 2013-07-22, 06:37
+
Shane Moriah 2013-07-19, 07:46
Copy link to this message
-
Re: Retrieve most-recent-n messages from kafka topic
There is not index-based access to messages in 0.7 like there is in 0.8.
You have to start from a known good offset and iterate through the messages.

What's your use case? Running a job periodically that reads the latest N
message from the queue? Is it impractical to run from the last known
offset and only keep the last N?

On 7/19/13 3:45 AM, Shane Moriah wrote:
 
+
Johan Lundahl 2013-07-19, 18:34
+
Shane Moriah 2013-07-19, 20:02
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB