Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Reading "first available" offset for the partition?


Copy link to this message
-
Re: Reading "first available" offset for the partition?
You can obtain this information by sending the broker an OffsetRequest.
There is also a command-line tool (GetOffsetShell) that can help understand
how it works.
On Mon, Nov 26, 2012 at 7:17 AM, Radek Gruchalski <
[EMAIL PROTECTED]> wrote:

> Hi everyone,
>
> I have a question regarding an issue related to OffsetOutOfRange exception.
> I have an app that consumes messages from a topic, this app uses node.js
> and node-kafka behind.
> Our data retention policy is 24h and the app in question was down for over
> 2 days. Not a problem, this is a prototype, however…
> Now, when reconnecting, we are receiving OffsetOutOfRange. Understandable,
> I'm only trying to figure out how to find the "first available" offset for
> a partition.
> Am I assuming correctly this can be done with JMX only? Any
> avro/thrift/rpc call that could give me that data?
>
> Kind regards,
> Radek Gruchalski
> [EMAIL PROTECTED] (mailto:[EMAIL PROTECTED])
> | [EMAIL PROTECTED] (mailto:[EMAIL PROTECTED]) |
> [EMAIL PROTECTED] (mailto:[EMAIL PROTECTED])
> 00447889948663
>
> Confidentiality:
> This communication is intended for the above-named person and may be
> confidential and/or legally privileged.
> If it has come to you in error you must take no action based on it, nor
> must you copy or show it to anyone; please delete/destroy and inform the
> sender immediately.
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB