Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Proper use of ConsumerConnector


+
Tom Brown 2012-12-19, 18:49
+
Joel Koshy 2012-12-19, 19:16
+
永辉 赵 2012-12-20, 09:07
+
Neha Narkhede 2012-12-20, 16:56
+
Joel Koshy 2012-12-20, 18:06
+
Neha Narkhede 2012-12-20, 18:14
+
Tom Brown 2012-12-20, 19:32
+
Neha Narkhede 2012-12-20, 19:43
+
永辉 赵 2012-12-21, 10:56
+
Neha Narkhede 2012-12-21, 17:37
+
Tom Brown 2012-12-21, 17:47
Copy link to this message
-
Re: Proper use of ConsumerConnector
It tracks the consumed offset, not the fetched offset.

Thanks,

Jun

On Fri, Dec 21, 2012 at 9:46 AM, Tom Brown <[EMAIL PROTECTED]> wrote:

> Does the ConsumerConnector keep track of the offsets of data
> downloaded from the server (and queued for consumption by the end user
> of the API), or does it keep track of the actual offset that has been
> consumed by the end user?
>
> --Tom
>
> On Fri, Dec 21, 2012 at 10:37 AM, Neha Narkhede <[EMAIL PROTECTED]>
> wrote:
> >>  But if crash happens just after offset committed, then unprocessed
> >> message in consumer will be skipped after reconnected.
> >>
> >
> > If the consumer crashes, you will get duplicates, not lose any data.
> >
> > Thanks,
> > Neha
>

 
+
Yonghui Zhao 2012-12-21, 23:12
+
Tom Brown 2012-12-22, 01:44
+
Neha Narkhede 2012-12-23, 19:54