Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - Re: how to force a consumer to start at the beginning


+
James A. Robinson 2013-07-25, 17:25
+
Joe Stein 2013-07-25, 17:42
Copy link to this message
-
Re: how to force a consumer to start at the beginning
Rob Withers 2013-07-25, 17:49
Thanks, Joe, I also see the answer to my other question, that the KafkaStream is not on a different thread, but I automatically expect it to be since all other uses we have had of the KafkaStream are stuffed in a Runnable.  duh.

thanks,
rob

On Jul 25, 2013, at 11:41 AM, Joe Stein <[EMAIL PROTECTED]> wrote:

> in 0.8 you can set the property "auto.offset.reset" = "smallest" when
> creating your ConsumerConfig ... this will override the default value of
> "largest"
>
> take a look at ConsoleConsumer.scala for more example if need be
>
>
> /*******************************************
>
> Joe Stein
> Founder, Principal Consultant
> Big Data Open Source Security LLC
> http://www.stealth.ly <http://www.stealth.ly>
> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
>
> ********************************************/
>
>
> On Thu, Jul 25, 2013 at 1:24 PM, James A. Robinson <
> [EMAIL PROTECTED]> wrote:
>
>> On Thu, Jul 25, 2013 at 9:11 AM, Withers, Robert
>> <[EMAIL PROTECTED]> wrote:
>>> We are creating a consumer with properties and I did not see a
>>> property that screamed that it was to start at the beginning of a
>>> topic.  Is there such a property?
>>
>> In v0.7, set 'autooffset.reset' to 'smallest'.
>>
>> Jim
>>
>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
>> James A. Robinson                       [EMAIL PROTECTED]
>> HighWire | Stanford University          http://highwire.stanford.edu/
>> +1 650 7237294 (Work)                   +1 650 7259335 (Fax)
>>
 
+
Rob Withers 2013-07-25, 17:57
+
Florin Trofin 2013-07-25, 22:37
+
Rob Withers 2013-07-26, 02:36
+
Rob Withers 2013-07-25, 17:45