Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Re: how to force a consumer to start at the beginning


Copy link to this message
-
Re: how to force a consumer to start at the beginning
Oh boy, is my mind slow today.  The tamasic cells woke up but the rajasic ones stayed asleep, which is rather ironic, if you know what I mean.   My only hope is the sattvasic few.

The issue of threading is secondary to the blocking api.  How can I know the traffic is drained from a topic/partition, cleanup, and return the response to the REST call?

thanks,
rob

On Jul 25, 2013, at 11:49 AM, Rob Withers <[EMAIL PROTECTED]> wrote:

> Thanks, Joe, I also see the answer to my other question, that the KafkaStream is not on a different thread, but I automatically expect it to be since all other uses we have had of the KafkaStream are stuffed in a Runnable.  duh.
>
> thanks,
> rob
>
> On Jul 25, 2013, at 11:41 AM, Joe Stein <[EMAIL PROTECTED]> wrote:
>
>> in 0.8 you can set the property "auto.offset.reset" = "smallest" when
>> creating your ConsumerConfig ... this will override the default value of
>> "largest"
>>
>> take a look at ConsoleConsumer.scala for more example if need be
>>
>>
>> /*******************************************
>>
>> Joe Stein
>> Founder, Principal Consultant
>> Big Data Open Source Security LLC
>> http://www.stealth.ly <http://www.stealth.ly>
>> Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
>>
>> ********************************************/
>>
>>
>> On Thu, Jul 25, 2013 at 1:24 PM, James A. Robinson <
>> [EMAIL PROTECTED]> wrote:
>>
>>> On Thu, Jul 25, 2013 at 9:11 AM, Withers, Robert
>>> <[EMAIL PROTECTED]> wrote:
>>>> We are creating a consumer with properties and I did not see a
>>>> property that screamed that it was to start at the beginning of a
>>>> topic.  Is there such a property?
>>>
>>> In v0.7, set 'autooffset.reset' to 'smallest'.
>>>
>>> Jim
>>>
>>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
>>> James A. Robinson                       [EMAIL PROTECTED]
>>> HighWire | Stanford University          http://highwire.stanford.edu/
>>> +1 650 7237294 (Work)                   +1 650 7259335 (Fax)
>>>
>