| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
38 (0.075s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Exceptions in zookeeper based consumer - Kafka - [mail # user]
|
|
...Hi all, I have written my own Kafka spout for storm processing. In this spout I open the connection using Consumer.createJavaConsumerConnector(consumerConfig), iterate over a batch of ...
|
|
|
Author: Vaibhav Puranik,
2012-07-27, 18:22
|
|
|
Re: Getting fixed amount of messages using Zookeeper based consumer - Kafka - [mail # user]
|
|
...Jun, The messages are always available. My requirement is to get them in batches (without worrying about offsets) so that I can do batch aggregation. I want to mark each batch with a b...
|
|
|
Author: Vaibhav Puranik,
2012-07-12, 18:40
|
|
|
Re: Getting fixed amount of messages using Zookeeper based consumer - Kafka - [mail # user]
|
|
...Neha, I tried calling shutdown on ConsumerConnector. The only problem I have with it is that it forces me to close the connection thereby forcing me to open the connection every single...
|
|
|
Author: Vaibhav Puranik,
2012-07-12, 18:24
|
|
|
Re: Getting fixed amount of messages using Zookeeper based consumer - Kafka - [mail # user]
|
|
...I tried breaking the loop in the middle and here is what I got: 10158 [FetchRunnable-0] INFO kafka.consumer.SimpleConsumer - Reconnect in multifetch due to socket error: ja...
|
|
|
Author: Vaibhav Puranik,
2012-07-12, 16:34
|
|
|
Re: Getting fixed amount of messages using Zookeeper based consumer - Kafka - [mail # user]
|
|
...The inner loop keeps running. If I break it in the middle, is Kafka broker going to know that rest of the mesaages in the stream were not delivered? Regards, Vaibhav GumGum On Jul 11, ...
|
|
|
Author: Vaibhav Puranik,
2012-07-12, 05:03
|
|
|
Getting fixed amount of messages using Zookeeper based consumer - Kafka - [mail # user]
|
|
...Hi all, Is there any way to get a fixed amount of messages using Zookeeper based consumer (ConsumerConnector)? I know that with SimpleConsumer you can pass fetchSize as an argume...
|
|
|
Author: Vaibhav Puranik,
2012-07-12, 00:05
|
|
|
Re: SimpleConsumer throwing OffsetOutOfRangeException - Kafka - [mail # user]
|
|
...Thanks Joel. I actually dont want to deal with offsets. The Kafka storm spout is forcing me to deal with it :) Regards, Vaibhav, GumGum On Jul 3, 2012 6:51 PM, "Joel Koshy" ...
|
|
|
Author: Vaibhav Puranik,
2012-07-04, 02:31
|
|
|
SimpleConsumer throwing OffsetOutOfRangeException - Kafka - [mail # user]
|
|
...Hi, We are sending all of our production events to Kafka, but nobody is consuming it right now. The system is running for a week. The retention period is set to 72 hours. When I ...
|
|
|
Author: Vaibhav Puranik,
2012-07-04, 00:51
|
|
|
Re: Getting timeouts with elastic load balancer in AWS - Kafka - [mail # user]
|
|
...Just to remove all the variables regarding me restarting the broker, I did a test with Amazon ELB. (0.7.1 producer and 0.7.0 broker) Thus, no broker restarts. The connection was getting brok...
|
|
|
Author: Vaibhav Puranik,
2012-06-29, 00:40
|
|
|
Re: Getting timeouts with elastic load balancer in AWS - Kafka - [mail # user]
|
|
...Jun, Here is the log with SynProducer and DefaultEventHandler trace enabled. http://pastebin.com/dTm5RSJ9 Here are my producer settings: properties.put("serializer.cl...
|
|
|
Author: Vaibhav Puranik,
2012-06-28, 20:36
|
|
|
|
