Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 101 to 110 from 117 (0.115s).
Loading phrases to help you
refine your search...
Keeping track of offsets - Kafka - [mail # user]
...I'm working on offset management for my Python client (non-ZK). I'm having trouble seeing how you would keep track of the message offset when using compression. As I understand it, when you ...
   Author: David Arthur, 2012-11-19, 20:45
Re: On SIGTERM and SIGKILL consumer ids in zookeeper do not always get cleared - Kafka - [mail # user]
...BTW, this is a feature of the ephemeral nodes in ZooKeeper, not a feature of Kafka. If Kafka doesn't close the ZK connection explicitly, ZK waits for the session timeout before deleting ephe...
   Author: David Arthur, 2012-11-19, 19:34
Re: version of zookeeper - Kafka - [mail # user]
...The ZooKeeper API has been stable for a while, I do not suspect there would be any problems between 3.3.4 and 3.4.x. Personally, I have run Kafka 0.7.x with ZooKeeper 3.4.3 with no problems ...
   Author: David Arthur, 2012-11-13, 13:55
[expand - 1 more] - Re: Kafka stream processing framework? - Kafka - [mail # dev]
...Prashanth,  Storm seems to be more focused on data flow between Storm processors (spout? bolt? i forget). My particular use case follows this pattern:  * read id from kafka queue *...
   Author: David Arthur, 2012-11-08, 16:38
[expand - 1 more] - Re: Committing offsets - Kafka - [mail # user]
...Thanks, Jun. This is what I was looking for. I did a little experimentation and found that if I crashed the JVM immediately after consuming a message, the offset is not always changed. I'm g...
   Author: David Arthur, 2012-11-08, 16:32
Re: Multi Costumer and Broker - Kafka - [mail # dev]
...Read through the quick start on the project page http://incubator.apache.org/kafka/quickstart.html  Kafka consumers need to be in the same "consumer group" in order to act as one (one m...
   Author: David Arthur, 2012-11-08, 15:11
Re: Scenarios of Hadoop producers and consumers - Kafka - [mail # user]
...Indeed Hadoop is not the ideal platform for stream processing, but there are plenty of use cases for Kakfa + Hadoop. I use it to consolidate log data from many different systems into HDFS. I...
   Author: David Arthur, 2012-10-31, 01:05
Kafka Python client - Kafka - [mail # user]
...I sent this around on the devs list, but neglected to include the users list. A few weeks ago I put together a "protocol" Python client for Kafka. It doesn't do any of the ZooKeeper/consumer...
   Author: David Arthur, 2012-10-29, 18:12
Re: How to feed MessagePack object to Kafka? - Kafka - [mail # user]
...kafka.message.Message has a constructor that takes in a byte array. MessagePack.write takes in an Object and returns a byte array. You just need to glue the two together in a kafka.serialize...
   Author: David Arthur, 2012-10-29, 18:01
Re: Is is possible to send Kryo serialized object to Kafka ? - Kafka - [mail # user]
...Messages in Kafka are just bytes, so as long as you can generate a byte array (byte[]) you can use anything with Kafka. You will need to implement adaptors for your serialization library tha...
   Author: David Arthur, 2012-10-29, 17:53
Kafka (117)
HBase (5)
Avro (2)
Pig (1)
Zookeeper (1)
mail # dev (51)
mail # user (47)
issue (19)
last 7 days (0)
last 30 days (1)
last 90 days (3)
last 6 months (4)
last 9 months (117)
Jun Rao (1038)
Neha Narkhede (665)
Neha Narkhede (412)
Jay Kreps (340)
Jun Rao (276)
Guozhang Wang (237)
Joe Stein (211)
Joel Koshy (207)
John Fung (95)
Joe Stein (94)
Jay Kreps (89)
Guozhang Wang (88)
Jason Rosenberg (70)
Sriram Subramanian (60)
None (60)
Swapnil Ghike (60)
David Arthur (59)
Chris Burroughs (58)
Swapnil Ghike (51)
John Fung (39)
Joel Koshy (38)
Timothy Chen (31)
Sriram Subramanian (29)
Gwen Shapira (27)
Alan D. Cabrera (24)