Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 101 to 110 from 118 (0.099s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Kafka on EC2 - Kafka - [mail # user]
...In my experience, anything smaller than m1.xlarge isn't really suitable for I/O intensive high performance stuff. I would guess that, for Kafka, a single m1.xlarge would outperform two m1.la...
   Author: David Arthur, 2012-11-20, 15:52
Keeping track of offsets - Kafka - [mail # user]
...I'm working on offset management for my Python client (non-ZK). I'm having trouble seeing how you would keep track of the message offset when using compression. As I understand it, when you ...
   Author: David Arthur, 2012-11-19, 20:45
Re: On SIGTERM and SIGKILL consumer ids in zookeeper do not always get cleared - Kafka - [mail # user]
...BTW, this is a feature of the ephemeral nodes in ZooKeeper, not a feature of Kafka. If Kafka doesn't close the ZK connection explicitly, ZK waits for the session timeout before deleting ephe...
   Author: David Arthur, 2012-11-19, 19:34
Re: version of zookeeper - Kafka - [mail # user]
...The ZooKeeper API has been stable for a while, I do not suspect there would be any problems between 3.3.4 and 3.4.x. Personally, I have run Kafka 0.7.x with ZooKeeper 3.4.3 with no problems ...
   Author: David Arthur, 2012-11-13, 13:55
[expand - 1 more] - Re: Kafka stream processing framework? - Kafka - [mail # dev]
...Prashanth,  Storm seems to be more focused on data flow between Storm processors (spout? bolt? i forget). My particular use case follows this pattern:  * read id from kafka queue *...
   Author: David Arthur, 2012-11-08, 16:38
[expand - 1 more] - Re: Committing offsets - Kafka - [mail # user]
...Thanks, Jun. This is what I was looking for. I did a little experimentation and found that if I crashed the JVM immediately after consuming a message, the offset is not always changed. I'm g...
   Author: David Arthur, 2012-11-08, 16:32
Re: Multi Costumer and Broker - Kafka - [mail # dev]
...Read through the quick start on the project page http://incubator.apache.org/kafka/quickstart.html  Kafka consumers need to be in the same "consumer group" in order to act as one (one m...
   Author: David Arthur, 2012-11-08, 15:11
Re: Scenarios of Hadoop producers and consumers - Kafka - [mail # user]
...Indeed Hadoop is not the ideal platform for stream processing, but there are plenty of use cases for Kakfa + Hadoop. I use it to consolidate log data from many different systems into HDFS. I...
   Author: David Arthur, 2012-10-31, 01:05
Kafka Python client - Kafka - [mail # user]
...I sent this around on the devs list, but neglected to include the users list. A few weeks ago I put together a "protocol" Python client for Kafka. It doesn't do any of the ZooKeeper/consumer...
   Author: David Arthur, 2012-10-29, 18:12
Re: How to feed MessagePack object to Kafka? - Kafka - [mail # user]
...kafka.message.Message has a constructor that takes in a byte array. MessagePack.write takes in an Object and returns a byte array. You just need to glue the two together in a kafka.serialize...
   Author: David Arthur, 2012-10-29, 18:01
Kafka (118)
HBase (5)
Avro (2)
Pig (1)
Zookeeper (1)
mail # dev (52)
mail # user (47)
issue (19)
last 7 days (1)
last 30 days (1)
last 90 days (3)
last 6 months (4)
last 9 months (118)
Jun Rao (1036)
Neha Narkhede (653)
Neha Narkhede (412)
Jay Kreps (345)
Jun Rao (276)
Guozhang Wang (246)
Joe Stein (213)
Joel Koshy (206)
John Fung (95)
Joe Stein (94)
Guozhang Wang (89)
Jay Kreps (89)
Jason Rosenberg (70)
Swapnil Ghike (62)
David Arthur (61)
Sriram Subramanian (60)
None (60)
Chris Burroughs (58)
Swapnil Ghike (51)
John Fung (39)
Joel Koshy (38)
Timothy Chen (32)
Sriram Subramanian (30)
Alan D. Cabrera (24)
Gwen Shapira (24)