Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 30 (0.13s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Programmatic Kafka version detection/extraction? - Kafka - [mail # user]
...Hi Gwen,the protocol version in an InfoResponse message would be the maximumsupported mainline protocol version, each change to theeffective protocol specification bumps the version by one.T...
   Author: Magnus Edenhill, 2014-11-14, 19:34
Re: Kafka to transport binary files - Kafka - [mail # user]
...Hi Rohit,librdkafka will produce messages with zero copy (unless compression isenabled).And kafkacat will do this if you provide it one or more files as argumentsin producer mode:  ...
   Author: Magnus Edenhill, 2014-11-14, 08:22
Re: spikes in producer requests/sec - Kafka - [mail # user]
...Hi Wes,are you monitoring librdkafka statistics as well?If so, are there any correlating spikes in the per-broker and per-partitionstatistics?Such as: - brokers..rtt.avg  <--- b...
   Author: Magnus Edenhill, 2014-11-11, 20:49
Re: Can both uncompressed data and compressed data reside in the same topic (partition) - Kafka - [mail # user]
...Hi Zuoning,since compression is a per-message(set) attribute a topic can have bothcompressed and uncompressed messages, as Guozhang says,and yes, this is supported by both the broker and cli...
   Author: Magnus Edenhill, 2014-11-03, 16:15
[expand - 1 more] - Re: C/C++ kafka client API's - Kafka - [mail # user]
...Hi Svante,yes, I will keep librdkafka in pace with the official Kafkafunctionality/features/protocol changes as they are released upstream.Next in the pipeline is broker based consumer group...
   Author: Magnus Edenhill, 2014-10-14, 18:37
Re: how is the partitioner working when compression is enabled? - Kafka - [mail # user]
...Hi Lex,messages are batched (and compressed) after partitioning.2014-08-19 15:46 GMT+02:00 Lian, Li : ...
   Author: Magnus Edenhill, 2014-08-19, 14:13
Re: Performance/Stress tools - Kafka - [mail # user]
...Hi Dayo,the rdkafka_performance tool from librdkafka is useful for performancemeasurements / stress testing.https://github.com/edenhill/librdkafkaIt resides in the examples/ directory.https:...
   Author: Magnus Edenhill, 2014-07-21, 22:37
Re: Kafka latency measures - Kafka - [mail # user]
...Hi,do these spikes happen to correlate with log.flush.interval.messages orlog.flush.interval.ms?If so it's the file system sync blockage you are seeing./Magnus2014-06-18 16:31 GMT+02:00 Supu...
   Author: Magnus Edenhill, 2014-06-18, 15:16
Re: console producer question - Kafka - [mail # user]
...Hey Ian,this is where a tool like kafkacat comes in handy, it will use a randompartitioner by default (without the need for defining a key):  tail -f /my/log | kafkacat -b mybroker...
   Author: Magnus Edenhill, 2014-04-10, 00:40
Re: Kafka snappy compression - Kafka - [mail # user]
...Some notes on this: - remember that Messages are wrapped in a compressed MessageSet that iswrapped in an outer Message which is wrapped in an outer MessageSet (themind boggles). - ...
   Author: Magnus Edenhill, 2014-03-27, 12:37
Sort:
project
Kafka (30)
type
mail # user (23)
mail # dev (7)
date
last 7 days (0)
last 30 days (0)
last 90 days (5)
last 6 months (7)
last 9 months (30)
author
Jun Rao (994)
Neha Narkhede (558)
Neha Narkhede (412)
Jay Kreps (317)
Jun Rao (276)
Guozhang Wang (249)
Joe Stein (230)
Joel Koshy (179)
John Fung (95)
Joe Stein (94)
Jay Kreps (89)
Guozhang Wang (88)
Jason Rosenberg (75)
Sriram Subramanian (60)
None (60)
Chris Burroughs (58)
David Arthur (58)
Swapnil Ghike (58)
Swapnil Ghike (51)
John Fung (39)
Joel Koshy (38)
Gwen Shapira (32)
Sriram Subramanian (27)
Alan D. Cabrera (24)
Bhavesh Mistry (21)
Magnus Edenhill
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB