Kafka, mail # dev - offset fetch request - response issue and wire protocol kafka 0.8 - 2013-06-17, 09:02
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Plain View
Copy link to this message
offset fetch request - response issue and wire protocol kafka 0.8
Given the

OffsetFetchRequest => ConsumerGroup [TopicName [Partition]]
  ConsumerGroup => string
  TopicName => string
  Partition => int32


OffsetFetchResponse => [TopicName [Partition Offset Metadata ErrorCode]]
  TopicName => string
  Partition => int32
  Offset => int64
  Metadata => string
  ErrorCode => int16

CorrelationId : 3500000001, ClientId: ERLKAFKA, APIKEY -> 7,
APIVERSION 0,   ConsumerGroup:  CG, TopicName: Topic1, Partition: 0

The following bytes are produed in request

RQLEN |APK|APV-| CorrelationI|CLE|  ClientID             |   |

         |     Topic1        |        |   0   |

I get a response of

 RELEN|CorrelationId|    ????

which seems to be wrong according to the wire protocol.

Also on Kafka Console, I get a

[2013-06-17 01:25:36,440] ERROR [KafkaApi-1] error when handling
request Name: ControlledShutdownRequest; Version: 0; CorrelationId:
-794967295; BrokerId: 542034 (kafka.server.KafkaApis)
kafka.common.BrokerNotAvailableException: Broker id 542034 does not exist.
at kafka.controller.KafkaController.shutdownBroker(KafkaController.scala:139)
at kafka.server.KafkaApis.handleControlledShutdownRequest(KafkaApis.scala:134)
at kafka.server.KafkaApis.handle(KafkaApis.scala:73)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42)
at java.lang.Thread.run(Thread.java:722)

What am I doing wrong?



NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB