Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # dev >> MULTI FETCH RESPONSE Wire Format for Kafka 0.7.1


+
Milind Parikh 2012-09-28, 21:38
Copy link to this message
-
Re: MULTI FETCH RESPONSE Wire Format for Kafka 0.7.1
After doing a little wire-snooping of the data, it appears that the
MULTI-FETCH RESPONSE is EXACTLY the same as the SINGLE-FETCH.

If this is correct, how does one advance to the next offset for each one of
the topic-partition combo if reading multiple topic-partitions in parallel;
given that the information about which topic-partition did this message
originate from is missing in the response?

Is there a JIRA that is getting worked?

Thanks
Milind
On Fri, Sep 28, 2012 at 2:38 PM, Milind Parikh <[EMAIL PROTECTED]>wrote:

> What is the wire format for MULTI-FETCH *RESPONSE* *given
>
>    *that the SINGLE-FETCH RESPONSE LOOKS like this:
>                     RESPONSE_HEADER
>                                   ResponseLength:32/integer
>                                   ErrorCode:16/integer
>                    MESSAGES
>                              (
>                                   Length:32/integer
>                                   Magic:8/integer
>                                   Compression:8/integer
>                                   CheckSum:32/integer
>                                   Payload/binary
>                              ) +
>
>
> https://cwiki.apache.org/KAFKA/writing-a-driver-for-kafka.html doesn't
> talk about this.
>
>
> Thanks
> Milind
>
>
+
Jun Rao 2012-09-29, 18:25
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB