I made some improvements to the Python client. I implemented fetch, multi-fetch, multi-produce, and offset requests; I also documented each request/response with the wire format. I've committed to my Kafka branch on GitHub. I have only briefly tested things.

https://github.com/mumrah/kafka/tree/trunk/clients/python

It's mostly low-level protocol stuff. I'm sure there is room for some more helper methods and high-level API. Feedback is welcome!

-David

I moved this into a standalone project on GitHub: https://github.com/mumrah/kafka-python

Any suggestions for features beyond the protocol support?

Also, where can I find details on protocol changes for 0.8 (if it's even finalized yet)?

Cheers,
David

On Sep 22, 2012, at 2:55 PM, David Arthur wrote:

> I made some improvements to the Python client. I implemented fetch, multi-fetch, multi-produce, and offset requests; I also documented each request/response with the wire format. I've committed to my Kafka branch on GitHub. I have only briefly tested things.
>
> https://github.com/mumrah/kafka/tree/trunk/clients/python
>
> It's mostly low-level protocol stuff. I'm sure there is room for some more helper methods and high-level API. Feedback is welcome!
>
> -David

0.8 protocol is described here:
https://cwiki.apache.org/confluence/display/KAFKA/New+Wire+Format+Proposal

Thanks,

Jun

On Mon, Sep 24, 2012 at 6:11 AM, David Arthur <[EMAIL PROTECTED]> wrote:

> I moved this into a standalone project on GitHub:
> https://github.com/mumrah/kafka-python
>
> Any suggestions for features beyond the protocol support?
>
> Also, where can I find details on protocol changes for 0.8 (if it's even
> finalized yet)?
>
> Cheers,
> David
>
> On Sep 22, 2012, at 2:55 PM, David Arthur wrote:
>
> > I made some improvements to the Python client. I implemented fetch,
> multi-fetch, multi-produce, and offset requests; I also documented each
> request/response with the wire format. I've committed to my Kafka branch on
> GitHub. I have only briefly tested things.
> >
> > https://github.com/mumrah/kafka/tree/trunk/clients/python
> >
> > It's mostly low-level protocol stuff. I'm sure there is room for some
> more helper methods and high-level API. Feedback is welcome!
> >
> > -David
>
>