Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> C/C++ Client


Copy link to this message
-
Re: C/C++ Client
At LinkedIn, we are also building a native C producer client for 0.8. It
uses non-blocking socket I/O to improve the producer throughput. We plan to
open source it when it's fully tested, hopefully in a couple of months.

Thanks,

Jun

On Wed, Mar 27, 2013 at 8:48 PM, Matthew Stump <[EMAIL PROTECTED]>wrote:

> Howdy,
>
> I'm considering the use of Kafka in the rewrite of a big legacy product. A
> good chunk of the back end code is going to be written in C++ (large in
> memory data-structures). The two possible options available to me for
> clients appear to be:
>
> https://github.com/edenhill/librdkafka
>
> and
>
> https://github.com/quipo/kafka-cpp
>
> The problem is that librdkafka currently only works on Linux due to the use
> of the AF_NETLINK API, and thread local storage. There may be other issues,
> but I just started playing with it today and that's what I've discovered
> thus far.
>
> kafka-cpp is incomplete (no consumer) and it looks unused.
>
> For either I would need to hop in and do some significant work. Is there
> any client I'm missing that can shorten my path?
>
> If I adopt one of these projects (lets say kafka-cpp) am I better off
> implementing the 0.8 protocol? I'de like to have something running in
> staging a couple months from now. How far out is 0.8?
>
> Thanks,
> Matt Stump
>