Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - C/C++ Client


+
Matthew Stump 2013-03-28, 03:49
+
Magnus Edenhill 2013-03-28, 14:51
+
Rohit Prasad 2013-03-28, 15:34
+
mrevilgnome 2013-03-28, 15:53
+
mrevilgnome 2013-03-28, 15:52
+
Jun Rao 2013-04-01, 14:54
Copy link to this message
-
Re: C/C++ Client
mrevilgnome 2013-04-01, 15:23
Any interest in open sourcing it now and picking up contributors?
On Mon, Apr 1, 2013 at 7:54 AM, Jun Rao <[EMAIL PROTECTED]> wrote:

> At LinkedIn, we are also building a native C producer client for 0.8. It
> uses non-blocking socket I/O to improve the producer throughput. We plan to
> open source it when it's fully tested, hopefully in a couple of months.
>
> Thanks,
>
> Jun
>
> On Wed, Mar 27, 2013 at 8:48 PM, Matthew Stump <[EMAIL PROTECTED]
> >wrote:
>
> > Howdy,
> >
> > I'm considering the use of Kafka in the rewrite of a big legacy product.
> A
> > good chunk of the back end code is going to be written in C++ (large in
> > memory data-structures). The two possible options available to me for
> > clients appear to be:
> >
> > https://github.com/edenhill/librdkafka
> >
> > and
> >
> > https://github.com/quipo/kafka-cpp
> >
> > The problem is that librdkafka currently only works on Linux due to the
> use
> > of the AF_NETLINK API, and thread local storage. There may be other
> issues,
> > but I just started playing with it today and that's what I've discovered
> > thus far.
> >
> > kafka-cpp is incomplete (no consumer) and it looks unused.
> >
> > For either I would need to hop in and do some significant work. Is there
> > any client I'm missing that can shorten my path?
> >
> > If I adopt one of these projects (lets say kafka-cpp) am I better off
> > implementing the 0.8 protocol? I'de like to have something running in
> > staging a couple months from now. How far out is 0.8?
> >
> > Thanks,
> > Matt Stump
> >
>

 
+
Simon Whitear 2013-04-16, 18:45