Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # dev - Kafka PHP Client (+RESTful proxy)


Copy link to this message
-
Re: Kafka PHP Client (+RESTful proxy)
Jonathan Creasy 2012-07-16, 18:11
Awesome, I built a RESTful Proxy last week so I will integrate your library
and check that out. I'll publish my Proxy code soon, it is getting thrashed
internally right now.
On Jul 15, 2012 4:21 PM, "Michal Hariš" <[EMAIL PROTECTED]> wrote:

> Hi all,
>
> I have a long interest in pub-sub and have written several variants of
> proxies/bridges to JMS ( ActiveMQ, HornetQ and some others) in Java and I
> share the motivations behind Kafka project (esp. the idea of keeping the
> consumption state at the consumer side really speaks to my heart and also
> the focus on persistence).
>
> So I started writing some proofs of concept for the 50GB of daily event
> logs I work with and  which I would like to turn into a real time streams
> rather than offline hive processes. I often use php for proof-of-concepts
> because it's easy to write and throw away but after a few hours of using
> and looking at the Kafka PHP Client which is in the incubator trunk I have
> ended up writing and alternative because the existing client does few
> things which don't work for me ( mainly the fact that it loads the entire
> fetch-response into memory and then processes internal buffer plus few
> other things.. ) and doesn't do few things I need ( mainly doesn't try to
> deal with the long offsets and  decompression )
>
> Please have a look if you're interested:
> http://svn.xp-dev.com/svn/kafkaphp/trunk/
>
> (Btw, having a robust and simple php api would be an easy step towards a
> restful proxy which could be later turned into scala/java underneath once
> the restful api would get stable)
>
> Michal
>