Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Kafka -> HDFS


Copy link to this message
-
Re: Kafka -> HDFS
Mark,

I had the same question!  Camus is super awesome, but doesn't have out of the box support for just writing Strings into HDFS.  I submitted this pull request to support that:

https://github.com/linkedin/camus/pull/28

You can clone this directly from the wikimedia branch of Camus:

https://github.com/wikimedia/camus/tree/wikimedia
On Aug 30, 2013, at 2:18 PM, Mark <[EMAIL PROTECTED]> wrote:

> What is the quickest and easiest way to write message from Kafka into HDFS? I've come across Camus but before we go the whole route of writing Avro messages we want to test plain old vanilla messages.
>
> Thanks