Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> kafka --> hadoop question


+
Oleg Ruchovets 2013-04-28, 11:30
Copy link to this message
-
Re: kafka --> hadoop question
Camus is a solution that is well supported and currently used at LinkedIn.

Thanks,
Neha
On Apr 28, 2013 4:30 AM, "Oleg Ruchovets" <[EMAIL PROTECTED]> wrote:

> Hi ,
>    I am looking for simple way to transfer from kafka to  hadoop.
>
>    I found such solutions in Github:
>      https://github.com/linkedin/camus
>      https://github.com/miniway/kafka-hadoop-consumer
>
> https://github.com/kafka-dev/kafka/tree/master/contrib/hadoop-consumer
>
>
>  Question:
>     What solution is stable and what framework do you use in your project?
>     Is there another kafka --> hadoop solution that I didn't find and it is
> worth an attention?
>
> I am looking something simple and stable. I just need to transfer kafka
> content to hdfs. There is no plan to use ETL at this stage.
>
> Please advice.
>
> Thanks
> Oleg.
>

 
+
Oleg Ruchovets 2013-04-28, 17:14
+
Neha Narkhede 2013-04-28, 17:24
+
Oleg Ruchovets 2013-04-28, 17:27
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB