Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # dev >> Flume-NG Kafka Channel


Copy link to this message
-
Re: Flume-NG Kafka Channel
Jonathan,

My understanding is that channel is a local concept in Flume. So, are you
using a single local Kafka broker to build channel? Will it make more sense
to build a Kafka sink in Fume?

Thanks,

Jun

On Fri, Mar 1, 2013 at 10:56 PM, Jonathan Creasy <[EMAIL PROTECTED]> wrote:

> I started hacking on a Kafka Channel for Flume-NG. It has a Java Consumer
> and Java Producer based on the java example code that works with the PUT
> and TAKE methods on the Channel Interface.
>
> Any thoughts?
>
> Kafka makes a really powerful addition to the existing channel options.
>
> -Jonathan
>
> --
> **
>
> *Jonathan Creasy* | Sr. Ops Engineer
>
> e: [EMAIL PROTECTED] | t: 314.580.8909
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB