Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Proper documentation for setting up sink groups


Copy link to this message
-
Re: Proper documentation for setting up sink groups
Did you read this: http://flume.apache.org/FlumeUserGuide.html#flume-sink-processors

That explains how to use sink groups. Also there is nothing wrong with multiple sinks taking events from one channel. This is an especially useful configuration if you have a very fast source and much slower sinks.
Hari

--
Hari Shreedharan
On Thursday, August 23, 2012 at 9:28 AM, Bhaskar V. Karambelkar wrote:

> The sink group document doesn't mention anything about how
> to hook up sink groups to the rest of the config in order to work.
>
> e.g. under normal circumstances one channel is linked with one sink.
>
> But for failover sink group , looks like both the sinks should be hooked up to the same channel,
> but this is not mentioned any where.
>
> Similarly, what exactly needs to be done for load balancing sink ?
>
> thanks
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB