Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> dynamic hostnames for sinks

Copy link to this message
Re: dynamic hostnames for sinks
I'd be interested in knowing how you dynamically located the new host.  I would also imagine you could create a "smart" sink that could failover itself.


On Aug 13, 2012, at 11:33 AM, David Capwell wrote:

> I am looking at flume for data ingestion on AWS.  I was wondering how people handle dynamic hostnames in flume?
> I have created my own ConfigurationProvider and looking to mimic FailoverSinkProcessor but on failover to dynamically find a new host to talk to.
> Is there a better route to go than the one I went down?
> Thanks for your time reading this email.