Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> dynamic hostnames for sinks


Copy link to this message
-
Re: dynamic hostnames for sinks
I'd be interested in knowing how you dynamically located the new host.  I would also imagine you could create a "smart" sink that could failover itself.

Ralph

On Aug 13, 2012, at 11:33 AM, David Capwell wrote:

> I am looking at flume for data ingestion on AWS.  I was wondering how people handle dynamic hostnames in flume?
>
> I have created my own ConfigurationProvider and looking to mimic FailoverSinkProcessor but on failover to dynamically find a new host to talk to.
>
> Is there a better route to go than the one I went down?
>
> Thanks for your time reading this email.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB