Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Flume hops behind HAProxy

Rahul Ravindran 2012-11-14, 01:52
Copy link to this message
Re: Flume hops behind HAProxy
Resending given I sent it during off-hours.
 From: Rahul Ravindran <[EMAIL PROTECTED]>
Sent: Tuesday, November 13, 2012 5:52 PM
Subject: Flume hops behind HAProxy

   Before I try it, I wanted to check if there were any known issues with this. We will have multiple flume agents sending an Avro stream each to a smaller set of intermediate flume hops. Are there any issues/concerns around having the flume agents send their streams to an HAProxy which will round robin between the different flume hops. Any issue around the transaction mechanism with this setup?

I know that there is a selector mechanism in Flume to do this, but our operations extensively use HAProxy, and are most familiar with it.

Brock Noland 2012-11-14, 21:33
Rahul Ravindran 2012-11-14, 21:49
Camp, Roy 2012-11-14, 22:15
Rahul Ravindran 2012-11-14, 22:46
Brock Noland 2012-11-15, 02:20
Rahul Ravindran 2012-11-15, 17:27
Brock Noland 2012-11-15, 17:35