Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Chukwa >> mail # user >> Multiple agents and multiple clusters

high pointe 2011-07-14, 17:44
Copy link to this message
Re: Multiple agents and multiple clusters
Just to be clear -- you want the same data to end up in each cluster?

You'll have to do some hacking. I think it won't be so very monstrous.
In the Agent, there's a notion of pluggable Connectors and Senders. I
think you want a new Connector with two senders.

One caveat -- you'll need to think through what happens if just one
cluster is down, and perhaps other partial failure scenarios too.


On Thu, Jul 14, 2011 at 10:44 AM, high pointe <[EMAIL PROTECTED]> wrote:
> I have a situation where I need to take the one data stream, send it through
> two agents and have the end point residing in separate clusters.
> Rough explanation....
> Streaming Data Box ---> Chukwa Box
> Agent one on Chukwa Box sends feed to cluster one.
> Agent two on Chukwa box sends feed to cluster two.
> Does anyone know of a way to do this without hacking this baby to shreds?
> Thanks!

UC Berkeley Computer Science Department
Bill Graham 2011-07-14, 22:47
highpointe 2011-07-15, 03:38
highpointe 2011-07-15, 03:45
Eric Yang 2011-07-15, 16:22
Ariel Rabkin 2011-07-18, 23:36