Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Chukwa >> mail # dev >> a more fault-tolerant collector

Copy link to this message
a more fault-tolerant collector

This is an answer to a question Bill asked me recently: can we
redesign the Collector process to behave better if the filesystem is

I think we can do this by backpressure. If the write fails, the
collector should return an error to the agent. And the agent should
treat it like a post failure, and retry.  Thoughts?


UC Berkeley Computer Science Department
Eric Yang 2010-10-12, 16:57
Bill Graham 2010-10-12, 17:25
Ariel Rabkin 2010-10-12, 17:40
Bill Graham 2010-10-12, 17:48