I'm having a lot of trouble getting throughput of mirrormaker to be consistent. On ec2, I have ~10 topics with pretty different throughputs, mirroring from 4 regions into 1. Total of about 20MBps. Sometimes it seems to be going fine, and then it seems like one of the consumers stops altogether, and restarting the process will let it catch back up. Sometimes I'll see errors in the logs about mirrormaker threads being stopped, and it doesn't seem like they ever get replaced.
Whats the recommended setup for mirrormaker? I've tried changing number of streams, producers, adding servers, splitting processes by topic or region, all to varying degrees of effect but still seem to just lose a partition periodically.
Jun On Thu, Aug 29, 2013 at 4:47 PM, Walter King <[EMAIL PROTECTED]> wrote:
Jun Rao 2013-08-30, 03:55
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext