Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> kafka producer - retry messages


Copy link to this message
-
Re: kafka producer - retry messages
Have you tried the replication feature added to 0.8 http://kafka.apache.org/documentation.html#replication
/*******************************************
 Joe Stein
 Founder, Principal Consultant
 Big Data Open Source Security LLC
 http://www.stealth.ly
 Twitter: @allthingshadoop
********************************************/
On Nov 28, 2013, at 9:37 AM, Demian Berjman <[EMAIL PROTECTED]> wrote:

> Hi.
>
> Anyone has build a retry system (durable) for the producer in case the
> kakfa cluster is down? We have certain messages that must be sent because
> there are after a transaction that cannot be undo.
>
> We could set the property "message.send.max.retries", but if the producer
> goes down, we lost the messages.
>
> Thanks,

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB