Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> kafka producer - retry messages


Copy link to this message
-
Re: kafka producer - retry messages
I would say follow Sparkngin and you'll be able to use the  "Log
persistence if the log producer connection is down". functionality when
it's complete.
On Thu, Nov 28, 2013 at 8:36 AM, Demian Berjman <[EMAIL PROTECTED]>wrote:

> Steve, our use case is very simple. There are many reasons for a cluster to
> go down. If that the case, what we do with the producers? Hopefully it will
> be a time window of a couple of hours. If your concern are the queued
> messages, we have only a few thousands per day.
>
> Thanks,
>
>
> On Thu, Nov 28, 2013 at 1:12 PM, Steve Morin <[EMAIL PROTECTED]> wrote:
>
> > What I mean by that is that your looking to have the Kafka cluster able
> to
> > be down for like 5 minutes or upto a day.  The problem is estimating how
> > long it will take to recover.
> >
> > Is this work your doing for a consulting project?  Or are you doing
> > something on behalf of an employer.  Basically would like to know more
> > about the use-case.  You can email me directly at [EMAIL PROTECTED]o
> > we don't clog the message board.
> >
> >
> > On Thu, Nov 28, 2013 at 8:05 AM, Demian Berjman <[EMAIL PROTECTED]
> > >wrote:
> >
> > > Steve, thanks for the response! I don't understand what you mean by
> "what
> > > kind of window?"
> > >
> > > I am looking for something like, i think you did it in Sparkngin: "Log
> > > persistence if the log producer connection is down".
> > >
> >
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB