-Re: What happens if one broker goes down
Chitra Raveendran 2013-05-20, 06:32
When my broker went down, my producer just stopped reading the file giving
an exception saying "connection refused to kafka broker".
I tried overcoming the exception by giving a try and catch ! BUT I'M SEEING
DATA LOSS. What am I doing wrong ??? Please help
For reference :
I'm using kafka 0.7.2 since my consumer is a storm spout and i read that
storm is most compatible with kafka 0.7.2.
IT DOESNT SUPPORT REPLICATION RIGHT?
On Fri, May 17, 2013 at 6:56 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:
> You can read the high level design of kafka replication here
> Generally if your replication factor is more than 1 you shouldn't see data
> loss in your test. When a broker fails, the producer will get an exception
> and it will retry.
> On May 16, 2013 10:21 PM, "Chitra Raveendran" <
> [EMAIL PROTECTED]> wrote:
> > Hi
> > I was just doing some benchmarking with a 3node cluster. If one broker
> > down , what happens? Does the producer go down ? that's what happened in
> > case.
> > Is the data lost? Or does it get distributed amongst the other brokers?
> > --
> > Chitra Raveendran
> > Data Scientist
> > *Flutura | Decision Sciences & Analytics*
> > mail : [EMAIL PROTECTED]
*Flutura Business Solutions Pvt. Ltd*
Tel : +918197563660
email : [EMAIL PROTECTED]