Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Re: issue with kafka-preferred-replica-election.sh


Copy link to this message
-
Re: issue with kafka-preferred-replica-election.sh
Guozhang Wang 2013-08-22, 16:42
Hello Libo,

I have created the Jira for this issue:

https://issues.apache.org/jira/browse/KAFKA-1019

Guozhang
On Wed, Aug 21, 2013 at 11:27 AM, Yu, Libo <[EMAIL PROTECTED]> wrote:

> We never deleted it. Either it was never created or deleted somehow.
>
> Regards,
>
> Libo
>
>
> -----Original Message-----
> From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, August 21, 2013 11:41 AM
> To: [EMAIL PROTECTED]
> Subject: Re: issue with kafka-preferred-replica-election.sh
>
> Libo,
>
> Just want to clarify, in your case after you created your topic, the
> /brokers/topics/my_topic/partitions was never created or it was deleted
> somehow?
>
> Guozhang
>
>
>
> On Wed, Aug 21, 2013 at 7:25 AM, Yu, Libo <[EMAIL PROTECTED]> wrote:
>
> > For the path /brokers/topics/my_topic/partitions, if you remove
> > partitions and run kafka-preferred-replica-election.sh, it terminates
> > right away with keeper exception.
> >
> > Regards,
> >
> > Libo
> >
> >
> > -----Original Message-----
> > From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> > Sent: Wednesday, August 21, 2013 12:23 AM
> > To: [EMAIL PROTECTED]
> > Subject: Re: issue with kafka-preferred-replica-election.sh
> >
> > Libo,
> >
> > Sorry for the late reply. I will file a JIRA for this one. Could you
> > please provide the full process and environment to reproduce this issue?
> >
> > Guozhang
> >
> >
> > On Tue, Aug 20, 2013 at 1:10 PM, Yu, Libo <[EMAIL PROTECTED]> wrote:
> >
> > > Hi Guozhang,
> > >
> > > Thanks for the detailed reply. All the brokers are running.
> > > The path not created is /brokers/topics/uattoqaaa.default/partitions
> > > not
> > > /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state
> > > Actually, I found quite a few topics don't have the issue. The
> > > controller must have failed to create them. I will keep monitoring
> > > this
> > issue.
> > >
> > > Currently, when /brokers/topics/my_path/partitions is not there,
> > > kafka-preferred-replica-election.sh stops right away with nonode
> > > keeper exception. Could you file a JIRA to make it keep working in
> > > that scenario?
> > >
> > >
> > >
> > > Regards,
> > >
> > > Libo
> > >
> > >
> > > -----Original Message-----
> > > From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> > > Sent: Tuesday, August 20, 2013 3:56 PM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: issue with kafka-preferred-replica-election.sh
> > >
> > > The create command tool will only create the path
> > > /brokers/topics/uattoqaaa.default, and then controller, once
> > > noticing the change in ZK about the added topic, will elect leaders
> > > from the assigned replicas written in
> > > /brokers/topics/uattoqaaa.default and then create
> > /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state.
> > >
> > > If you have created the topic for a long time but
> > > /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state is
> > > not created by controller, it could because the replicas specified
> > > in /brokers/topics/uattoqaaa.default does not exist yet. Could you
> > > verify the brokers specified in this path are up and running?
> > >
> > > Guozhang
> > >
> > >
> > > On Tue, Aug 20, 2013 at 12:14 PM, Yu, Libo <[EMAIL PROTECTED]> wrote:
> > >
> > > > One more question:
> > > > "The create topic command will not immediately create the path; it
> > > > will be created by the controller later during the creation of
> > > > partitions and assign replicas to partitions."
> > > >
> > > > So when will the controller create the path and partitions? When
> > > > the first message is published to the topic and partition?
> > > > All the partitions are created at once?
> > > >
> > > > Regards,
> > > >
> > > > Libo
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> > > > Sent: Tuesday, August 20, 2013 1:48 PM
> > > > To: [EMAIL PROTECTED]
> > > > Subject: Re: issue with kafka-preferred-replica-election.sh
> > > >
> > > > Could you check that before you run