Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Re: issue with kafka-preferred-replica-election.sh


Copy link to this message
-
Re: issue with kafka-preferred-replica-election.sh
Libo,

Just want to clarify, in your case after you created your topic, the
/brokers/topics/my_topic/partitions was never created or it was deleted
somehow?

Guozhang

On Wed, Aug 21, 2013 at 7:25 AM, Yu, Libo <[EMAIL PROTECTED]> wrote:

> For the path /brokers/topics/my_topic/partitions, if you remove partitions
> and run
> kafka-preferred-replica-election.sh, it terminates right away with keeper
> exception.
>
> Regards,
>
> Libo
>
>
> -----Original Message-----
> From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, August 21, 2013 12:23 AM
> To: [EMAIL PROTECTED]
> Subject: Re: issue with kafka-preferred-replica-election.sh
>
> Libo,
>
> Sorry for the late reply. I will file a JIRA for this one. Could you
> please provide the full process and environment to reproduce this issue?
>
> Guozhang
>
>
> On Tue, Aug 20, 2013 at 1:10 PM, Yu, Libo <[EMAIL PROTECTED]> wrote:
>
> > Hi Guozhang,
> >
> > Thanks for the detailed reply. All the brokers are running.
> > The path not created is /brokers/topics/uattoqaaa.default/partitions
> > not /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state
> > Actually, I found quite a few topics don't have the issue. The
> > controller must have failed to create them. I will keep monitoring this
> issue.
> >
> > Currently, when /brokers/topics/my_path/partitions is not there,
> > kafka-preferred-replica-election.sh stops right away with nonode
> > keeper exception. Could you file a JIRA to make it keep working in
> > that scenario?
> >
> >
> >
> > Regards,
> >
> > Libo
> >
> >
> > -----Original Message-----
> > From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> > Sent: Tuesday, August 20, 2013 3:56 PM
> > To: [EMAIL PROTECTED]
> > Subject: Re: issue with kafka-preferred-replica-election.sh
> >
> > The create command tool will only create the path
> > /brokers/topics/uattoqaaa.default, and then controller, once noticing
> > the change in ZK about the added topic, will elect leaders from the
> > assigned replicas written in /brokers/topics/uattoqaaa.default and
> > then create
> /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state.
> >
> > If you have created the topic for a long time but
> > /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state is
> > not created by controller, it could because the replicas specified in
> > /brokers/topics/uattoqaaa.default does not exist yet. Could you verify
> > the brokers specified in this path are up and running?
> >
> > Guozhang
> >
> >
> > On Tue, Aug 20, 2013 at 12:14 PM, Yu, Libo <[EMAIL PROTECTED]> wrote:
> >
> > > One more question:
> > > "The create topic command will not immediately create the path; it
> > > will be created by the controller later during the creation of
> > > partitions and assign replicas to partitions."
> > >
> > > So when will the controller create the path and partitions? When the
> > > first message is published to the topic and partition?
> > > All the partitions are created at once?
> > >
> > > Regards,
> > >
> > > Libo
> > >
> > >
> > > -----Original Message-----
> > > From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> > > Sent: Tuesday, August 20, 2013 1:48 PM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: issue with kafka-preferred-replica-election.sh
> > >
> > > Could you check that before you run
> > > kafka-preferred-replica-election.sh
> > > the /brokers/topics/uattoqaaa.default/partitions Node has been
> > > created or not?
> > > The create topic command will not immediately create the path; it
> > > will be created by the controller later during the creation of
> > > partitions and assign replicas to partitions. If you start the
> > > election command right after the create topic tool, it might not be
> created yet.
> > >
> > > Guozhang
> > >
> > >
> > > On Tue, Aug 20, 2013 at 10:24 AM, Yu, Libo <[EMAIL PROTECTED]> wrote:
> > >
> > > > It is created with 3 partitions.
> > > >
> > > > Regards,
> > > >
> > > > Libo
> > > >
> > > >
> > > > -----Original Message-----
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB