Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Re: issue with kafka-preferred-replica-election.sh


Copy link to this message
-
Re: issue with kafka-preferred-replica-election.sh
Libo,

Sorry for the late reply. I will file a JIRA for this one. Could you please
provide the full process and environment to reproduce this issue?

Guozhang
On Tue, Aug 20, 2013 at 1:10 PM, Yu, Libo <[EMAIL PROTECTED]> wrote:

> Hi Guozhang,
>
> Thanks for the detailed reply. All the brokers are running.
> The path not created is /brokers/topics/uattoqaaa.default/partitions
> not /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state
> Actually, I found quite a few topics don't have the issue. The controller
> must have failed to create them. I will keep monitoring this issue.
>
> Currently, when /brokers/topics/my_path/partitions is not there,
> kafka-preferred-replica-election.sh stops right away with nonode
> keeper exception. Could you file a JIRA to make it keep working in
> that scenario?
>
>
>
> Regards,
>
> Libo
>
>
> -----Original Message-----
> From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, August 20, 2013 3:56 PM
> To: [EMAIL PROTECTED]
> Subject: Re: issue with kafka-preferred-replica-election.sh
>
> The create command tool will only create the path
> /brokers/topics/uattoqaaa.default, and then controller, once noticing the
> change in ZK about the added topic, will elect leaders from the assigned
> replicas written in /brokers/topics/uattoqaaa.default and then create
> /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state.
>
> If you have created the topic for a long time but
> /brokers/topics/uattoqaaa.default/partitions/[partition-id]/state is not
> created by controller, it could because the replicas specified in
> /brokers/topics/uattoqaaa.default does not exist yet. Could you verify the
> brokers specified in this path are up and running?
>
> Guozhang
>
>
> On Tue, Aug 20, 2013 at 12:14 PM, Yu, Libo <[EMAIL PROTECTED]> wrote:
>
> > One more question:
> > "The create topic command will not immediately create the path; it
> > will be created by the controller later during the creation of
> > partitions and assign replicas to partitions."
> >
> > So when will the controller create the path and partitions? When the
> > first message is published to the topic and partition?
> > All the partitions are created at once?
> >
> > Regards,
> >
> > Libo
> >
> >
> > -----Original Message-----
> > From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> > Sent: Tuesday, August 20, 2013 1:48 PM
> > To: [EMAIL PROTECTED]
> > Subject: Re: issue with kafka-preferred-replica-election.sh
> >
> > Could you check that before you run
> > kafka-preferred-replica-election.sh
> > the /brokers/topics/uattoqaaa.default/partitions Node has been created
> > or not?
> > The create topic command will not immediately create the path; it will
> > be created by the controller later during the creation of partitions
> > and assign replicas to partitions. If you start the election command
> > right after the create topic tool, it might not be created yet.
> >
> > Guozhang
> >
> >
> > On Tue, Aug 20, 2013 at 10:24 AM, Yu, Libo <[EMAIL PROTECTED]> wrote:
> >
> > > It is created with 3 partitions.
> > >
> > > Regards,
> > >
> > > Libo
> > >
> > >
> > > -----Original Message-----
> > > From: Guozhang Wang [mailto:[EMAIL PROTECTED]]
> > > Sent: Tuesday, August 20, 2013 12:21 PM
> > > To: [EMAIL PROTECTED]
> > > Subject: Re: issue with kafka-preferred-replica-election.sh
> > >
> > > Hello Libo,
> > >
> > > Before you call the kafka-preferred-replica-election.sh have you
> > > already created the topic uattoqaaa.default with the number of
> > partitions?
> > >
> > > Guozhang
> > >
> > >
> > > On Tue, Aug 20, 2013 at 8:35 AM, Yu, Libo <[EMAIL PROTECTED]> wrote:
> > >
> > > > Hi,
> > > >
> > > > I tried to run kafka-preferred-replica-election.sh on our kafka
> > cluster.
> > > > But I got this expection:
> > > > Failed to start preferred replica election
> > > > org.I0Itec.zkclient.exception.ZkNoNodeException:
> > > > org.apache.zookeeper.KeeperException$NoNodeException:
> > > > KeeperErrorCode = NoNode for
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB