Hi, allI have some problem with using kafka-0.7.1.  I use a cluster with 4 brokers. They are runing well before.However, I found all brokers re-registered to zk yesterday. The log is blow:[2012-11-08 09:58:17,805] INFO re-registering broker info in ZK for broker 2 (kafka.server.KafkaZooKeeper)[2012-11-08 09:58:17,944] INFO re-registering broker topics in ZK for broker 2 (kafka.server.KafkaZooKeeper)......
I want to know why the brokers re-register?I had deleted some topics in ZK that are not used now. But I had not delete data with these topics on the brokers.So, this re-registry bring these topics that had been deleted into ZK again.
If I delete these data with these topics on the broker, and delete these topics in ZK, but I do not restart brokers.When the brokers re-register again, the brokers will bring these topics(had been deleted) into ZK ?The brokers get info of topics from ram or disk?
Thanks All.

Were there ZK session expirations in the broker log? Broker registers when
ZK session expires.

Thanks,

Jun

On Fri, Nov 9, 2012 at 1:24 AM, <[EMAIL PROTECTED]> wrote:

>  Hi, allI have some problem with using kafka-0.7.1.  I use a cluster with
> 4 brokers. They are runing well before.However, I found all brokers
> re-registered to zk yesterday. The log is blow:[2012-11-08 09:58:17,805]
> INFO re-registering broker info in ZK for broker 2
> (kafka.server.KafkaZooKeeper)[2012-11-08 09:58:17,944] INFO re-registering
> broker topics in ZK for broker 2 (kafka.server.KafkaZooKeeper)......
> I want to know why the brokers re-register?I had deleted some topics in ZK
> that are not used now. But I had not delete data with these topics on the
> brokers.So, this re-registry bring these topics that had been deleted into
> ZK again.
> If I delete these data with these topics on the broker, and delete these
> topics in ZK, but I do not restart brokers.When the brokers re-register
> again, the brokers will bring these topics(had been deleted) into ZK ?The
> brokers get info of topics from ram or disk?
> Thanks All.

Thanks to Jun Dao,

 There were ZK session expireations in the broker log. Are the expireations according to network delay?
 I want to know if the broker re-register to ZK, the topics is coming from reading disk or reading ram that cache topics info?
----- Original Message -----
From: Jun Rao <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED], [EMAIL PROTECTED]
Subject: Re: kafka broker re-register
Date: 2012-11-09 23:28

Were there ZK session expirations in the broker log? Broker registers when ZK session expires.
Thanks,
Jun

On Fri, Nov 9, 2012 at 1:24 AM,  <[EMAIL PROTECTED]> wrote:

 Hi, allI have some problem with using kafka-0.7.1.  I use a cluster with 4 brokers. They are runing well before.However, I found all brokers re-registered to zk yesterday. The log is blow:[2012-11-08 09:58:17,805] INFO re-registering broker info in ZK for broker 2 (kafka.server.KafkaZooKeeper)[2012-11-08 09:58:17,944] INFO re-registering broker topics in ZK for broker 2 (kafka.server.KafkaZooKeeper)......
I want to know why the brokers re-register?I had deleted some topics in ZK that are not used now. But I had not delete data with these topics on the brokers.So, this re-registry bring these topics that had been deleted into ZK again.
If I delete these data with these topics on the broker, and delete these topics in ZK, but I do not restart brokers.When the brokers re-register again, the brokers will bring these topics(had been deleted) into ZK ?The brokers get info of topics from ram or disk?
Thanks All.

Zookeeper session can expire due to a variety of reasons ranging from
network connectivity to JVM garbage collections. I would start by
looking into the latter at the client as well as server side.
To answer your 2nd question, once the broker establishes a new
session, it re-registers topics from internal process cache.

Thanks,
Neha

On Sun, Nov 11, 2012 at 7:24 PM,  <[EMAIL PROTECTED]> wrote:
>  Thanks to Jun Dao,
>
>  There were ZK session expireations in the broker log. Are the expireations according to network delay?
>  I want to know if the broker re-register to ZK, the topics is coming from reading disk or reading ram that cache topics info?
> ----- Original Message -----
> From: Jun Rao <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED], [EMAIL PROTECTED]
> Subject: Re: kafka broker re-register
> Date: 2012-11-09 23:28
>
> Were there ZK session expirations in the broker log? Broker registers when ZK session expires.
> Thanks,
> Jun
>
> On Fri, Nov 9, 2012 at 1:24 AM,  <[EMAIL PROTECTED]> wrote:
>
>  Hi, allI have some problem with using kafka-0.7.1.  I use a cluster with 4 brokers. They are runing well before.However, I found all brokers re-registered to zk yesterday. The log is blow:[2012-11-08 09:58:17,805] INFO re-registering broker info in ZK for broker 2 (kafka.server.KafkaZooKeeper)[2012-11-08 09:58:17,944] INFO re-registering broker topics in ZK for broker 2 (kafka.server.KafkaZooKeeper)......
>
>
> I want to know why the brokers re-register?I had deleted some topics in ZK that are not used now. But I had not delete data with these topics on the brokers.So, this re-registry bring these topics that had been deleted into ZK again.
>
>
> If I delete these data with these topics on the broker, and delete these topics in ZK, but I do not restart brokers.When the brokers re-register again, the brokers will bring these topics(had been deleted) into ZK ?The brokers get info of topics from ram or disk?
>
>
> Thanks All.
>
>