Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> kafka broker re-register

Copy link to this message
Re: Re: kafka broker re-register
Zookeeper session can expire due to a variety of reasons ranging from
network connectivity to JVM garbage collections. I would start by
looking into the latter at the client as well as server side.
To answer your 2nd question, once the broker establishes a new
session, it re-registers topics from internal process cache.


On Sun, Nov 11, 2012 at 7:24 PM,  <[EMAIL PROTECTED]> wrote:
>  Thanks to Jun Dao,
>  There were ZK session expireations in the broker log. Are the expireations according to network delay?
>  I want to know if the broker re-register to ZK, the topics is coming from reading disk or reading ram that cache topics info?
> ----- Original Message -----
> From: Jun Rao <[EMAIL PROTECTED]>
> Subject: Re: kafka broker re-register
> Date: 2012-11-09 23:28
> Were there ZK session expirations in the broker log? Broker registers when ZK session expires.
> Thanks,
> Jun
> On Fri, Nov 9, 2012 at 1:24 AM,  <[EMAIL PROTECTED]> wrote:
>  Hi, allI have some problem with using kafka-0.7.1.  I use a cluster with 4 brokers. They are runing well before.However, I found all brokers re-registered to zk yesterday. The log is blow:[2012-11-08 09:58:17,805] INFO re-registering broker info in ZK for broker 2 (kafka.server.KafkaZooKeeper)[2012-11-08 09:58:17,944] INFO re-registering broker topics in ZK for broker 2 (kafka.server.KafkaZooKeeper)......
> I want to know why the brokers re-register?I had deleted some topics in ZK that are not used now. But I had not delete data with these topics on the brokers.So, this re-registry bring these topics that had been deleted into ZK again.
> If I delete these data with these topics on the broker, and delete these topics in ZK, but I do not restart brokers.When the brokers re-register again, the brokers will bring these topics(had been deleted) into ZK ?The brokers get info of topics from ram or disk?
> Thanks All.