Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> kafka broker re-register


Copy link to this message
-
Re: Re: kafka broker re-register
Zookeeper session can expire due to a variety of reasons ranging from
network connectivity to JVM garbage collections. I would start by
looking into the latter at the client as well as server side.
To answer your 2nd question, once the broker establishes a new
session, it re-registers topics from internal process cache.

Thanks,
Neha

On Sun, Nov 11, 2012 at 7:24 PM,  <[EMAIL PROTECTED]> wrote:
>  Thanks to Jun Dao,
>
>  There were ZK session expireations in the broker log. Are the expireations according to network delay?
>  I want to know if the broker re-register to ZK, the topics is coming from reading disk or reading ram that cache topics info?
> ----- Original Message -----
> From: Jun Rao <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED], [EMAIL PROTECTED]
> Subject: Re: kafka broker re-register
> Date: 2012-11-09 23:28
>
> Were there ZK session expirations in the broker log? Broker registers when ZK session expires.
> Thanks,
> Jun
>
> On Fri, Nov 9, 2012 at 1:24 AM,  <[EMAIL PROTECTED]> wrote:
>
>  Hi, allI have some problem with using kafka-0.7.1.  I use a cluster with 4 brokers. They are runing well before.However, I found all brokers re-registered to zk yesterday. The log is blow:[2012-11-08 09:58:17,805] INFO re-registering broker info in ZK for broker 2 (kafka.server.KafkaZooKeeper)[2012-11-08 09:58:17,944] INFO re-registering broker topics in ZK for broker 2 (kafka.server.KafkaZooKeeper)......
>
>
> I want to know why the brokers re-register?I had deleted some topics in ZK that are not used now. But I had not delete data with these topics on the brokers.So, this re-registry bring these topics that had been deleted into ZK again.
>
>
> If I delete these data with these topics on the broker, and delete these topics in ZK, but I do not restart brokers.When the brokers re-register again, the brokers will bring these topics(had been deleted) into ZK ?The brokers get info of topics from ram or disk?
>
>
> Thanks All.
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB