Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Stale TopicMetadata


Copy link to this message
-
Re: Stale TopicMetadata
Thanks Jun, done. I've created KAFKA-972 issue for that.

Regards
On Thu, Jul 11, 2013 at 1:16 AM, Jun Rao <[EMAIL PROTECTED]> wrote:

> That's actually not expected. We should only return live brokers to the
> client. It seems that we never clear the live broker cache in the brokers.
> This is a bug. Could you file a jira?
>
> Thanks,
>
> Jun
>
>
> On Wed, Jul 10, 2013 at 8:52 AM, Vinicius Carvalho <
> [EMAIL PROTECTED]> wrote:
>
> > Hi there. Once again, I don't think I could get the docs on another
> topic.
> >
> > So my nodejs client connects to the broker and the first thing it does is
> > store the topic metadata:
> >
> > data received
> > {
> >     "brokers": [
> >         {
> >             "nodeId": 0,
> >             "host": "10.139.245.106",
> >             "port": 9092,
> >             "byteLength": 24
> >         },
> >         {
> >             "nodeId": 1,
> >             "host": "localhost",
> >             "port": 9093,
> >             "byteLength": 19
> >         }
> >     ],
> >     "topicMetadata": [
> >         {
> >             "topicErrorCode": 0,
> >             "topicName": "foozbar",
> >             "partitions": [
> >                 {
> >                     "replicas": [
> >                         0
> >                     ],
> >                     "isr": [
> >                         0
> >                     ],
> >                     "partitionErrorCode": 0,
> >                     "partitionId": 0,
> >                     "leader": 0,
> >                     "byteLength": 26
> >                 },
> >                 {
> >                     "replicas": [
> >                         1
> >                     ],
> >                     "isr": [
> >                         1
> >                     ],
> >                     "partitionErrorCode": 0,
> >                     "partitionId": 1,
> >                     "leader": 1,
> >                     "byteLength": 26
> >                 },
> >                 {
> >                     "replicas": [
> >                         0
> >                     ],
> >                     "isr": [
> >                         0
> >                     ],
> >                     "partitionErrorCode": 0,
> >                     "partitionId": 2,
> >                     "leader": 0,
> >                     "byteLength": 26
> >                 },
> >                 {
> >                     "replicas": [
> >                         1
> >                     ],
> >                     "isr": [
> >                         1
> >                     ],
> >                     "partitionErrorCode": 0,
> >                     "partitionId": 3,
> >                     "leader": 1,
> >                     "byteLength": 26
> >                 },
> >                 {
> >                     "replicas": [
> >                         0
> >                     ],
> >                     "isr": [
> >                         0
> >                     ],
> >                     "partitionErrorCode": 0,
> >                     "partitionId": 4,
> >                     "leader": 0,
> >                     "byteLength": 26
> >                 }
> >             ],
> >             "byteLength": 145
> >         }
> >     ],
> >     "responseSize": 200,
> >     "correlationId": -1000
> > }
> >
> > Ok, so far so good. So I kill node 0 on purpose. Trying to simulate a
> > broker failure, and then I fetch metadata again:
> >
> > data received
> > {
> >     "brokers": [
> >         {
> >             "nodeId": 0,
> >             "host": "10.139.245.106",
> >             "port": 9092,
> >             "byteLength": 24
> >         },
> >         {
> >             "nodeId": 1,
> >             "host": "localhost",
> >             "port": 9093,
> >             "byteLength": 19
> >         }
> >     ],
> >     "topicMetadata": [
> >         {
> >             "topicErrorCode": 0,
> >             "topicName": "foozbar",
> >             "partitions": [
> >                 {
> >                     "replicas": [

The intuitive mind is a sacred gift and the
rational mind is a faithful servant. We have
created a society that honors the servant and
has forgotten the gift.

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB