Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Topic Fetch metadata in producer


Copy link to this message
-
Re: Topic Fetch metadata in producer
Do you see the following warn messages on the producer ?
Fetching topic metadata with correlation id %d for topics [%s] from broker
[%s] failed

fetching topic metadata for topics [%s] from broker [%s] failed
On the server side -

1. could you enable DEBUG on kafka.server.KafkaApis and see if you get the
following message -

    Error while fetching topic metadata for topic %s due to %s

2. Do you see the following ERROR message on the server -

"Error while fetching metadata for partition %s"

On Wed, Oct 9, 2013 at 10:57 PM, Shafaq <[EMAIL PROTECTED]> wrote:

> I did some more debugging and found the corresponding debug message on the
> broker for topic (417topic1381383668416) in the producer:
>
> Seems like broker is removing fetcher for partition as producer throws no
> metadata for topic.
>
>
> [2013-10-09 22:41:09,529] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,3] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,532] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 3. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,533] INFO [ReplicaFetcherManager on broker 2] Removing
> fetcher for partition [417topic1381383668416,2]
> (kafka.server.ReplicaFetcherManager)
> [2013-10-09 22:41:09,534] INFO [Kafka Log on Broker 2], Completed load of
> log 417topic1381383668416-2 with log end offset 0 (kafka.log.Log)
> [2013-10-09 22:41:09,534] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,2] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,537] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 2. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,538] INFO [ReplicaFetcherManager on broker 2] Removing
> fetcher for partition [417topic1381383668416,4]
> (kafka.server.ReplicaFetcherManager)
> [2013-10-09 22:41:09,539] INFO [Kafka Log on Broker 2], Completed load of
> log 417topic1381383668416-4 with log end offset 0 (kafka.log.Log)
> [2013-10-09 22:41:09,539] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,4] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,542] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 4. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,543] INFO [ReplicaFetcherManager on broker 2] Removing
> fetcher for partition [417topic1381383668416,0]
> (kafka.server.ReplicaFetcherManager)
> [2013-10-09 22:41:09,544] INFO [Kafka Log on Broker 2], Completed load of
> log 417topic1381383668416-0 with log end offset 0 (kafka.log.Log)
> [2013-10-09 22:41:09,545] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,0] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,547] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 0. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,548] INFO [ReplicaFetcherManager on broker 2] Removing
> fetcher for partition [417topic1381383668416,1]
> (kafka.server.ReplicaFetcherManager)
> [2013-10-09 22:41:09,549] INFO [Kafka Log on Broker 2], Completed load of
> log 417topic1381383668416-1 with log end offset 0 (kafka.log.Log)
> [2013-10-09 22:41:09,549] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,1] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,551] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 1. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,552] INFO [Replica Manager on Broker 2]: Handled
> leader and isr request
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB