Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Topic Fetch metadata in producer


Copy link to this message
-
Re: Topic Fetch metadata in producer
Do you see the following warn messages on the producer ?
Fetching topic metadata with correlation id %d for topics [%s] from broker
[%s] failed

fetching topic metadata for topics [%s] from broker [%s] failed
On the server side -

1. could you enable DEBUG on kafka.server.KafkaApis and see if you get the
following message -

    Error while fetching topic metadata for topic %s due to %s

2. Do you see the following ERROR message on the server -

"Error while fetching metadata for partition %s"

On Wed, Oct 9, 2013 at 10:57 PM, Shafaq <[EMAIL PROTECTED]> wrote:

> I did some more debugging and found the corresponding debug message on the
> broker for topic (417topic1381383668416) in the producer:
>
> Seems like broker is removing fetcher for partition as producer throws no
> metadata for topic.
>
>
> [2013-10-09 22:41:09,529] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,3] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,532] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 3. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,533] INFO [ReplicaFetcherManager on broker 2] Removing
> fetcher for partition [417topic1381383668416,2]
> (kafka.server.ReplicaFetcherManager)
> [2013-10-09 22:41:09,534] INFO [Kafka Log on Broker 2], Completed load of
> log 417topic1381383668416-2 with log end offset 0 (kafka.log.Log)
> [2013-10-09 22:41:09,534] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,2] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,537] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 2. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,538] INFO [ReplicaFetcherManager on broker 2] Removing
> fetcher for partition [417topic1381383668416,4]
> (kafka.server.ReplicaFetcherManager)
> [2013-10-09 22:41:09,539] INFO [Kafka Log on Broker 2], Completed load of
> log 417topic1381383668416-4 with log end offset 0 (kafka.log.Log)
> [2013-10-09 22:41:09,539] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,4] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,542] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 4. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,543] INFO [ReplicaFetcherManager on broker 2] Removing
> fetcher for partition [417topic1381383668416,0]
> (kafka.server.ReplicaFetcherManager)
> [2013-10-09 22:41:09,544] INFO [Kafka Log on Broker 2], Completed load of
> log 417topic1381383668416-0 with log end offset 0 (kafka.log.Log)
> [2013-10-09 22:41:09,545] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,0] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,547] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 0. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,548] INFO [ReplicaFetcherManager on broker 2] Removing
> fetcher for partition [417topic1381383668416,1]
> (kafka.server.ReplicaFetcherManager)
> [2013-10-09 22:41:09,549] INFO [Kafka Log on Broker 2], Completed load of
> log 417topic1381383668416-1 with log end offset 0 (kafka.log.Log)
> [2013-10-09 22:41:09,549] INFO [Log Manager on Broker 2] Created log for
> partition [417topic1381383668416,1] in /tmp/kafka-logs-3.
> (kafka.log.LogManager)
> [2013-10-09 22:41:09,551] WARN No previously checkpointed highwatermark
> value found for topic 417topic1381383668416 partition 1. Returning 0 as the
> highwatermark (kafka.server.HighwaterMarkCheckpoint)
> [2013-10-09 22:41:09,552] INFO [Replica Manager on Broker 2]: Handled
> leader and isr request
>