Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Kafka cannot produce message


Copy link to this message
-
Re: Kafka cannot produce message
Aniket Bhatnagar 2013-10-11, 04:18
Hi Jiang

Just thinking out loud, it could be because Kafka can't connect to
Zookeeper. Can you check Kafka logs to validate the same?
On 11 October 2013 08:22, Jiang Jacky <[EMAIL PROTECTED]> wrote:

> Hi, Everyone, I use the larger memory instance to replace that small one,
> for now, I can create the topic, but when I try to produce message, it
> still gives the same error.
> Its so weird. can any one help me? Thanks
>
>
> 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
>
> > Another thing need is my instance comes with very small memory, just
> 683M,
> > I am not sure if it is related. I will try to use 8G memory instance.
> >
> >
> > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> >
> >> yes, even I cannot create new topic, same error, leadernotavailable.
> >> My zookeeper and storm all are working very well, except of Kafka.
> >>
> >>
> >> 2013/10/10 Neha Narkhede <[EMAIL PROTECTED]>
> >>
> >>> Are you trying to produce these messages to a newly created topic?
> >>>
> >>>
> >>> On Thu, Oct 10, 2013 at 6:15 PM, Jiang Jacky <[EMAIL PROTECTED]>
> >>> wrote:
> >>>
> >>> > can anyone help me? Thanks a lot
> >>> >
> >>> >
> >>> > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> >>> >
> >>> > > Hi, I run into kafka issue recently, when I try to produce a
> >>> message, it
> >>> > > gives me follow error
> >>> > >
> >>> > > [2013-10-11 00:30:26,740] INFO Fetching metadata from broker
> >>> > > id:0,host:localhost,port:9092 with correlation id 47 for 1 topic(s)
> >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> >>> > > [2013-10-11 00:30:26,741] INFO Connected to localhost:9092 for
> >>> producing
> >>> > > (kafka.producer.SyncProducer)
> >>> > > [2013-10-11 00:30:26,753] INFO Disconnecting from localhost:9092
> >>> > > (kafka.producer.SyncProducer)
> >>> > > [2013-10-11 00:30:26,753] INFO Closing socket connection to /
> >>> 127.0.0.1.
> >>> > > (kafka.network.Processor)
> >>> > > [2013-10-11 00:30:26,754] WARN Error while fetching metadata
> >>> > > [{TopicMetadata for topic my-replicated-topic ->
> >>> > > No partition metadata for topic my-replicated-topic due to
> >>> > > kafka.common.LeaderNotAvailableException}] for topic
> >>> > [my-replicated-topic]:
> >>> > > class kafka.common.LeaderNotAvailableException
> >>> > >  (kafka.producer.BrokerPartitionInfo)
> >>> > > [2013-10-11 00:30:26,755] ERROR Failed to collate messages by
> topic,
> >>> > > partition due to: Failed to fetch topic metadata for topic:
> >>> > > my-replicated-topic (kafka.producer.async.DefaultEventHandler)
> >>> > > [2013-10-11 00:30:26,755] INFO Back off for 100 ms before retrying
> >>> send.
> >>> > > Remaining retries = 0 (kafka.producer.async.DefaultEventHandler)
> >>> > > [2013-10-11 00:30:26,856] INFO Fetching metadata from broker
> >>> > > id:0,host:localhost,port:9092 with correlation id 48 for 1 topic(s)
> >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> >>> > > [2013-10-11 00:30:26,857] INFO Connected to localhost:9092 for
> >>> producing
> >>> > > (kafka.producer.SyncProducer)
> >>> > > [2013-10-11 00:30:26,874] INFO Disconnecting from localhost:9092
> >>> > > (kafka.producer.SyncProducer)
> >>> > > [2013-10-11 00:30:26,874] INFO Closing socket connection to /
> >>> 127.0.0.1.
> >>> > > (kafka.network.Processor)
> >>> > > [2013-10-11 00:30:26,875] WARN Error while fetching metadata
> >>> > > [{TopicMetadata for topic my-replicated-topic ->
> >>> > > No partition metadata for topic my-replicated-topic due to
> >>> > > kafka.common.LeaderNotAvailableException}] for topic
> >>> > [my-replicated-topic]:
> >>> > > class kafka.common.LeaderNotAvailableException
> >>> > >  (kafka.producer.BrokerPartitionInfo)
> >>> > > [2013-10-11 00:30:26,876] ERROR Failed to send requests for topics
> >>> > > my-replicated-topic with correlation ids in [41,48]
> >>> > > (kafka.producer.async.DefaultEventHandler)
> >>> > > [2013-10-11 00:30:26,876] ERROR Error in handling batch of 1 events
> >>> > > (kafka.producer.async.ProducerSendThread)