Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Kafka cannot produce message


Copy link to this message
-
Re: Kafka cannot produce message
Jun Rao 2013-10-11, 04:51
Any error in the controller and state-change log?

Thanks,

Jun
On Thu, Oct 10, 2013 at 9:38 PM, Jiang Jacky <[EMAIL PROTECTED]> wrote:

> Hi, Aniket
> Thanks for your reply
> I checked the log from /tmp/kafka-logs/
> There are some empty files, likes 00000000000000000000.index,
> 00000000000000000000.log. I cannot find any useful information there.
> However, i found some other interesting things, I have posted here
> https://mail.google.com/mail/ca/u/0/#label/TechDiscuss/141a5c074641dd70
> Please have a look. Thanks a lot.
>
>
> 2013/10/11 Aniket Bhatnagar <[EMAIL PROTECTED]>
>
> > Hi Jiang
> >
> > Just thinking out loud, it could be because Kafka can't connect to
> > Zookeeper. Can you check Kafka logs to validate the same?
> >
> >
> > On 11 October 2013 08:22, Jiang Jacky <[EMAIL PROTECTED]> wrote:
> >
> > > Hi, Everyone, I use the larger memory instance to replace that small
> one,
> > > for now, I can create the topic, but when I try to produce message, it
> > > still gives the same error.
> > > Its so weird. can any one help me? Thanks
> > >
> > >
> > > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > >
> > > > Another thing need is my instance comes with very small memory, just
> > > 683M,
> > > > I am not sure if it is related. I will try to use 8G memory instance.
> > > >
> > > >
> > > > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > >
> > > >> yes, even I cannot create new topic, same error, leadernotavailable.
> > > >> My zookeeper and storm all are working very well, except of Kafka.
> > > >>
> > > >>
> > > >> 2013/10/10 Neha Narkhede <[EMAIL PROTECTED]>
> > > >>
> > > >>> Are you trying to produce these messages to a newly created topic?
> > > >>>
> > > >>>
> > > >>> On Thu, Oct 10, 2013 at 6:15 PM, Jiang Jacky <[EMAIL PROTECTED]>
> > > >>> wrote:
> > > >>>
> > > >>> > can anyone help me? Thanks a lot
> > > >>> >
> > > >>> >
> > > >>> > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > >>> >
> > > >>> > > Hi, I run into kafka issue recently, when I try to produce a
> > > >>> message, it
> > > >>> > > gives me follow error
> > > >>> > >
> > > >>> > > [2013-10-11 00:30:26,740] INFO Fetching metadata from broker
> > > >>> > > id:0,host:localhost,port:9092 with correlation id 47 for 1
> > topic(s)
> > > >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> > > >>> > > [2013-10-11 00:30:26,741] INFO Connected to localhost:9092 for
> > > >>> producing
> > > >>> > > (kafka.producer.SyncProducer)
> > > >>> > > [2013-10-11 00:30:26,753] INFO Disconnecting from
> localhost:9092
> > > >>> > > (kafka.producer.SyncProducer)
> > > >>> > > [2013-10-11 00:30:26,753] INFO Closing socket connection to /
> > > >>> 127.0.0.1.
> > > >>> > > (kafka.network.Processor)
> > > >>> > > [2013-10-11 00:30:26,754] WARN Error while fetching metadata
> > > >>> > > [{TopicMetadata for topic my-replicated-topic ->
> > > >>> > > No partition metadata for topic my-replicated-topic due to
> > > >>> > > kafka.common.LeaderNotAvailableException}] for topic
> > > >>> > [my-replicated-topic]:
> > > >>> > > class kafka.common.LeaderNotAvailableException
> > > >>> > >  (kafka.producer.BrokerPartitionInfo)
> > > >>> > > [2013-10-11 00:30:26,755] ERROR Failed to collate messages by
> > > topic,
> > > >>> > > partition due to: Failed to fetch topic metadata for topic:
> > > >>> > > my-replicated-topic (kafka.producer.async.DefaultEventHandler)
> > > >>> > > [2013-10-11 00:30:26,755] INFO Back off for 100 ms before
> > retrying
> > > >>> send.
> > > >>> > > Remaining retries = 0
> (kafka.producer.async.DefaultEventHandler)
> > > >>> > > [2013-10-11 00:30:26,856] INFO Fetching metadata from broker
> > > >>> > > id:0,host:localhost,port:9092 with correlation id 48 for 1
> > topic(s)
> > > >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> > > >>> > > [2013-10-11 00:30:26,857] INFO Connected to localhost:9092 for
> > > >>> producing
> > > >>> > > (kafka.producer.SyncProducer)
> > > >>> > > [2013-10-11 00:30:26,874] INFO Disconnecting from