Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - Kafka cannot produce message


+
Jiang Jacky 2013-10-11, 00:33
+
Jiang Jacky 2013-10-11, 01:16
+
Neha Narkhede 2013-10-11, 01:34
+
Jiang Jacky 2013-10-11, 01:41
+
Jiang Jacky 2013-10-11, 01:42
+
Jiang Jacky 2013-10-11, 02:52
+
Aniket Bhatnagar 2013-10-11, 04:18
+
Jiang Jacky 2013-10-11, 04:39
+
Jun Rao 2013-10-11, 04:51
+
Jiang Jacky 2013-10-11, 04:57
Copy link to this message
-
Re: Kafka cannot produce message
Jun Rao 2013-10-11, 05:11
under logs/.

Thanks,

Jun
On Thu, Oct 10, 2013 at 9:56 PM, Jiang Jacky <[EMAIL PROTECTED]> wrote:

> Thanks Jun Rao
> Where can I find those logs?
>
>
> 2013/10/11 Jun Rao <[EMAIL PROTECTED]>
>
> > Any error in the controller and state-change log?
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Thu, Oct 10, 2013 at 9:38 PM, Jiang Jacky <[EMAIL PROTECTED]>
> wrote:
> >
> > > Hi, Aniket
> > > Thanks for your reply
> > > I checked the log from /tmp/kafka-logs/
> > > There are some empty files, likes 00000000000000000000.index,
> > > 00000000000000000000.log. I cannot find any useful information there.
> > > However, i found some other interesting things, I have posted here
> > >
> https://mail.google.com/mail/ca/u/0/#label/TechDiscuss/141a5c074641dd70
> > > Please have a look. Thanks a lot.
> > >
> > >
> > > 2013/10/11 Aniket Bhatnagar <[EMAIL PROTECTED]>
> > >
> > > > Hi Jiang
> > > >
> > > > Just thinking out loud, it could be because Kafka can't connect to
> > > > Zookeeper. Can you check Kafka logs to validate the same?
> > > >
> > > >
> > > > On 11 October 2013 08:22, Jiang Jacky <[EMAIL PROTECTED]> wrote:
> > > >
> > > > > Hi, Everyone, I use the larger memory instance to replace that
> small
> > > one,
> > > > > for now, I can create the topic, but when I try to produce message,
> > it
> > > > > still gives the same error.
> > > > > Its so weird. can any one help me? Thanks
> > > > >
> > > > >
> > > > > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > > >
> > > > > > Another thing need is my instance comes with very small memory,
> > just
> > > > > 683M,
> > > > > > I am not sure if it is related. I will try to use 8G memory
> > instance.
> > > > > >
> > > > > >
> > > > > > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > > > >
> > > > > >> yes, even I cannot create new topic, same error,
> > leadernotavailable.
> > > > > >> My zookeeper and storm all are working very well, except of
> Kafka.
> > > > > >>
> > > > > >>
> > > > > >> 2013/10/10 Neha Narkhede <[EMAIL PROTECTED]>
> > > > > >>
> > > > > >>> Are you trying to produce these messages to a newly created
> > topic?
> > > > > >>>
> > > > > >>>
> > > > > >>> On Thu, Oct 10, 2013 at 6:15 PM, Jiang Jacky <
> > [EMAIL PROTECTED]>
> > > > > >>> wrote:
> > > > > >>>
> > > > > >>> > can anyone help me? Thanks a lot
> > > > > >>> >
> > > > > >>> >
> > > > > >>> > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > > > >>> >
> > > > > >>> > > Hi, I run into kafka issue recently, when I try to produce
> a
> > > > > >>> message, it
> > > > > >>> > > gives me follow error
> > > > > >>> > >
> > > > > >>> > > [2013-10-11 00:30:26,740] INFO Fetching metadata from
> broker
> > > > > >>> > > id:0,host:localhost,port:9092 with correlation id 47 for 1
> > > > topic(s)
> > > > > >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> > > > > >>> > > [2013-10-11 00:30:26,741] INFO Connected to localhost:9092
> > for
> > > > > >>> producing
> > > > > >>> > > (kafka.producer.SyncProducer)
> > > > > >>> > > [2013-10-11 00:30:26,753] INFO Disconnecting from
> > > localhost:9092
> > > > > >>> > > (kafka.producer.SyncProducer)
> > > > > >>> > > [2013-10-11 00:30:26,753] INFO Closing socket connection
> to /
> > > > > >>> 127.0.0.1.
> > > > > >>> > > (kafka.network.Processor)
> > > > > >>> > > [2013-10-11 00:30:26,754] WARN Error while fetching
> metadata
> > > > > >>> > > [{TopicMetadata for topic my-replicated-topic ->
> > > > > >>> > > No partition metadata for topic my-replicated-topic due to
> > > > > >>> > > kafka.common.LeaderNotAvailableException}] for topic
> > > > > >>> > [my-replicated-topic]:
> > > > > >>> > > class kafka.common.LeaderNotAvailableException
> > > > > >>> > >  (kafka.producer.BrokerPartitionInfo)
> > > > > >>> > > [2013-10-11 00:30:26,755] ERROR Failed to collate messages
> by
> > > > > topic,
> > > > > >>> > > partition due to: Failed to fetch topic metadata for topic:
> > > > > >>> > > my-replicated-topic
> > (kafka.producer.async.DefaultEventHandler)

 
+
Jiang Jacky 2013-10-11, 05:21
+
Jun Rao 2013-10-11, 15:17
+
Neha Narkhede 2013-10-11, 16:06