Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Kafka cannot produce message


Copy link to this message
-
Re: Kafka cannot produce message
under logs/.

Thanks,

Jun
On Thu, Oct 10, 2013 at 9:56 PM, Jiang Jacky <[EMAIL PROTECTED]> wrote:

> Thanks Jun Rao
> Where can I find those logs?
>
>
> 2013/10/11 Jun Rao <[EMAIL PROTECTED]>
>
> > Any error in the controller and state-change log?
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Thu, Oct 10, 2013 at 9:38 PM, Jiang Jacky <[EMAIL PROTECTED]>
> wrote:
> >
> > > Hi, Aniket
> > > Thanks for your reply
> > > I checked the log from /tmp/kafka-logs/
> > > There are some empty files, likes 00000000000000000000.index,
> > > 00000000000000000000.log. I cannot find any useful information there.
> > > However, i found some other interesting things, I have posted here
> > >
> https://mail.google.com/mail/ca/u/0/#label/TechDiscuss/141a5c074641dd70
> > > Please have a look. Thanks a lot.
> > >
> > >
> > > 2013/10/11 Aniket Bhatnagar <[EMAIL PROTECTED]>
> > >
> > > > Hi Jiang
> > > >
> > > > Just thinking out loud, it could be because Kafka can't connect to
> > > > Zookeeper. Can you check Kafka logs to validate the same?
> > > >
> > > >
> > > > On 11 October 2013 08:22, Jiang Jacky <[EMAIL PROTECTED]> wrote:
> > > >
> > > > > Hi, Everyone, I use the larger memory instance to replace that
> small
> > > one,
> > > > > for now, I can create the topic, but when I try to produce message,
> > it
> > > > > still gives the same error.
> > > > > Its so weird. can any one help me? Thanks
> > > > >
> > > > >
> > > > > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > > >
> > > > > > Another thing need is my instance comes with very small memory,
> > just
> > > > > 683M,
> > > > > > I am not sure if it is related. I will try to use 8G memory
> > instance.
> > > > > >
> > > > > >
> > > > > > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > > > >
> > > > > >> yes, even I cannot create new topic, same error,
> > leadernotavailable.
> > > > > >> My zookeeper and storm all are working very well, except of
> Kafka.
> > > > > >>
> > > > > >>
> > > > > >> 2013/10/10 Neha Narkhede <[EMAIL PROTECTED]>
> > > > > >>
> > > > > >>> Are you trying to produce these messages to a newly created
> > topic?
> > > > > >>>
> > > > > >>>
> > > > > >>> On Thu, Oct 10, 2013 at 6:15 PM, Jiang Jacky <
> > [EMAIL PROTECTED]>
> > > > > >>> wrote:
> > > > > >>>
> > > > > >>> > can anyone help me? Thanks a lot
> > > > > >>> >
> > > > > >>> >
> > > > > >>> > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > > > >>> >
> > > > > >>> > > Hi, I run into kafka issue recently, when I try to produce
> a
> > > > > >>> message, it
> > > > > >>> > > gives me follow error
> > > > > >>> > >
> > > > > >>> > > [2013-10-11 00:30:26,740] INFO Fetching metadata from
> broker
> > > > > >>> > > id:0,host:localhost,port:9092 with correlation id 47 for 1
> > > > topic(s)
> > > > > >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> > > > > >>> > > [2013-10-11 00:30:26,741] INFO Connected to localhost:9092
> > for
> > > > > >>> producing
> > > > > >>> > > (kafka.producer.SyncProducer)
> > > > > >>> > > [2013-10-11 00:30:26,753] INFO Disconnecting from
> > > localhost:9092
> > > > > >>> > > (kafka.producer.SyncProducer)
> > > > > >>> > > [2013-10-11 00:30:26,753] INFO Closing socket connection
> to /
> > > > > >>> 127.0.0.1.
> > > > > >>> > > (kafka.network.Processor)
> > > > > >>> > > [2013-10-11 00:30:26,754] WARN Error while fetching
> metadata
> > > > > >>> > > [{TopicMetadata for topic my-replicated-topic ->
> > > > > >>> > > No partition metadata for topic my-replicated-topic due to
> > > > > >>> > > kafka.common.LeaderNotAvailableException}] for topic
> > > > > >>> > [my-replicated-topic]:
> > > > > >>> > > class kafka.common.LeaderNotAvailableException
> > > > > >>> > >  (kafka.producer.BrokerPartitionInfo)
> > > > > >>> > > [2013-10-11 00:30:26,755] ERROR Failed to collate messages
> by
> > > > > topic,
> > > > > >>> > > partition due to: Failed to fetch topic metadata for topic:
> > > > > >>> > > my-replicated-topic
> > (kafka.producer.async.DefaultEventHandler)

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB