Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Kafka cannot produce message


Copy link to this message
-
Re: Kafka cannot produce message
Any error in the controller and state-change log?

Thanks,

Jun
On Thu, Oct 10, 2013 at 9:38 PM, Jiang Jacky <[EMAIL PROTECTED]> wrote:

> Hi, Aniket
> Thanks for your reply
> I checked the log from /tmp/kafka-logs/
> There are some empty files, likes 00000000000000000000.index,
> 00000000000000000000.log. I cannot find any useful information there.
> However, i found some other interesting things, I have posted here
> https://mail.google.com/mail/ca/u/0/#label/TechDiscuss/141a5c074641dd70
> Please have a look. Thanks a lot.
>
>
> 2013/10/11 Aniket Bhatnagar <[EMAIL PROTECTED]>
>
> > Hi Jiang
> >
> > Just thinking out loud, it could be because Kafka can't connect to
> > Zookeeper. Can you check Kafka logs to validate the same?
> >
> >
> > On 11 October 2013 08:22, Jiang Jacky <[EMAIL PROTECTED]> wrote:
> >
> > > Hi, Everyone, I use the larger memory instance to replace that small
> one,
> > > for now, I can create the topic, but when I try to produce message, it
> > > still gives the same error.
> > > Its so weird. can any one help me? Thanks
> > >
> > >
> > > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > >
> > > > Another thing need is my instance comes with very small memory, just
> > > 683M,
> > > > I am not sure if it is related. I will try to use 8G memory instance.
> > > >
> > > >
> > > > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > >
> > > >> yes, even I cannot create new topic, same error, leadernotavailable.
> > > >> My zookeeper and storm all are working very well, except of Kafka.
> > > >>
> > > >>
> > > >> 2013/10/10 Neha Narkhede <[EMAIL PROTECTED]>
> > > >>
> > > >>> Are you trying to produce these messages to a newly created topic?
> > > >>>
> > > >>>
> > > >>> On Thu, Oct 10, 2013 at 6:15 PM, Jiang Jacky <[EMAIL PROTECTED]>
> > > >>> wrote:
> > > >>>
> > > >>> > can anyone help me? Thanks a lot
> > > >>> >
> > > >>> >
> > > >>> > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> > > >>> >
> > > >>> > > Hi, I run into kafka issue recently, when I try to produce a
> > > >>> message, it
> > > >>> > > gives me follow error
> > > >>> > >
> > > >>> > > [2013-10-11 00:30:26,740] INFO Fetching metadata from broker
> > > >>> > > id:0,host:localhost,port:9092 with correlation id 47 for 1
> > topic(s)
> > > >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> > > >>> > > [2013-10-11 00:30:26,741] INFO Connected to localhost:9092 for
> > > >>> producing
> > > >>> > > (kafka.producer.SyncProducer)
> > > >>> > > [2013-10-11 00:30:26,753] INFO Disconnecting from
> localhost:9092
> > > >>> > > (kafka.producer.SyncProducer)
> > > >>> > > [2013-10-11 00:30:26,753] INFO Closing socket connection to /
> > > >>> 127.0.0.1.
> > > >>> > > (kafka.network.Processor)
> > > >>> > > [2013-10-11 00:30:26,754] WARN Error while fetching metadata
> > > >>> > > [{TopicMetadata for topic my-replicated-topic ->
> > > >>> > > No partition metadata for topic my-replicated-topic due to
> > > >>> > > kafka.common.LeaderNotAvailableException}] for topic
> > > >>> > [my-replicated-topic]:
> > > >>> > > class kafka.common.LeaderNotAvailableException
> > > >>> > >  (kafka.producer.BrokerPartitionInfo)
> > > >>> > > [2013-10-11 00:30:26,755] ERROR Failed to collate messages by
> > > topic,
> > > >>> > > partition due to: Failed to fetch topic metadata for topic:
> > > >>> > > my-replicated-topic (kafka.producer.async.DefaultEventHandler)
> > > >>> > > [2013-10-11 00:30:26,755] INFO Back off for 100 ms before
> > retrying
> > > >>> send.
> > > >>> > > Remaining retries = 0
> (kafka.producer.async.DefaultEventHandler)
> > > >>> > > [2013-10-11 00:30:26,856] INFO Fetching metadata from broker
> > > >>> > > id:0,host:localhost,port:9092 with correlation id 48 for 1
> > topic(s)
> > > >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> > > >>> > > [2013-10-11 00:30:26,857] INFO Connected to localhost:9092 for
> > > >>> producing
> > > >>> > > (kafka.producer.SyncProducer)
> > > >>> > > [2013-10-11 00:30:26,874] INFO Disconnecting from

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB