Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Kafka cannot produce message


Copy link to this message
-
Re: Kafka cannot produce message
Hi Jiang

Just thinking out loud, it could be because Kafka can't connect to
Zookeeper. Can you check Kafka logs to validate the same?
On 11 October 2013 08:22, Jiang Jacky <[EMAIL PROTECTED]> wrote:

> Hi, Everyone, I use the larger memory instance to replace that small one,
> for now, I can create the topic, but when I try to produce message, it
> still gives the same error.
> Its so weird. can any one help me? Thanks
>
>
> 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
>
> > Another thing need is my instance comes with very small memory, just
> 683M,
> > I am not sure if it is related. I will try to use 8G memory instance.
> >
> >
> > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> >
> >> yes, even I cannot create new topic, same error, leadernotavailable.
> >> My zookeeper and storm all are working very well, except of Kafka.
> >>
> >>
> >> 2013/10/10 Neha Narkhede <[EMAIL PROTECTED]>
> >>
> >>> Are you trying to produce these messages to a newly created topic?
> >>>
> >>>
> >>> On Thu, Oct 10, 2013 at 6:15 PM, Jiang Jacky <[EMAIL PROTECTED]>
> >>> wrote:
> >>>
> >>> > can anyone help me? Thanks a lot
> >>> >
> >>> >
> >>> > 2013/10/10 Jiang Jacky <[EMAIL PROTECTED]>
> >>> >
> >>> > > Hi, I run into kafka issue recently, when I try to produce a
> >>> message, it
> >>> > > gives me follow error
> >>> > >
> >>> > > [2013-10-11 00:30:26,740] INFO Fetching metadata from broker
> >>> > > id:0,host:localhost,port:9092 with correlation id 47 for 1 topic(s)
> >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> >>> > > [2013-10-11 00:30:26,741] INFO Connected to localhost:9092 for
> >>> producing
> >>> > > (kafka.producer.SyncProducer)
> >>> > > [2013-10-11 00:30:26,753] INFO Disconnecting from localhost:9092
> >>> > > (kafka.producer.SyncProducer)
> >>> > > [2013-10-11 00:30:26,753] INFO Closing socket connection to /
> >>> 127.0.0.1.
> >>> > > (kafka.network.Processor)
> >>> > > [2013-10-11 00:30:26,754] WARN Error while fetching metadata
> >>> > > [{TopicMetadata for topic my-replicated-topic ->
> >>> > > No partition metadata for topic my-replicated-topic due to
> >>> > > kafka.common.LeaderNotAvailableException}] for topic
> >>> > [my-replicated-topic]:
> >>> > > class kafka.common.LeaderNotAvailableException
> >>> > >  (kafka.producer.BrokerPartitionInfo)
> >>> > > [2013-10-11 00:30:26,755] ERROR Failed to collate messages by
> topic,
> >>> > > partition due to: Failed to fetch topic metadata for topic:
> >>> > > my-replicated-topic (kafka.producer.async.DefaultEventHandler)
> >>> > > [2013-10-11 00:30:26,755] INFO Back off for 100 ms before retrying
> >>> send.
> >>> > > Remaining retries = 0 (kafka.producer.async.DefaultEventHandler)
> >>> > > [2013-10-11 00:30:26,856] INFO Fetching metadata from broker
> >>> > > id:0,host:localhost,port:9092 with correlation id 48 for 1 topic(s)
> >>> > > Set(my-replicated-topic) (kafka.client.ClientUtils$)
> >>> > > [2013-10-11 00:30:26,857] INFO Connected to localhost:9092 for
> >>> producing
> >>> > > (kafka.producer.SyncProducer)
> >>> > > [2013-10-11 00:30:26,874] INFO Disconnecting from localhost:9092
> >>> > > (kafka.producer.SyncProducer)
> >>> > > [2013-10-11 00:30:26,874] INFO Closing socket connection to /
> >>> 127.0.0.1.
> >>> > > (kafka.network.Processor)
> >>> > > [2013-10-11 00:30:26,875] WARN Error while fetching metadata
> >>> > > [{TopicMetadata for topic my-replicated-topic ->
> >>> > > No partition metadata for topic my-replicated-topic due to
> >>> > > kafka.common.LeaderNotAvailableException}] for topic
> >>> > [my-replicated-topic]:
> >>> > > class kafka.common.LeaderNotAvailableException
> >>> > >  (kafka.producer.BrokerPartitionInfo)
> >>> > > [2013-10-11 00:30:26,876] ERROR Failed to send requests for topics
> >>> > > my-replicated-topic with correlation ids in [41,48]
> >>> > > (kafka.producer.async.DefaultEventHandler)
> >>> > > [2013-10-11 00:30:26,876] ERROR Error in handling batch of 1 events
> >>> > > (kafka.producer.async.ProducerSendThread)

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB