Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Re: bug report


Copy link to this message
-
Re: bug report
That's interesting. The issue is that we somehow are missing a
response for [libomirror8,3]
specified in the request. I don't know how this is happening in the broker
though. Are you using the latest code in the 0.8 branch?

 Incomplete response (ProducerResponse(334159,Map([libomirror8,9] ->
ProducerResponseStatus(0,96820), [libomirror8,6] ->
ProducerResponseStatus(2,0), [libomirror8,0] ->
ProducerResponseStatus(0,0)))) for producer request (Name: ProducerRequest;
Version: 0; CorrelationId: 334159; ClientId: ProducerPerformance;
RequiredAcks: -1; AckTimeoutMs: 3000 ms; TopicAndPartition: [libomirror8,9]
-> 102660,[libomirror8,6] -> 102660,[libomirror8,3] ->
102660,[libomirror8,0] -> 102660)

Thanks,

Jun
On Thu, Jun 6, 2013 at 8:17 AM, Yu, Libo <[EMAIL PROTECTED]> wrote:

> The publisher tried to publish 10G data (msg size 10k) to 3 brokers. This
> error
> occurred so frequently and caused big delay.
>
> [2013-06-06 11:13:29,491] INFO Shutting down producer
> (kafka.producer.Producer)
> [2013-06-06 11:13:29,492] INFO Beging shutting down ProducerSendThread
> (kafka.producer.async.ProducerSendThread)
> [2013-06-06 11:13:32,804] INFO Shutting down producer
> (kafka.producer.Producer)
> [2013-06-06 11:13:32,804] INFO Beging shutting down ProducerSendThread
> (kafka.producer.async.ProducerSendThread)
> [2013-06-06 11:13:33,716] WARN Failed to send producer request with
> correlation id 334159 to broker 1 with data for partitions
> [libomirror8,9],[libomirror8,6],[libomirror8,0],[libomirror8,3]
> (kafka.producer.async.DefaultEventHandler)
> kafka.common.KafkaException: Incomplete response
> (ProducerResponse(334159,Map([libomirror8,9] ->
> ProducerResponseStatus(0,96820), [libomirror8,6] ->
> ProducerResponseStatus(2,0), [libomirror8,0] ->
> ProducerResponseStatus(0,0)))) for producer request (Name: ProducerRequest;
> Version: 0; CorrelationId: 334159; ClientId: ProducerPerformance;
> RequiredAcks: -1; AckTimeoutMs: 3000 ms; TopicAndPartition: [libomirror8,9]
> -> 102660,[libomirror8,6] -> 102660,[libomirror8,3] ->
> 102660,[libomirror8,0] -> 102660)
>         at
> kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:250)
>         at
> kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$1.apply(DefaultEventHandler.scala:107)
>         at
> kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$1.apply(DefaultEventHandler.scala:101)
>         at
> scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:80)
>         at
> scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:80)
>         at scala.collection.Iterator$class.foreach(Iterator.scala:631)
>         at
> scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:161)
>         at
> scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:194)
>         at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
>         at scala.collection.mutable.HashMap.foreach(HashMap.scala:80)
>         at
> kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:101)
>         at
> kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:73)
>         at
> kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104)
>         at
> kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:87)
>         at
> kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:67)
>         at scala.collection.immutable.Stream.foreach(Stream.scala:254)
>         at
> kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:66)
>         at
> kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44)
> [2013-06-06 11:13:33,728] INFO Back off for 100 ms before retrying send.
> Remaining retries = 3 (kafka.producer.async.DefaultEventHandler)
>
>
> Regards,
>