Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Re: bug report


Copy link to this message
-
Re: bug report
That's interesting. The issue is that we somehow are missing a
response for [libomirror8,3]
specified in the request. I don't know how this is happening in the broker
though. Are you using the latest code in the 0.8 branch?

 Incomplete response (ProducerResponse(334159,Map([libomirror8,9] ->
ProducerResponseStatus(0,96820), [libomirror8,6] ->
ProducerResponseStatus(2,0), [libomirror8,0] ->
ProducerResponseStatus(0,0)))) for producer request (Name: ProducerRequest;
Version: 0; CorrelationId: 334159; ClientId: ProducerPerformance;
RequiredAcks: -1; AckTimeoutMs: 3000 ms; TopicAndPartition: [libomirror8,9]
-> 102660,[libomirror8,6] -> 102660,[libomirror8,3] ->
102660,[libomirror8,0] -> 102660)

Thanks,

Jun
On Thu, Jun 6, 2013 at 8:17 AM, Yu, Libo <[EMAIL PROTECTED]> wrote:

> The publisher tried to publish 10G data (msg size 10k) to 3 brokers. This
> error
> occurred so frequently and caused big delay.
>
> [2013-06-06 11:13:29,491] INFO Shutting down producer
> (kafka.producer.Producer)
> [2013-06-06 11:13:29,492] INFO Beging shutting down ProducerSendThread
> (kafka.producer.async.ProducerSendThread)
> [2013-06-06 11:13:32,804] INFO Shutting down producer
> (kafka.producer.Producer)
> [2013-06-06 11:13:32,804] INFO Beging shutting down ProducerSendThread
> (kafka.producer.async.ProducerSendThread)
> [2013-06-06 11:13:33,716] WARN Failed to send producer request with
> correlation id 334159 to broker 1 with data for partitions
> [libomirror8,9],[libomirror8,6],[libomirror8,0],[libomirror8,3]
> (kafka.producer.async.DefaultEventHandler)
> kafka.common.KafkaException: Incomplete response
> (ProducerResponse(334159,Map([libomirror8,9] ->
> ProducerResponseStatus(0,96820), [libomirror8,6] ->
> ProducerResponseStatus(2,0), [libomirror8,0] ->
> ProducerResponseStatus(0,0)))) for producer request (Name: ProducerRequest;
> Version: 0; CorrelationId: 334159; ClientId: ProducerPerformance;
> RequiredAcks: -1; AckTimeoutMs: 3000 ms; TopicAndPartition: [libomirror8,9]
> -> 102660,[libomirror8,6] -> 102660,[libomirror8,3] ->
> 102660,[libomirror8,0] -> 102660)
>         at
> kafka.producer.async.DefaultEventHandler.kafka$producer$async$DefaultEventHandler$$send(DefaultEventHandler.scala:250)
>         at
> kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$1.apply(DefaultEventHandler.scala:107)
>         at
> kafka.producer.async.DefaultEventHandler$$anonfun$dispatchSerializedData$1.apply(DefaultEventHandler.scala:101)
>         at
> scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:80)
>         at
> scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:80)
>         at scala.collection.Iterator$class.foreach(Iterator.scala:631)
>         at
> scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:161)
>         at
> scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:194)
>         at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
>         at scala.collection.mutable.HashMap.foreach(HashMap.scala:80)
>         at
> kafka.producer.async.DefaultEventHandler.dispatchSerializedData(DefaultEventHandler.scala:101)
>         at
> kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:73)
>         at
> kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104)
>         at
> kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:87)
>         at
> kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.apply(ProducerSendThread.scala:67)
>         at scala.collection.immutable.Stream.foreach(Stream.scala:254)
>         at
> kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:66)
>         at
> kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44)
> [2013-06-06 11:13:33,728] INFO Back off for 100 ms before retrying send.
> Remaining retries = 3 (kafka.producer.async.DefaultEventHandler)
>
>
> Regards,
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB