Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - InvalidMessageException


+
Yonghui Zhao 2013-05-30, 03:08
Copy link to this message
-
Re: InvalidMessageException
王国栋 2013-05-30, 04:43
Hi Yonghui,

We see this exception too. We believe this is related to the jdk versions.
In our case, the exception only happens on heavy workload, and after we
upgrade the jdk version , it is gone.

Currently, we use jdk1.6_35. I suggest you to try this.

Best

Guodong
On Thu, May 30, 2013 at 11:07 AM, Yonghui Zhao <[EMAIL PROTECTED]>wrote:

> Hi,
>
> I am using kafka 0.7.2, do you see this exception?   What's the possible
> reason?
>
> 2013/05/29 19:18:19.325 ERROR [KafkaRequestHandlers] [] Error processing
> ProduceRequest on gallery:0
> kafka.message.InvalidMessageException: message is invalid, compression
> codec: NoCompressionCodec size: 222 curr offset: 0 init offset: 0
>         at
>
> kafka.message.ByteBufferMessageSet$$anon$1.makeNextOuter(ByteBufferMessageSet.scala:130)
>         at
>
> kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:160)
>         at
>
> kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:100)
>         at
> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:59)
>         at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:51)
>         at
>
> kafka.message.ByteBufferMessageSet.verifyMessageSize(ByteBufferMessageSet.scala:89)
>         at kafka.log.Log.append(Log.scala:218)
>         at
>
> kafka.server.KafkaRequestHandlers.kafka$server$KafkaRequestHandlers$$handleProducerRequest(KafkaRequestHandlers.scala:69)
>         at
>
> kafka.server.KafkaRequestHandlers.handleProducerRequest(KafkaRequestHandlers.scala:53)
>         at
>
> kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$1.apply(KafkaRequestHandlers.scala:38)
>         at
>
> kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$1.apply(KafkaRequestHandlers.scala:38)
>         at kafka.network.Processor.handle(SocketServer.scala:296)
>         at kafka.network.Processor.read(SocketServer.scala:319)
>         at kafka.network.Processor.run(SocketServer.scala:214)
>         at java.lang.Thread.run(Thread.java:679)
>

 
+
Yonghui Zhao 2013-05-30, 06:00
+
Jason Weiss 2013-05-30, 03:24