Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> InvalidMessageException


+
Yonghui Zhao 2013-05-30, 03:08
Copy link to this message
-
Re: InvalidMessageException
Hi Yonghui,

We see this exception too. We believe this is related to the jdk versions.
In our case, the exception only happens on heavy workload, and after we
upgrade the jdk version , it is gone.

Currently, we use jdk1.6_35. I suggest you to try this.

Best

Guodong
On Thu, May 30, 2013 at 11:07 AM, Yonghui Zhao <[EMAIL PROTECTED]>wrote:

> Hi,
>
> I am using kafka 0.7.2, do you see this exception?   What's the possible
> reason?
>
> 2013/05/29 19:18:19.325 ERROR [KafkaRequestHandlers] [] Error processing
> ProduceRequest on gallery:0
> kafka.message.InvalidMessageException: message is invalid, compression
> codec: NoCompressionCodec size: 222 curr offset: 0 init offset: 0
>         at
>
> kafka.message.ByteBufferMessageSet$$anon$1.makeNextOuter(ByteBufferMessageSet.scala:130)
>         at
>
> kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:160)
>         at
>
> kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:100)
>         at
> kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:59)
>         at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:51)
>         at
>
> kafka.message.ByteBufferMessageSet.verifyMessageSize(ByteBufferMessageSet.scala:89)
>         at kafka.log.Log.append(Log.scala:218)
>         at
>
> kafka.server.KafkaRequestHandlers.kafka$server$KafkaRequestHandlers$$handleProducerRequest(KafkaRequestHandlers.scala:69)
>         at
>
> kafka.server.KafkaRequestHandlers.handleProducerRequest(KafkaRequestHandlers.scala:53)
>         at
>
> kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$1.apply(KafkaRequestHandlers.scala:38)
>         at
>
> kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$1.apply(KafkaRequestHandlers.scala:38)
>         at kafka.network.Processor.handle(SocketServer.scala:296)
>         at kafka.network.Processor.read(SocketServer.scala:319)
>         at kafka.network.Processor.run(SocketServer.scala:214)
>         at java.lang.Thread.run(Thread.java:679)
>

 
+
Yonghui Zhao 2013-05-30, 06:00
+
Jason Weiss 2013-05-30, 03:24