Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> GZIPCompressionCodec


Copy link to this message
-
GZIPCompressionCodec
Guys I am getting loads of these exceptions.  I am currently pushing loads of data through and still getting my head wrapped around how to debug issues like this.  Anyone have a clue what might be going on here?

using: kafka-0.7.1-incubating-candidate-2
  
kafka.message.InvalidMessageException: message is invalid, compression codec: GZIPCompressionCodec size: 63426 curr offset: 0 init offset: 0
   at kafka.message.ByteBufferMessageSet$$anon$1.makeNextOuter(ByteBufferMessageSet.scala:130)
   at kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:166)
   at kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:100)
   at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:59)
   at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:51)
   at scala.collection.Iterator$class.foreach(Iterator.scala:631)
   at kafka.utils.IteratorTemplate.foreach(IteratorTemplate.scala:30)
   at scala.collection.IterableLike$class.foreach(IterableLike.scala:79)
   at kafka.message.MessageSet.foreach(MessageSet.scala:87)
  --
   at scala.collection.mutable.ArrayOps.foreach(ArrayOps.scala:34)
   at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
   at scala.collection.mutable.ArrayOps.map(ArrayOps.scala:34)
   at kafka.server.KafkaRequestHandlers.handleMultiProducerRequest(KafkaRequestHandlers.scala:62)
   at kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$4.apply(KafkaRequestHandlers.scala:41)
   at kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$4.apply(KafkaRequestHandlers.scala:41)
   at kafka.network.Processor.handle(SocketServer.scala:296)
   at kafka.network.Processor.read(SocketServer.scala:319)
   at kafka.network.Processor.run(SocketServer.scala:214)
   at java.lang.Thread.run(Thread.java:619)