Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> GZIPCompressionCodec


Copy link to this message
-
GZIPCompressionCodec
Guys I am getting loads of these exceptions.  I am currently pushing loads of data through and still getting my head wrapped around how to debug issues like this.  Anyone have a clue what might be going on here?

using: kafka-0.7.1-incubating-candidate-2
  
kafka.message.InvalidMessageException: message is invalid, compression codec: GZIPCompressionCodec size: 63426 curr offset: 0 init offset: 0
   at kafka.message.ByteBufferMessageSet$$anon$1.makeNextOuter(ByteBufferMessageSet.scala:130)
   at kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:166)
   at kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:100)
   at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:59)
   at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:51)
   at scala.collection.Iterator$class.foreach(Iterator.scala:631)
   at kafka.utils.IteratorTemplate.foreach(IteratorTemplate.scala:30)
   at scala.collection.IterableLike$class.foreach(IterableLike.scala:79)
   at kafka.message.MessageSet.foreach(MessageSet.scala:87)
  --
   at scala.collection.mutable.ArrayOps.foreach(ArrayOps.scala:34)
   at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
   at scala.collection.mutable.ArrayOps.map(ArrayOps.scala:34)
   at kafka.server.KafkaRequestHandlers.handleMultiProducerRequest(KafkaRequestHandlers.scala:62)
   at kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$4.apply(KafkaRequestHandlers.scala:41)
   at kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$4.apply(KafkaRequestHandlers.scala:41)
   at kafka.network.Processor.handle(SocketServer.scala:296)
   at kafka.network.Processor.read(SocketServer.scala:319)
   at kafka.network.Processor.run(SocketServer.scala:214)
   at java.lang.Thread.run(Thread.java:619)
+
jjian fan 2012-08-13, 09:21
+
Corbin Hoenes 2012-08-16, 03:35
+
Neha Narkhede 2012-08-16, 04:33
+
Corbin Hoenes 2012-08-16, 04:47
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB