Kafka, mail # user - Re: 0.72 Consumer: message is invalid, compression codec: NoCompressionCodec - 2014-02-11, 23:12
 Search Hadoop and all its subprojects:

Switch to Plain View
+
Jun Rao 2014-02-11, 15:45
+
vinh 2014-02-11, 20:17
Copy link to this message
-
Re: 0.72 Consumer: message is invalid, compression codec: NoCompressionCodec
Actually, looking at the code, the consumer client code can also catch this exception while iterating for messages. The fetcher thread inserts a special message before dying, which triggers an exception while client calls next message

https://github.com/apache/kafka/blob/0.7.2/core/src/main/scala/kafka/consumer/FetcherRunnable.scala#L87

So, we could create a new ConsumerConnector object when this error happens, which will re-initialize the fetcher threads.

Thanks,
Suyog

On Feb 11, 2014, at 12:16 PM, vinh <[EMAIL PROTECTED]> wrote:

 
+
Philip OToole 2014-02-11, 23:55
+
Philip OToole 2014-02-11, 01:00
+
Philip OToole 2014-02-11, 01:02
+
Jun Rao 2014-02-11, 04:39
+
Philip OToole 2014-02-11, 04:42
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB