Kafka, mail # user - Re: Uncompress / re-compress of messages in the message server - 2013-03-19, 06:11
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Re: Uncompress / re-compress of messages in the message server
Yes, your understanding is correct. The reason we have to recompress the
messages is to assign a unique offset to messages inside a compressed
message. Some preliminary load testing shows 30% increase in CPU, but that
is using GZIP which is known to be CPU intensive. By this week, we will
know the CPU usage for a lighter compression codec like Snappy. Will post
the results on the mailing list.

Thanks,
Neha

On Monday, March 18, 2013, Ross Black wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB