Actually you don't need 100s GBs to reap the benefits of Kafka over Rabbit.
 Because Kafka doesn't centrally maintain state it can always manage higher
message throughput more efficiently than Rabbit even when there is no
messages persisted to disk.

However Kafka’s throughput advantage increases dramatically anytime Rabbit
needs to spill messages to disk due to random I/O.  This is shown at the
bottom in the ‘Large queues’ section of performance benchmarks Alexis
shared previously,
http://www.rabbitmq.com/blog/2012/04/25/rabbitmq-performance-measurements-part-2/.
As you can see in the last graph of 10 million messages which is less than
a GB on disk, the Rabbit throughput is capped around 10k/sec.  Beyond
throughput, with the pending release of 0.8, Kafka will also have
advantages around message guarantees and durability.

On Sun, Jun 9, 2013 at 9:58 AM, Mark <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB