On Wed, Nov 13, 2013 at 11:54:07AM -0800, [EMAIL PROTECTED] wrote:

Depending on your CPU-specs you should be able to add threads to scale
out - but yes if you want to scale out even more you would want more
instances on more nodes provided there are sufficient partitions to
load balance.
The high-level consumer has a heavy dependence on zookeeper - so yes
there is a bottleneck there especially if each consumer consumes a lot
of topics. This will be addressed to a large degree by the client
rewrite; consumer coordinator approach
and in-built offset management

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB