That is a good suggestion. Some of us started thinking about re-designing
the consumer client a while ago and wrote up some ideas here -
In addition to this, we have a working prototype of stage 1 of that
re-design here

Besides this, work has started on scaling the offset storage for the
consumer as part of this JIRA - It is true that the team
is currently focussed on developing and stabilizing replication, but we
welcome ideas and contribution to the consumer client re-design project as

On Fri, Dec 21, 2012 at 5:44 PM, Tom Brown <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB