We need to try the one with filters, thanks.  We found that if you commitOffsets, after each msg, it works.  The IO is not bad.

- charlie
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB