We use 30k as the limit. It is largely driven by the number of partitions
(including replicas), retention period and number of
simultaneous producers/consumers.

In your case it seems you have 150 topics, 36 partitions, 3x replication -
with that configuration you will definitely need to up your file handle
limit.

Thanks,

Joel

On Wednesday, August 14, 2013, Vadim Keylis wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB