I was just reading this:
https://cwiki.apache.org/confluence/display/KAFKA/Performance+testing

Sounds like a solid idea!  Has this been implemented yet?  I can't seem to
find it in the source.