-S3 Archiving for Kafka topics (with Zookeeper resume)
Jibran Saithi 2013-01-31, 09:30
I know this has come up a few times, so thought I'd share a bit of code
we've been using to archive topics to S3.
Particularly unimaginatively named, but is available here:
We needed something with Zookeeper support for storing the offsets, but
didn't come across anything so I quickly put this together. For the moment
I've removed graphite stats reporting because it has a few internal
dependencies, but plan to sort that out soon.
Hope this helps,