Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> production deployment


Copy link to this message
-
Re: production deployment
On 06/11/2012 05:09 PM, Todd Bilsborrow wrote:
> Just curious - how are folks on this list deploying Kafka in a hosted production environment? Do you just unzip/build/run in place, on every broker machine? Or is there a more binary distribution approach that people are taking?
>
> - Todd
>

At AddThis it looks something like:
 - start with latest Apache release (or svn checkout)
 - Make a new custom tarball (remove contrib, custom jars, maybe change
defaults).
 - Have a separate set of templated config files (for brokers IDs etc.)
 - rsync everywhere
 - Pass off to whatever command and control tool [1] is cool these days.
[1] fabric, capistranto, shell scripts, whatever
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB