Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> In 0.8, can a single broker be configured to run without Zookeeper?


+
Hargett, Phil 2013-03-18, 13:52
Copy link to this message
-
Re: In 0.8, can a single broker be configured to run without Zookeeper?
Phil,

In 0.8, the broker always depends on ZK. So, this is no longer optional.
You can still run a single node broker with replication factor set to 1
though.

Actually, in 0.7, MirrorMaker depends on ZK to consume data in a broker.
So, how did you get the data from the local broker out without ZK?

Thanks,

Jun

On Mon, Mar 18, 2013 at 6:52 AM, Hargett, Phil <
[EMAIL PROTECTED]> wrote:

> While the replication features in 0.8 are very desirable for us, one
> aspect of 0.7 that was also appealing was that in specific scenarios a
> single broker instance could run by itself without an accompanying
> Zookeeper.
>
> This provided a lightweight "entry point" for log flows by running lots of
> single-instance Kafka brokers for local durability, then running other code
> (like MirrorMaker) to propagate local data from those single-instance
> brokers to shared broker clusters for further processing by other
> applications.
>
> Is this scenario no longer achievable with 0.8? Will it be on the roadmap
> again?

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB