Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - In 0.8, can a single broker be configured to run without Zookeeper?


+
Hargett, Phil 2013-03-18, 13:52
Copy link to this message
-
Re: In 0.8, can a single broker be configured to run without Zookeeper?
Jun Rao 2013-03-18, 16:36
Phil,

In 0.8, the broker always depends on ZK. So, this is no longer optional.
You can still run a single node broker with replication factor set to 1
though.

Actually, in 0.7, MirrorMaker depends on ZK to consume data in a broker.
So, how did you get the data from the local broker out without ZK?

Thanks,

Jun

On Mon, Mar 18, 2013 at 6:52 AM, Hargett, Phil <
[EMAIL PROTECTED]> wrote:

> While the replication features in 0.8 are very desirable for us, one
> aspect of 0.7 that was also appealing was that in specific scenarios a
> single broker instance could run by itself without an accompanying
> Zookeeper.
>
> This provided a lightweight "entry point" for log flows by running lots of
> single-instance Kafka brokers for local durability, then running other code
> (like MirrorMaker) to propagate local data from those single-instance
> brokers to shared broker clusters for further processing by other
> applications.
>
> Is this scenario no longer achievable with 0.8? Will it be on the roadmap
> again?

 
+
Hargett, Phil 2013-03-18, 19:12