Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Zookeeper


Copy link to this message
-
Re: Zookeeper
Chris Burroughs 2011-11-15, 01:12
+list for reference.  I'll review the replication doc again.
On 11/10/2011 08:39 PM, Jun Rao wrote:
> Both SyncProducer and SimpleConsumer will still be there. However, with
> replication, only the broker hosting the master of a partition can handle
> the read/write request. So if you send a request to a wrong host, your
> request will be rejected. Our high level producer/consumer api will be able
> to figure out the correct host from ZK.
>
> Jun
>
> On Thu, Nov 10, 2011 at 1:17 PM, Chris Burroughs
> <[EMAIL PROTECTED]>wrote:
>
>> On 11/07/2011 11:25 AM, Jun Rao wrote:
>>> Thanks for sharing this. As part of the replication work (KAFKA-50),
>>> partitions will become logical and their physical locations are
>> registered
>>> in ZK. This will make it difficult to use Kafka without ZK.
>>
>> Do you anticipate replication requiring changes to SyncProducer or
>> SimpleConsumer?  I think it's worthwhile to maintain the ability to use
>> kafka as a simple local daemon with no knowledge of the outside world.
>>
>