Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> version of zookeeper


Copy link to this message
-
Re: version of zookeeper
> So, there are known api changes that would preclude use of 3.4.x with
> kafka, it sounds like?

Not really. Zookeeper 3.4.x is backwards compatible. Kafka 0.8 should
still work with any of the stable zookeeper versions out there. Once
ZK 3.4.x is stable, Kafka 0.8 would certainly benefit from the multi
APIs, since instead of doing one write per partition, we can do one
write for all partitions.

> Is there a notion of a supported version of zookeeper for each kafka
> release?

Not formally, though this sounds like a good idea. Implicitly, we
consider the zk version we release with as stable.

> How about upgrading the recommended version for 0.8 at least to the latest
> 3.3.x (3.3.6)?

Yes, do you have an idea about any particular bugs that were fixed
post 3.3.4 which could be useful ?

Thanks,
Neha

On Tue, Nov 13, 2012 at 9:54 AM, Jason Rosenberg <[EMAIL PROTECTED]> wrote:
> Ok,
>
> So, there are known api changes that would preclude use of 3.4.x with
> kafka, it sounds like?
>
> Is there a notion of a supported version of zookeeper for each kafka
> release?
>
> How about upgrading the recommended version for 0.8 at least to the latest
> 3.3.x (3.3.6)?
>
> Jason
>
>
>
> On Tue, Nov 13, 2012 at 8:50 AM, Neha Narkhede <[EMAIL PROTECTED]>wrote:
>
>> I've been observing the zookeeper mailing list for 3.4.x and haven't
>> found it to be particularly stable. There are still serious issues
>> being reported like leader election failures, ephemeral node deletion.
>> I'm sure they are being fixed and there are many early adopters. But
>> my guess is that we should probably release 0.8 on a proven stable
>> version and look into 3.4.x for Kafka 0.8.1.
>>
>> Thanks,
>> Neha
>>
>> On Tue, Nov 13, 2012 at 6:57 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
>> > Jason,
>> >
>> > We are just not sure about the stability of ZK 3.4.4. Does anybody know?
>> In
>> > fact, some of the features in ZK 3.4.x (like the multi operation) can
>> > improve the availability of Kafka in 0.8. So, we'd like to move to ZK
>> 3.4.4
>> > if it's been widely used and is stable.
>> >
>> > Thanks,
>> >
>> > Jun
>> >
>> > On Mon, Nov 12, 2012 at 11:30 PM, Jason Rosenberg <[EMAIL PROTECTED]>
>> wrote:
>> >
>> >> Hi,
>> >>
>> >> I'm wondering if there's a reason kafka currently seems to depend on
>> >> zookeeper 3.3.4.  While the current stable version for zookeeper is
>> 3.4.4.
>> >>
>> >> Are there known issues with upgrading to the newer version of zookeeper?
>> >>
>> >> Jason
>> >>
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB