Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> version of zookeeper


Copy link to this message
-
Re: version of zookeeper
According to the zookeeper home page, the current stable releases are
"3.3.6" and "3.4.4".

There seem to be a few interesting bug fixes in the release notes for 3.3.5
& 3.3.6:
http://zookeeper.apache.org/doc/r3.3.5/releasenotes.html#changes
http://zookeeper.apache.org/doc/r3.3.6/releasenotes.html#changes

Notably fixes for:
  leaking file handles
  data inconsistencies and unexpired ephemeral nodes after cluster restart
  shutdown synchronization

But, I have not been using kafka long enough to see these issues myself.

On Tue, Nov 13, 2012 at 3:29 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:

> > So, there are known api changes that would preclude use of 3.4.x with
> > kafka, it sounds like?
>
> Not really. Zookeeper 3.4.x is backwards compatible. Kafka 0.8 should
> still work with any of the stable zookeeper versions out there. Once
> ZK 3.4.x is stable, Kafka 0.8 would certainly benefit from the multi
> APIs, since instead of doing one write per partition, we can do one
> write for all partitions.
>
> > Is there a notion of a supported version of zookeeper for each kafka
> > release?
>
> Not formally, though this sounds like a good idea. Implicitly, we
> consider the zk version we release with as stable.
>
> > How about upgrading the recommended version for 0.8 at least to the
> latest
> > 3.3.x (3.3.6)?
>
> Yes, do you have an idea about any particular bugs that were fixed
> post 3.3.4 which could be useful ?
>
> Thanks,
> Neha
>
> On Tue, Nov 13, 2012 at 9:54 AM, Jason Rosenberg <[EMAIL PROTECTED]> wrote:
> > Ok,
> >
> > So, there are known api changes that would preclude use of 3.4.x with
> > kafka, it sounds like?
> >
> > Is there a notion of a supported version of zookeeper for each kafka
> > release?
> >
> > How about upgrading the recommended version for 0.8 at least to the
> latest
> > 3.3.x (3.3.6)?
> >
> > Jason
> >
> >
> >
> > On Tue, Nov 13, 2012 at 8:50 AM, Neha Narkhede <[EMAIL PROTECTED]
> >wrote:
> >
> >> I've been observing the zookeeper mailing list for 3.4.x and haven't
> >> found it to be particularly stable. There are still serious issues
> >> being reported like leader election failures, ephemeral node deletion.
> >> I'm sure they are being fixed and there are many early adopters. But
> >> my guess is that we should probably release 0.8 on a proven stable
> >> version and look into 3.4.x for Kafka 0.8.1.
> >>
> >> Thanks,
> >> Neha
> >>
> >> On Tue, Nov 13, 2012 at 6:57 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> >> > Jason,
> >> >
> >> > We are just not sure about the stability of ZK 3.4.4. Does anybody
> know?
> >> In
> >> > fact, some of the features in ZK 3.4.x (like the multi operation) can
> >> > improve the availability of Kafka in 0.8. So, we'd like to move to ZK
> >> 3.4.4
> >> > if it's been widely used and is stable.
> >> >
> >> > Thanks,
> >> >
> >> > Jun
> >> >
> >> > On Mon, Nov 12, 2012 at 11:30 PM, Jason Rosenberg <[EMAIL PROTECTED]>
> >> wrote:
> >> >
> >> >> Hi,
> >> >>
> >> >> I'm wondering if there's a reason kafka currently seems to depend on
> >> >> zookeeper 3.3.4.  While the current stable version for zookeeper is
> >> 3.4.4.
> >> >>
> >> >> Are there known issues with upgrading to the newer version of
> zookeeper?
> >> >>
> >> >> Jason
> >> >>
> >>
>