The 1st 0.94.5 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.5-rc0/

Signed with my code signing key: C7CFE328

0.94.5 is a bug fix release. This RC has 66 issues resolved against it, contributed by 26 individuals.
These are mostly bug fixes. Also fixed is a long standing bug in replication along with lots of random test failures.

The full list of changes is available here: https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874

Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by February 11th on whether we should release this as 0.94.5.

The release testing spreadsheet is here:
https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
(if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)

HBase continues to be actively maintained; changes are coming in at a rate of about two commits per day.
There is no slow down in this RC with 66 commits over the course of about a month.

Thanks.

-- Lars

Hi Lars,

I gave it a big try and so far I don't see any issue.

It's a bit slower than 0.94.4 (2%) but it might be related to my
tests. I will continue the performances tests and try YCSB on it if
time permit...

I have updated the spreadsheet.

So far, +1.

JM

2013/2/2, lars hofhansl <[EMAIL PROTECTED]>:
> The 1st 0.94.5 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>
> Signed with my code signing key: C7CFE328
>
> 0.94.5 is a bug fix release. This RC has 66 issues resolved against it,
> contributed by 26 individuals.
> These are mostly bug fixes. Also fixed is a long standing bug in replication
> along with lots of random test failures.
>
> The full list of changes is available here:
> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>
> Please try out the RC, check out the doc, take it for a spin, etc, and vote
> +1/-1 by February 11th on whether we should release this as 0.94.5.
>
> The release testing spreadsheet is here:
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
> (if you test this release, please add your test to this spreadsheet, so that
> we can gauge the coverage)
>
> HBase continues to be actively maintained; changes are coming in at a rate
> of about two commits per day.
> There is no slow down in this RC with 66 commits over the course of about a
> month.
>
> Thanks.
>
> -- Lars

Thanks JM,

on what workload do you see the 2% slowdown?
-- Lars

________________________________
 From: Jean-Marc Spaggiari <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
Sent: Monday, February 4, 2013 10:35 AM
Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for download
 
Hi Lars,

I gave it a big try and so far I don't see any issue.

It's a bit slower than 0.94.4 (2%) but it might be related to my
tests. I will continue the performances tests and try YCSB on it if
time permit...

I have updated the spreadsheet.

So far, +1.

JM

2013/2/2, lars hofhansl <[EMAIL PROTECTED]>:
> The 1st 0.94.5 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>
> Signed with my code signing key: C7CFE328
>
> 0.94.5 is a bug fix release. This RC has 66 issues resolved against it,
> contributed by 26 individuals.
> These are mostly bug fixes. Also fixed is a long standing bug in replication
> along with lots of random test failures.
>
> The full list of changes is available here:
> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>
> Please try out the RC, check out the doc, take it for a spin, etc, and vote
> +1/-1 by February 11th on whether we should release this as 0.94.5.
>
> The release testing spreadsheet is here:
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
> (if you test this release, please add your test to this spreadsheet, so that
> we can gauge the coverage)
>
> HBase continues to be actively maintained; changes are coming in at a rate
> of about two commits per day.
> There is no slow down in this RC with 66 commits over the course of about a
> month.
>
> Thanks.
>
> -- Lars

Hi Lars,

I saw that on the RandomSeekScanTest between 0.94.4 and 0.94.5. 2% is
not big. This might have been because some other process start while I
was running the tests.

I have just the test. I will re-run all to compare.
I have already put the results of the previous tests in the spreadsheet.

Basically,
0.94.2 => 232 lines / seconds
0.94.4 => 231 lines / seconds
0.94.5 => 227 lines / seconds.

0.94.3 gave 228.

I will update the spreadsheet when tests are done.

JM

2013/2/4, lars hofhansl <[EMAIL PROTECTED]>:
> Thanks JM,
>
> on what workload do you see the 2% slowdown?
>
>
> -- Lars
>
>
>
> ________________________________
>  From: Jean-Marc Spaggiari <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
> Sent: Monday, February 4, 2013 10:35 AM
> Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for
> download
>
> Hi Lars,
>
> I gave it a big try and so far I don't see any issue.
>
> It's a bit slower than 0.94.4 (2%) but it might be related to my
> tests. I will continue the performances tests and try YCSB on it if
> time permit...
>
> I have updated the spreadsheet.
>
> So far, +1.
>
> JM
>
> 2013/2/2, lars hofhansl <[EMAIL PROTECTED]>:
>> The 1st 0.94.5 RC is available for download at
>> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>>
>> Signed with my code signing key: C7CFE328
>>
>> 0.94.5 is a bug fix release. This RC has 66 issues resolved against it,
>> contributed by 26 individuals.
>> These are mostly bug fixes. Also fixed is a long standing bug in
>> replication
>> along with lots of random test failures.
>>
>> The full list of changes is available here:
>> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>>
>> Please try out the RC, check out the doc, take it for a spin, etc, and
>> vote
>> +1/-1 by February 11th on whether we should release this as 0.94.5.
>>
>> The release testing spreadsheet is here:
>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
>> (if you test this release, please add your test to this spreadsheet, so
>> that
>> we can gauge the coverage)
>>
>> HBase continues to be actively maintained; changes are coming in at a
>> rate
>> of about two commits per day.
>> There is no slow down in this RC with 66 commits over the course of about
>> a
>> month.
>>
>> Thanks.
>>
>> -- Lars

Are you running those tests more than once to eliminate variation?

On Tue, Feb 5, 2013 at 4:14 AM, Jean-Marc Spaggiari
<[EMAIL PROTECTED]> wrote:
> Hi Lars,
>
> I saw that on the RandomSeekScanTest between 0.94.4 and 0.94.5. 2% is
> not big. This might have been because some other process start while I
> was running the tests.
>
> I have just the test. I will re-run all to compare.
> I have already put the results of the previous tests in the spreadsheet.
>
> Basically,
> 0.94.2 => 232 lines / seconds
> 0.94.4 => 231 lines / seconds
> 0.94.5 => 227 lines / seconds.
>
> 0.94.3 gave 228.
>
> I will update the spreadsheet when tests are done.
>
> JM
>
> 2013/2/4, lars hofhansl <[EMAIL PROTECTED]>:
>> Thanks JM,
>>
>> on what workload do you see the 2% slowdown?
>>
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>>  From: Jean-Marc Spaggiari <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
>> Sent: Monday, February 4, 2013 10:35 AM
>> Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for
>> download
>>
>> Hi Lars,
>>
>> I gave it a big try and so far I don't see any issue.
>>
>> It's a bit slower than 0.94.4 (2%) but it might be related to my
>> tests. I will continue the performances tests and try YCSB on it if
>> time permit...
>>
>> I have updated the spreadsheet.
>>
>> So far, +1.
>>
>> JM
>>
>> 2013/2/2, lars hofhansl <[EMAIL PROTECTED]>:
>>> The 1st 0.94.5 RC is available for download at
>>> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>>>
>>> Signed with my code signing key: C7CFE328
>>>
>>> 0.94.5 is a bug fix release. This RC has 66 issues resolved against it,
>>> contributed by 26 individuals.
>>> These are mostly bug fixes. Also fixed is a long standing bug in
>>> replication
>>> along with lots of random test failures.
>>>
>>> The full list of changes is available here:
>>> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>>>
>>> Please try out the RC, check out the doc, take it for a spin, etc, and
>>> vote
>>> +1/-1 by February 11th on whether we should release this as 0.94.5.
>>>
>>> The release testing spreadsheet is here:
>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
>>> (if you test this release, please add your test to this spreadsheet, so
>>> that
>>> we can gauge the coverage)
>>>
>>> HBase continues to be actively maintained; changes are coming in at a
>>> rate
>>> of about two commits per day.
>>> There is no slow down in this RC with 66 commits over the course of about
>>> a
>>> month.
>>>
>>> Thanks.
>>>
>>> -- Lars

Hi J-D,

I ran them twice.

The 2nd time 0.94.2 was 1.5% faster than 0.94.5. But as you are
saying, I need to run that more to be able to get any conclusion.

Now, this morning I have setup a dedicated computer to run those
tests, have installed HBase 0.94.0 to 0.94.5 (6 versions) and scripted
6 tests in a batch file. Those tests will run for each version, and I
will do that in loop something like 3 or 4 times.

There is absolutly nothing else running on this computer. It's fully
dedicated. Slow, but dedicated ;)

I will post the results when it will be done. I'm not expecting this
to be done before Friday because of the time it's taking.

JM

2013/2/5, Jean-Daniel Cryans <[EMAIL PROTECTED]>:
> Are you running those tests more than once to eliminate variation?
>
> On Tue, Feb 5, 2013 at 4:14 AM, Jean-Marc Spaggiari
> <[EMAIL PROTECTED]> wrote:
>> Hi Lars,
>>
>> I saw that on the RandomSeekScanTest between 0.94.4 and 0.94.5. 2% is
>> not big. This might have been because some other process start while I
>> was running the tests.
>>
>> I have just the test. I will re-run all to compare.
>> I have already put the results of the previous tests in the spreadsheet.
>>
>> Basically,
>> 0.94.2 => 232 lines / seconds
>> 0.94.4 => 231 lines / seconds
>> 0.94.5 => 227 lines / seconds.
>>
>> 0.94.3 gave 228.
>>
>> I will update the spreadsheet when tests are done.
>>
>> JM
>>
>> 2013/2/4, lars hofhansl <[EMAIL PROTECTED]>:
>>> Thanks JM,
>>>
>>> on what workload do you see the 2% slowdown?
>>>
>>>
>>> -- Lars
>>>
>>>
>>>
>>> ________________________________
>>>  From: Jean-Marc Spaggiari <[EMAIL PROTECTED]>
>>> To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
>>> Sent: Monday, February 4, 2013 10:35 AM
>>> Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available
>>> for
>>> download
>>>
>>> Hi Lars,
>>>
>>> I gave it a big try and so far I don't see any issue.
>>>
>>> It's a bit slower than 0.94.4 (2%) but it might be related to my
>>> tests. I will continue the performances tests and try YCSB on it if
>>> time permit...
>>>
>>> I have updated the spreadsheet.
>>>
>>> So far, +1.
>>>
>>> JM
>>>
>>> 2013/2/2, lars hofhansl <[EMAIL PROTECTED]>:
>>>> The 1st 0.94.5 RC is available for download at
>>>> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>>>>
>>>> Signed with my code signing key: C7CFE328
>>>>
>>>> 0.94.5 is a bug fix release. This RC has 66 issues resolved against it,
>>>> contributed by 26 individuals.
>>>> These are mostly bug fixes. Also fixed is a long standing bug in
>>>> replication
>>>> along with lots of random test failures.
>>>>
>>>> The full list of changes is available here:
>>>> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>>>>
>>>> Please try out the RC, check out the doc, take it for a spin, etc, and
>>>> vote
>>>> +1/-1 by February 11th on whether we should release this as 0.94.5.
>>>>
>>>> The release testing spreadsheet is here:
>>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
>>>> (if you test this release, please add your test to this spreadsheet, so
>>>> that
>>>> we can gauge the coverage)
>>>>
>>>> HBase continues to be actively maintained; changes are coming in at a
>>>> rate
>>>> of about two commits per day.
>>>> There is no slow down in this RC with 66 commits over the course of
>>>> about
>>>> a
>>>> month.
>>>>
>>>> Thanks.
>>>>
>>>> -- Lars
>

Patch is available for:
HBASE-7771 Secure HBase Client in MR job causes tasks to wait forever

It removes the workaround from HBASE-4791 which went into 0.94.4

Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771 should go
into 0.94.5

My two cents.

On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> The 1st 0.94.5 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>
> Signed with my code signing key: C7CFE328
>
> 0.94.5 is a bug fix release. This RC has 66 issues resolved against it,
> contributed by 26 individuals.
> These are mostly bug fixes. Also fixed is a long standing bug in
> replication along with lots of random test failures.
>
> The full list of changes is available here:
> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by February 11th on whether we should release this as 0.94.5.
>
> The release testing spreadsheet is here:
>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
> (if you test this release, please add your test to this spreadsheet, so
> that we can gauge the coverage)
>
> HBase continues to be actively maintained; changes are coming in at a rate
> of about two commits per day.
> There is no slow down in this RC with 66 commits over the course of about
> a month.
>
> Thanks.
>
> -- Lars

Hi Ted,

Does it mean that 0.94.5 will not work anymore for those running
zookeeper separatly with a version < 3.4.5?

I'm running 3.4.3 in my cluster...

JM

2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> Patch is available for:
> HBASE-7771 Secure HBase Client in MR job causes tasks to wait forever
>
> It removes the workaround from HBASE-4791 which went into 0.94.4
>
> Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771 should go
> into 0.94.5
>
> My two cents.
>
> On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>
>> The 1st 0.94.5 RC is available for download at
>> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>>
>> Signed with my code signing key: C7CFE328
>>
>> 0.94.5 is a bug fix release. This RC has 66 issues resolved against it,
>> contributed by 26 individuals.
>> These are mostly bug fixes. Also fixed is a long standing bug in
>> replication along with lots of random test failures.
>>
>> The full list of changes is available here:
>> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>>
>> Please try out the RC, check out the doc, take it for a spin, etc, and
>> vote +1/-1 by February 11th on whether we should release this as 0.94.5.
>>
>> The release testing spreadsheet is here:
>>
>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
>> (if you test this release, please add your test to this spreadsheet, so
>> that we can gauge the coverage)
>>
>> HBase continues to be actively maintained; changes are coming in at a
>> rate
>> of about two commits per day.
>> There is no slow down in this RC with 66 commits over the course of about
>> a month.
>>
>> Thanks.
>>
>> -- Lars
>

This is tricky.
Is it possible to upgrade standalone zookeeper to 3.4.5 when you upgrade to
HBase 0.94.5 ?

Anyway, looks like we need some config parameter that tells us the version
of standalone zookeeper :-) so that we can decide whether the workaround
should be used.

On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:

> Hi Ted,
>
> Does it mean that 0.94.5 will not work anymore for those running
> zookeeper separatly with a version < 3.4.5?
>
> I'm running 3.4.3 in my cluster...
>
> JM
>
> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> > Patch is available for:
> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait forever
> >
> > It removes the workaround from HBASE-4791 which went into 0.94.4
> >
> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771 should go
> > into 0.94.5
> >
> > My two cents.
> >
> > On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:
> >
> >> The 1st 0.94.5 RC is available for download at
> >> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
> >>
> >> Signed with my code signing key: C7CFE328
> >>
> >> 0.94.5 is a bug fix release. This RC has 66 issues resolved against it,
> >> contributed by 26 individuals.
> >> These are mostly bug fixes. Also fixed is a long standing bug in
> >> replication along with lots of random test failures.
> >>
> >> The full list of changes is available here:
> >> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
> >>
> >> Please try out the RC, check out the doc, take it for a spin, etc, and
> >> vote +1/-1 by February 11th on whether we should release this as 0.94.5.
> >>
> >> The release testing spreadsheet is here:
> >>
> >>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
> >> (if you test this release, please add your test to this spreadsheet, so
> >> that we can gauge the coverage)
> >>
> >> HBase continues to be actively maintained; changes are coming in at a
> >> rate
> >> of about two commits per day.
> >> There is no slow down in this RC with 66 commits over the course of
> about
> >> a month.
> >>
> >> Thanks.
> >>
> >> -- Lars
> >
>

Yes, I can easily upgrade to 3.4.5, but I think some might not want to
if zookeeper is used by some other applications.

So I agree that we should consider something to detect ZK version and
decide, based on that, ifthe workaround should be used. And if this
can be done automatically instead of setting up something in the conf
files, it's even better...

2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> This is tricky.
> Is it possible to upgrade standalone zookeeper to 3.4.5 when you upgrade to
> HBase 0.94.5 ?
>
> Anyway, looks like we need some config parameter that tells us the version
> of standalone zookeeper :-) so that we can decide whether the workaround
> should be used.
>
> On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Ted,
>>
>> Does it mean that 0.94.5 will not work anymore for those running
>> zookeeper separatly with a version < 3.4.5?
>>
>> I'm running 3.4.3 in my cluster...
>>
>> JM
>>
>> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
>> > Patch is available for:
>> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait forever
>> >
>> > It removes the workaround from HBASE-4791 which went into 0.94.4
>> >
>> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771 should
>> > go
>> > into 0.94.5
>> >
>> > My two cents.
>> >
>> > On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>> >
>> >> The 1st 0.94.5 RC is available for download at
>> >> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>> >>
>> >> Signed with my code signing key: C7CFE328
>> >>
>> >> 0.94.5 is a bug fix release. This RC has 66 issues resolved against
>> >> it,
>> >> contributed by 26 individuals.
>> >> These are mostly bug fixes. Also fixed is a long standing bug in
>> >> replication along with lots of random test failures.
>> >>
>> >> The full list of changes is available here:
>> >> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>> >>
>> >> Please try out the RC, check out the doc, take it for a spin, etc, and
>> >> vote +1/-1 by February 11th on whether we should release this as
>> >> 0.94.5.
>> >>
>> >> The release testing spreadsheet is here:
>> >>
>> >>
>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
>> >> (if you test this release, please add your test to this spreadsheet,
>> >> so
>> >> that we can gauge the coverage)
>> >>
>> >> HBase continues to be actively maintained; changes are coming in at a
>> >> rate
>> >> of about two commits per day.
>> >> There is no slow down in this RC with 66 commits over the course of
>> about
>> >> a month.
>> >>
>> >> Thanks.
>> >>
>> >> -- Lars
>> >
>>
>

Auto-detection may be difficult.
0.94.5 uses the following config param for usage of multi() feature in
zookeeper 3.4 :

  <property>
    <name>hbase.zookeeper.useMulti</name>
    <value>false</value>

Since the issue HBASE-7771 tries to solve affects zookeeper 3.4.4 and later
version(s), the above config param would not suffice (for current
discussion).

Cheers

On Tue, Feb 5, 2013 at 11:40 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:

> Yes, I can easily upgrade to 3.4.5, but I think some might not want to
> if zookeeper is used by some other applications.
>
> So I agree that we should consider something to detect ZK version and
> decide, based on that, ifthe workaround should be used. And if this
> can be done automatically instead of setting up something in the conf
> files, it's even better...
>
> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> > This is tricky.
> > Is it possible to upgrade standalone zookeeper to 3.4.5 when you upgrade
> to
> > HBase 0.94.5 ?
> >
> > Anyway, looks like we need some config parameter that tells us the
> version
> > of standalone zookeeper :-) so that we can decide whether the workaround
> > should be used.
> >
> > On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
> > [EMAIL PROTECTED]> wrote:
> >
> >> Hi Ted,
> >>
> >> Does it mean that 0.94.5 will not work anymore for those running
> >> zookeeper separatly with a version < 3.4.5?
> >>
> >> I'm running 3.4.3 in my cluster...
> >>
> >> JM
> >>
> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> >> > Patch is available for:
> >> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait forever
> >> >
> >> > It removes the workaround from HBASE-4791 which went into 0.94.4
> >> >
> >> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771 should
> >> > go
> >> > into 0.94.5
> >> >
> >> > My two cents.
> >> >
> >> > On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]>
> wrote:
> >> >
> >> >> The 1st 0.94.5 RC is available for download at
> >> >> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
> >> >>
> >> >> Signed with my code signing key: C7CFE328
> >> >>
> >> >> 0.94.5 is a bug fix release. This RC has 66 issues resolved against
> >> >> it,
> >> >> contributed by 26 individuals.
> >> >> These are mostly bug fixes. Also fixed is a long standing bug in
> >> >> replication along with lots of random test failures.
> >> >>
> >> >> The full list of changes is available here:
> >> >> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
> >> >>
> >> >> Please try out the RC, check out the doc, take it for a spin, etc,
> and
> >> >> vote +1/-1 by February 11th on whether we should release this as
> >> >> 0.94.5.
> >> >>
> >> >> The release testing spreadsheet is here:
> >> >>
> >> >>
> >>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
> >> >> (if you test this release, please add your test to this spreadsheet,
> >> >> so
> >> >> that we can gauge the coverage)
> >> >>
> >> >> HBase continues to be actively maintained; changes are coming in at a
> >> >> rate
> >> >> of about two commits per day.
> >> >> There is no slow down in this RC with 66 commits over the course of
> >> about
> >> >> a month.
> >> >>
> >> >> Thanks.
> >> >>
> >> >> -- Lars
> >> >
> >>
> >
>

Lars, on an unrelated note, can we continue to commit on 0.94 branch for
0.94.6? The RC cut is complete I believe.

Ps. this is for HBASE-7748, and HBASE-7770.
Enis
On Tue, Feb 5, 2013 at 11:47 AM, Ted Yu <[EMAIL PROTECTED]> wrote:

> Auto-detection may be difficult.
> 0.94.5 uses the following config param for usage of multi() feature in
> zookeeper 3.4 :
>
>   <property>
>     <name>hbase.zookeeper.useMulti</name>
>     <value>false</value>
>
> Since the issue HBASE-7771 tries to solve affects zookeeper 3.4.4 and later
> version(s), the above config param would not suffice (for current
> discussion).
>
> Cheers
>
> On Tue, Feb 5, 2013 at 11:40 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
> > Yes, I can easily upgrade to 3.4.5, but I think some might not want to
> > if zookeeper is used by some other applications.
> >
> > So I agree that we should consider something to detect ZK version and
> > decide, based on that, ifthe workaround should be used. And if this
> > can be done automatically instead of setting up something in the conf
> > files, it's even better...
> >
> > 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> > > This is tricky.
> > > Is it possible to upgrade standalone zookeeper to 3.4.5 when you
> upgrade
> > to
> > > HBase 0.94.5 ?
> > >
> > > Anyway, looks like we need some config parameter that tells us the
> > version
> > > of standalone zookeeper :-) so that we can decide whether the
> workaround
> > > should be used.
> > >
> > > On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
> > > [EMAIL PROTECTED]> wrote:
> > >
> > >> Hi Ted,
> > >>
> > >> Does it mean that 0.94.5 will not work anymore for those running
> > >> zookeeper separatly with a version < 3.4.5?
> > >>
> > >> I'm running 3.4.3 in my cluster...
> > >>
> > >> JM
> > >>
> > >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> > >> > Patch is available for:
> > >> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait
> forever
> > >> >
> > >> > It removes the workaround from HBASE-4791 which went into 0.94.4
> > >> >
> > >> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771
> should
> > >> > go
> > >> > into 0.94.5
> > >> >
> > >> > My two cents.
> > >> >
> > >> > On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]>
> > wrote:
> > >> >
> > >> >> The 1st 0.94.5 RC is available for download at
> > >> >> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
> > >> >>
> > >> >> Signed with my code signing key: C7CFE328
> > >> >>
> > >> >> 0.94.5 is a bug fix release. This RC has 66 issues resolved against
> > >> >> it,
> > >> >> contributed by 26 individuals.
> > >> >> These are mostly bug fixes. Also fixed is a long standing bug in
> > >> >> replication along with lots of random test failures.
> > >> >>
> > >> >> The full list of changes is available here:
> > >> >> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
> > >> >>
> > >> >> Please try out the RC, check out the doc, take it for a spin, etc,
> > and
> > >> >> vote +1/-1 by February 11th on whether we should release this as
> > >> >> 0.94.5.
> > >> >>
> > >> >> The release testing spreadsheet is here:
> > >> >>
> > >> >>
> > >>
> >
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
> > >> >> (if you test this release, please add your test to this
> spreadsheet,
> > >> >> so
> > >> >> that we can gauge the coverage)
> > >> >>
> > >> >> HBase continues to be actively maintained; changes are coming in
> at a
> > >> >> rate
> > >> >> of about two commits per day.
> > >> >> There is no slow down in this RC with 66 commits over the course of
> > >> about
> > >> >> a month.
> > >> >>
> > >> >> Thanks.
> > >> >>
> > >> >> -- Lars
> > >> >
> > >>
> > >
> >
>

Francis reminded me that ZOOKEEPER-1437 is a client side fix.

So our situation is simplified: 0.94.5 ships with zookeeper 3.4.5
client. HBASE-7771 should be included.

Cheers

On Tue, Feb 5, 2013 at 11:47 AM, Ted Yu <[EMAIL PROTECTED]> wrote:

> Auto-detection may be difficult.
> 0.94.5 uses the following config param for usage of multi() feature in
> zookeeper 3.4 :
>
>   <property>
>     <name>hbase.zookeeper.useMulti</name>
>     <value>false</value>
>
> Since the issue HBASE-7771 tries to solve affects zookeeper 3.4.4 and
> later version(s), the above config param would not suffice (for current
> discussion).
>
> Cheers
>
> On Tue, Feb 5, 2013 at 11:40 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> Yes, I can easily upgrade to 3.4.5, but I think some might not want to
>> if zookeeper is used by some other applications.
>>
>> So I agree that we should consider something to detect ZK version and
>> decide, based on that, ifthe workaround should be used. And if this
>> can be done automatically instead of setting up something in the conf
>> files, it's even better...
>>
>> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
>> > This is tricky.
>> > Is it possible to upgrade standalone zookeeper to 3.4.5 when you
>> upgrade to
>> > HBase 0.94.5 ?
>> >
>> > Anyway, looks like we need some config parameter that tells us the
>> version
>> > of standalone zookeeper :-) so that we can decide whether the workaround
>> > should be used.
>> >
>> > On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
>> > [EMAIL PROTECTED]> wrote:
>> >
>> >> Hi Ted,
>> >>
>> >> Does it mean that 0.94.5 will not work anymore for those running
>> >> zookeeper separatly with a version < 3.4.5?
>> >>
>> >> I'm running 3.4.3 in my cluster...
>> >>
>> >> JM
>> >>
>> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
>> >> > Patch is available for:
>> >> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait forever
>> >> >
>> >> > It removes the workaround from HBASE-4791 which went into 0.94.4
>> >> >
>> >> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771 should
>> >> > go
>> >> > into 0.94.5
>> >> >
>> >> > My two cents.
>> >> >
>> >> > On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]>
>> wrote:
>> >> >
>> >> >> The 1st 0.94.5 RC is available for download at
>> >> >> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>> >> >>
>> >> >> Signed with my code signing key: C7CFE328
>> >> >>
>> >> >> 0.94.5 is a bug fix release. This RC has 66 issues resolved against
>> >> >> it,
>> >> >> contributed by 26 individuals.
>> >> >> These are mostly bug fixes. Also fixed is a long standing bug in
>> >> >> replication along with lots of random test failures.
>> >> >>
>> >> >> The full list of changes is available here:
>> >> >> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>> >> >>
>> >> >> Please try out the RC, check out the doc, take it for a spin, etc,
>> and
>> >> >> vote +1/-1 by February 11th on whether we should release this as
>> >> >> 0.94.5.
>> >> >>
>> >> >> The release testing spreadsheet is here:
>> >> >>
>> >> >>
>> >>
>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
>> >> >> (if you test this release, please add your test to this spreadsheet,
>> >> >> so
>> >> >> that we can gauge the coverage)
>> >> >>
>> >> >> HBase continues to be actively maintained; changes are coming in at
>> a
>> >> >> rate
>> >> >> of about two commits per day.
>> >> >> There is no slow down in this RC with 66 commits over the course of
>> >> about
>> >> >> a month.
>> >> >>
>> >> >> Thanks.
>> >> >>
>> >> >> -- Lars
>> >> >
>> >>
>> >
>>
>
>

Yeah when the RC is release committing can continue. Sorry forgot to send a note to that regard.

-- Lars

________________________________
 From: Enis Söztutar <[EMAIL PROTECTED]>
To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Sent: Tuesday, February 5, 2013 11:56 AM
Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for download
 
Lars, on an unrelated note, can we continue to commit on 0.94 branch for
0.94.6? The RC cut is complete I believe.

Ps. this is for HBASE-7748, and HBASE-7770.
Enis
On Tue, Feb 5, 2013 at 11:47 AM, Ted Yu <[EMAIL PROTECTED]> wrote:

> Auto-detection may be difficult.
> 0.94.5 uses the following config param for usage of multi() feature in
> zookeeper 3.4 :
>
>   <property>
>     <name>hbase.zookeeper.useMulti</name>
>     <value>false</value>
>
> Since the issue HBASE-7771 tries to solve affects zookeeper 3.4.4 and later
> version(s), the above config param would not suffice (for current
> discussion).
>
> Cheers
>
> On Tue, Feb 5, 2013 at 11:40 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
> > Yes, I can easily upgrade to 3.4.5, but I think some might not want to
> > if zookeeper is used by some other applications.
> >
> > So I agree that we should consider something to detect ZK version and
> > decide, based on that, ifthe workaround should be used. And if this
> > can be done automatically instead of setting up something in the conf
> > files, it's even better...
> >
> > 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> > > This is tricky.
> > > Is it possible to upgrade standalone zookeeper to 3.4.5 when you
> upgrade
> > to
> > > HBase 0.94.5 ?
> > >
> > > Anyway, looks like we need some config parameter that tells us the
> > version
> > > of standalone zookeeper :-) so that we can decide whether the
> workaround
> > > should be used.
> > >
> > > On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
> > > [EMAIL PROTECTED]> wrote:
> > >
> > >> Hi Ted,
> > >>
> > >> Does it mean that 0.94.5 will not work anymore for those running
> > >> zookeeper separatly with a version < 3.4.5?
> > >>
> > >> I'm running 3.4.3 in my cluster...
> > >>
> > >> JM
> > >>
> > >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> > >> > Patch is available for:
> > >> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait
> forever
> > >> >
> > >> > It removes the workaround from HBASE-4791 which went into 0.94.4
> > >> >
> > >> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771
> should
> > >> > go
> > >> > into 0.94.5
> > >> >
> > >> > My two cents.
> > >> >
> > >> > On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]>
> > wrote:
> > >> >
> > >> >> The 1st 0.94.5 RC is available for download at
> > >> >> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
> > >> >>
> > >> >> Signed with my code signing key: C7CFE328
> > >> >>
> > >> >> 0.94.5 is a bug fix release. This RC has 66 issues resolved against
> > >> >> it,
> > >> >> contributed by 26 individuals.
> > >> >> These are mostly bug fixes. Also fixed is a long standing bug in
> > >> >> replication along with lots of random test failures.
> > >> >>
> > >> >> The full list of changes is available here:
> > >> >> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
> > >> >>
> > >> >> Please try out the RC, check out the doc, take it for a spin, etc,
> > and
> > >> >> vote +1/-1 by February 11th on whether we should release this as
> > >> >> 0.94.5.
> > >> >>
> > >> >> The release testing spreadsheet is here:
> > >> >>
> > >> >>
> > >>
> >
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
> > >> >> (if you test this release, please add your test to this
> spreadsheet,
> > >> >> so
> > >> >> that we can gauge the coverage)
> > >> >>
> > >> >> HBase continues to be actively maintained; changes are coming in
> at a
> > >> >> rate
> > >> >> of about two commits per day.
> > >> >> There is no slow down in this RC with 66 commits over the course of

You'd recommend sinking this RC for this rather than having this next months in 0.94.6?

I'm fine either way. With many, smaller, and backward compatible releases it should be less important to fix a particular problem in a specific release.

Looks like this problem was introduced with 0.94.4, and it that case it might be prudent to get this in.

So... Wanna sink this RC?
-- Lars

________________________________
 From: Ted Yu <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Tuesday, February 5, 2013 1:19 PM
Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for download
 
Francis reminded me that ZOOKEEPER-1437 is a client side fix.

So our situation is simplified: 0.94.5 ships with zookeeper 3.4.5
client. HBASE-7771 should be included.

Cheers

On Tue, Feb 5, 2013 at 11:47 AM, Ted Yu <[EMAIL PROTECTED]> wrote:

> Auto-detection may be difficult.
> 0.94.5 uses the following config param for usage of multi() feature in
> zookeeper 3.4 :
>
>   <property>
>     <name>hbase.zookeeper.useMulti</name>
>     <value>false</value>
>
> Since the issue HBASE-7771 tries to solve affects zookeeper 3.4.4 and
> later version(s), the above config param would not suffice (for current
> discussion).
>
> Cheers
>
> On Tue, Feb 5, 2013 at 11:40 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> Yes, I can easily upgrade to 3.4.5, but I think some might not want to
>> if zookeeper is used by some other applications.
>>
>> So I agree that we should consider something to detect ZK version and
>> decide, based on that, ifthe workaround should be used. And if this
>> can be done automatically instead of setting up something in the conf
>> files, it's even better...
>>
>> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
>> > This is tricky.
>> > Is it possible to upgrade standalone zookeeper to 3.4.5 when you
>> upgrade to
>> > HBase 0.94.5 ?
>> >
>> > Anyway, looks like we need some config parameter that tells us the
>> version
>> > of standalone zookeeper :-) so that we can decide whether the workaround
>> > should be used.
>> >
>> > On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
>> > [EMAIL PROTECTED]> wrote:
>> >
>> >> Hi Ted,
>> >>
>> >> Does it mean that 0.94.5 will not work anymore for those running
>> >> zookeeper separatly with a version < 3.4.5?
>> >>
>> >> I'm running 3.4.3 in my cluster...
>> >>
>> >> JM
>> >>
>> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
>> >> > Patch is available for:
>> >> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait forever
>> >> >
>> >> > It removes the workaround from HBASE-4791 which went into 0.94.4
>> >> >
>> >> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771 should
>> >> > go
>> >> > into 0.94.5
>> >> >
>> >> > My two cents.
>> >> >
>> >> > On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]>
>> wrote:
>> >> >
>> >> >> The 1st 0.94.5 RC is available for download at
>> >> >> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
>> >> >>
>> >> >> Signed with my code signing key: C7CFE328
>> >> >>
>> >> >> 0.94.5 is a bug fix release. This RC has 66 issues resolved against
>> >> >> it,
>> >> >> contributed by 26 individuals.
>> >> >> These are mostly bug fixes. Also fixed is a long standing bug in
>> >> >> replication along with lots of random test failures.
>> >> >>
>> >> >> The full list of changes is available here:
>> >> >> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
>> >> >>
>> >> >> Please try out the RC, check out the doc, take it for a spin, etc,
>> and
>> >> >> vote +1/-1 by February 11th on whether we should release this as
>> >> >> 0.94.5.
>> >> >>
>> >> >> The release testing spreadsheet is here:
>> >> >>
>> >> >>
>> >>
>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGNTUHVVY1lVZnpPT2Z5b0l2c3RoSHc#gid=0
>> >> >> (if you test this release, please add your test to this spreadsheet,
>> >> >> so
>> >> >> that we can gauge the coverage)
>> >> >>
>> >> >> HBase continues to be actively maintained; changes are coming in at

I think it would be prudent to sink RC0.

The fix for HBASE-7771 is shaping up. As long as user deploys 0.94.5 (RC1)
with zookeeper client of 3.4.4 or newer, there should be no problem.

Cheers

On Tue, Feb 5, 2013 at 1:31 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> You'd recommend sinking this RC for this rather than having this next
> months in 0.94.6?
>
> I'm fine either way. With many, smaller, and backward compatible releases
> it should be less important to fix a particular problem in a specific
> release.
>
> Looks like this problem was introduced with 0.94.4, and it that case it
> might be prudent to get this in.
>
> So... Wanna sink this RC?
>
>
> -- Lars
>
>
>
> ________________________________
>  From: Ted Yu <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Sent: Tuesday, February 5, 2013 1:19 PM
> Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for
> download
>
> Francis reminded me that ZOOKEEPER-1437 is a client side fix.
>
> So our situation is simplified: 0.94.5 ships with zookeeper 3.4.5
> client. HBASE-7771 should be included.
>
> Cheers
>
> On Tue, Feb 5, 2013 at 11:47 AM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
> > Auto-detection may be difficult.
> > 0.94.5 uses the following config param for usage of multi() feature in
> > zookeeper 3.4 :
> >
> >   <property>
> >     <name>hbase.zookeeper.useMulti</name>
> >     <value>false</value>
> >
> > Since the issue HBASE-7771 tries to solve affects zookeeper 3.4.4 and
> > later version(s), the above config param would not suffice (for current
> > discussion).
> >
> > Cheers
> >
> > On Tue, Feb 5, 2013 at 11:40 AM, Jean-Marc Spaggiari <
> > [EMAIL PROTECTED]> wrote:
> >
> >> Yes, I can easily upgrade to 3.4.5, but I think some might not want to
> >> if zookeeper is used by some other applications.
> >>
> >> So I agree that we should consider something to detect ZK version and
> >> decide, based on that, ifthe workaround should be used. And if this
> >> can be done automatically instead of setting up something in the conf
> >> files, it's even better...
> >>
> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> >> > This is tricky.
> >> > Is it possible to upgrade standalone zookeeper to 3.4.5 when you
> >> upgrade to
> >> > HBase 0.94.5 ?
> >> >
> >> > Anyway, looks like we need some config parameter that tells us the
> >> version
> >> > of standalone zookeeper :-) so that we can decide whether the
> workaround
> >> > should be used.
> >> >
> >> > On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
> >> > [EMAIL PROTECTED]> wrote:
> >> >
> >> >> Hi Ted,
> >> >>
> >> >> Does it mean that 0.94.5 will not work anymore for those running
> >> >> zookeeper separatly with a version < 3.4.5?
> >> >>
> >> >> I'm running 3.4.3 in my cluster...
> >> >>
> >> >> JM
> >> >>
> >> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> >> >> > Patch is available for:
> >> >> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait
> forever
> >> >> >
> >> >> > It removes the workaround from HBASE-4791 which went into 0.94.4
> >> >> >
> >> >> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771
> should
> >> >> > go
> >> >> > into 0.94.5
> >> >> >
> >> >> > My two cents.
> >> >> >
> >> >> > On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]>
> >> wrote:
> >> >> >
> >> >> >> The 1st 0.94.5 RC is available for download at
> >> >> >> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
> >> >> >>
> >> >> >> Signed with my code signing key: C7CFE328
> >> >> >>
> >> >> >> 0.94.5 is a bug fix release. This RC has 66 issues resolved
> against
> >> >> >> it,
> >> >> >> contributed by 26 individuals.
> >> >> >> These are mostly bug fixes. Also fixed is a long standing bug in
> >> >> >> replication along with lots of random test failures.
> >> >> >>
> >> >> >> The full list of changes is available here:
> >> >> >>
> https://issues.apache.org/jira/browse/HBASE/fixforversion/12323874
> >> >> >>
> >> >> >> Please try out the RC, check out the doc, take it for a spin, etc,

I do not think we can mandate a newer version of ZK in a minor release. At least we avoided that in the past.
HBase "ships" with ZK 3.4.5, but that really just means the client. It still has to work with older ZK servers.

-- Lars

________________________________
 From: Ted Yu <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
Sent: Tuesday, February 5, 2013 1:36 PM
Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for download
 
I think it would be prudent to sink RC0.

The fix for HBASE-7771 is shaping up. As long as user deploys 0.94.5 (RC1)
with zookeeper client of 3.4.4 or newer, there should be no problem.

Cheers

On Tue, Feb 5, 2013 at 1:31 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> You'd recommend sinking this RC for this rather than having this next
> months in 0.94.6?
>
> I'm fine either way. With many, smaller, and backward compatible releases
> it should be less important to fix a particular problem in a specific
> release.
>
> Looks like this problem was introduced with 0.94.4, and it that case it
> might be prudent to get this in.
>
> So... Wanna sink this RC?
>
>
> -- Lars
>
>
>
> ________________________________
>  From: Ted Yu <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Sent: Tuesday, February 5, 2013 1:19 PM
> Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for
> download
>
> Francis reminded me that ZOOKEEPER-1437 is a client side fix.
>
> So our situation is simplified: 0.94.5 ships with zookeeper 3.4.5
> client. HBASE-7771 should be included.
>
> Cheers
>
> On Tue, Feb 5, 2013 at 11:47 AM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
> > Auto-detection may be difficult.
> > 0.94.5 uses the following config param for usage of multi() feature in
> > zookeeper 3.4 :
> >
> >   <property>
> >     <name>hbase.zookeeper.useMulti</name>
> >     <value>false</value>
> >
> > Since the issue HBASE-7771 tries to solve affects zookeeper 3.4.4 and
> > later version(s), the above config param would not suffice (for current
> > discussion).
> >
> > Cheers
> >
> > On Tue, Feb 5, 2013 at 11:40 AM, Jean-Marc Spaggiari <
> > [EMAIL PROTECTED]> wrote:
> >
> >> Yes, I can easily upgrade to 3.4.5, but I think some might not want to
> >> if zookeeper is used by some other applications.
> >>
> >> So I agree that we should consider something to detect ZK version and
> >> decide, based on that, ifthe workaround should be used. And if this
> >> can be done automatically instead of setting up something in the conf
> >> files, it's even better...
> >>
> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> >> > This is tricky.
> >> > Is it possible to upgrade standalone zookeeper to 3.4.5 when you
> >> upgrade to
> >> > HBase 0.94.5 ?
> >> >
> >> > Anyway, looks like we need some config parameter that tells us the
> >> version
> >> > of standalone zookeeper :-) so that we can decide whether the
> workaround
> >> > should be used.
> >> >
> >> > On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
> >> > [EMAIL PROTECTED]> wrote:
> >> >
> >> >> Hi Ted,
> >> >>
> >> >> Does it mean that 0.94.5 will not work anymore for those running
> >> >> zookeeper separatly with a version < 3.4.5?
> >> >>
> >> >> I'm running 3.4.3 in my cluster...
> >> >>
> >> >> JM
> >> >>
> >> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> >> >> > Patch is available for:
> >> >> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait
> forever
> >> >> >
> >> >> > It removes the workaround from HBASE-4791 which went into 0.94.4
> >> >> >
> >> >> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771
> should
> >> >> > go
> >> >> > into 0.94.5
> >> >> >
> >> >> > My two cents.
> >> >> >
> >> >> > On Sat, Feb 2, 2013 at 9:29 AM, lars hofhansl <[EMAIL PROTECTED]>
> >> wrote:
> >> >> >
> >> >> >> The 1st 0.94.5 RC is available for download at
> >> >> >> http://people.apache.org/~larsh/hbase-0.94.5-rc0/
> >> >> >>
> >> >> >> Signed with my code signing key: C7CFE328
> >> >> >>

I think HBASE-7772 should sink the current RC.  It looks like HBASE-7626
broke token authentication in some cases with secure HBase.
On Tue, Feb 5, 2013 at 1:40 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> I do not think we can mandate a newer version of ZK in a minor release. At
> least we avoided that in the past.
> HBase "ships" with ZK 3.4.5, but that really just means the client. It
> still has to work with older ZK servers.
>
> -- Lars
>
>
>
> ________________________________
>  From: Ted Yu <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
> Sent: Tuesday, February 5, 2013 1:36 PM
> Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for
> download
>
> I think it would be prudent to sink RC0.
>
> The fix for HBASE-7771 is shaping up. As long as user deploys 0.94.5 (RC1)
> with zookeeper client of 3.4.4 or newer, there should be no problem.
>
> Cheers
>
> On Tue, Feb 5, 2013 at 1:31 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>
> > You'd recommend sinking this RC for this rather than having this next
> > months in 0.94.6?
> >
> > I'm fine either way. With many, smaller, and backward compatible releases
> > it should be less important to fix a particular problem in a specific
> > release.
> >
> > Looks like this problem was introduced with 0.94.4, and it that case it
> > might be prudent to get this in.
> >
> > So... Wanna sink this RC?
> >
> >
> > -- Lars
> >
> >
> >
> > ________________________________
> >  From: Ted Yu <[EMAIL PROTECTED]>
> > To: [EMAIL PROTECTED]
> > Sent: Tuesday, February 5, 2013 1:19 PM
> > Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for
> > download
> >
> > Francis reminded me that ZOOKEEPER-1437 is a client side fix.
> >
> > So our situation is simplified: 0.94.5 ships with zookeeper 3.4.5
> > client. HBASE-7771 should be included.
> >
> > Cheers
> >
> > On Tue, Feb 5, 2013 at 11:47 AM, Ted Yu <[EMAIL PROTECTED]> wrote:
> >
> > > Auto-detection may be difficult.
> > > 0.94.5 uses the following config param for usage of multi() feature in
> > > zookeeper 3.4 :
> > >
> > >   <property>
> > >     <name>hbase.zookeeper.useMulti</name>
> > >     <value>false</value>
> > >
> > > Since the issue HBASE-7771 tries to solve affects zookeeper 3.4.4 and
> > > later version(s), the above config param would not suffice (for current
> > > discussion).
> > >
> > > Cheers
> > >
> > > On Tue, Feb 5, 2013 at 11:40 AM, Jean-Marc Spaggiari <
> > > [EMAIL PROTECTED]> wrote:
> > >
> > >> Yes, I can easily upgrade to 3.4.5, but I think some might not want to
> > >> if zookeeper is used by some other applications.
> > >>
> > >> So I agree that we should consider something to detect ZK version and
> > >> decide, based on that, ifthe workaround should be used. And if this
> > >> can be done automatically instead of setting up something in the conf
> > >> files, it's even better...
> > >>
> > >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> > >> > This is tricky.
> > >> > Is it possible to upgrade standalone zookeeper to 3.4.5 when you
> > >> upgrade to
> > >> > HBase 0.94.5 ?
> > >> >
> > >> > Anyway, looks like we need some config parameter that tells us the
> > >> version
> > >> > of standalone zookeeper :-) so that we can decide whether the
> > workaround
> > >> > should be used.
> > >> >
> > >> > On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
> > >> > [EMAIL PROTECTED]> wrote:
> > >> >
> > >> >> Hi Ted,
> > >> >>
> > >> >> Does it mean that 0.94.5 will not work anymore for those running
> > >> >> zookeeper separatly with a version < 3.4.5?
> > >> >>
> > >> >> I'm running 3.4.3 in my cluster...
> > >> >>
> > >> >> JM
> > >> >>
> > >> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
> > >> >> > Patch is available for:
> > >> >> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait
> > forever
> > >> >> >
> > >> >> > It removes the workaround from HBASE-4791 which went into 0.94.4
> > >> >> >
> > >> >> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771

All right, consider rc0 sunk.

Gary Helmling <[EMAIL PROTECTED]> wrote:

>I think HBASE-7772 should sink the current RC.  It looks like HBASE-7626 broke token authentication in some cases with secure HBase.
>
>
>
>On Tue, Feb 5, 2013 at 1:40 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>
>I do not think we can mandate a newer version of ZK in a minor release. At least we avoided that in the past.
>HBase "ships" with ZK 3.4.5, but that really just means the client. It still has to work with older ZK servers.
>
>
>-- Lars
>
>
>
>________________________________
> From: Ted Yu <[EMAIL PROTECTED]>
>
>To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
>Sent: Tuesday, February 5, 2013 1:36 PM
>
>Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for download
>
>I think it would be prudent to sink RC0.
>
>The fix for HBASE-7771 is shaping up. As long as user deploys 0.94.5 (RC1)
>with zookeeper client of 3.4.4 or newer, there should be no problem.
>
>Cheers
>
>On Tue, Feb 5, 2013 at 1:31 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>
>> You'd recommend sinking this RC for this rather than having this next
>> months in 0.94.6?
>>
>> I'm fine either way. With many, smaller, and backward compatible releases
>> it should be less important to fix a particular problem in a specific
>> release.
>>
>> Looks like this problem was introduced with 0.94.4, and it that case it
>> might be prudent to get this in.
>>
>> So... Wanna sink this RC?
>>
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>>  From: Ted Yu <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]
>> Sent: Tuesday, February 5, 2013 1:19 PM
>> Subject: Re: ANN: The 1st hbase 0.94.5 release candidate is available for
>> download
>>
>> Francis reminded me that ZOOKEEPER-1437 is a client side fix.
>>
>> So our situation is simplified: 0.94.5 ships with zookeeper 3.4.5
>> client. HBASE-7771 should be included.
>>
>> Cheers
>>
>> On Tue, Feb 5, 2013 at 11:47 AM, Ted Yu <[EMAIL PROTECTED]> wrote:
>>
>> > Auto-detection may be difficult.
>> > 0.94.5 uses the following config param for usage of multi() feature in
>> > zookeeper 3.4 :
>> >
>> >   <property>
>> >     <name>hbase.zookeeper.useMulti</name>
>> >     <value>false</value>
>> >
>> > Since the issue HBASE-7771 tries to solve affects zookeeper 3.4.4 and
>> > later version(s), the above config param would not suffice (for current
>> > discussion).
>> >
>> > Cheers
>> >
>> > On Tue, Feb 5, 2013 at 11:40 AM, Jean-Marc Spaggiari <
>> > [EMAIL PROTECTED]> wrote:
>> >
>> >> Yes, I can easily upgrade to 3.4.5, but I think some might not want to
>> >> if zookeeper is used by some other applications.
>> >>
>> >> So I agree that we should consider something to detect ZK version and
>> >> decide, based on that, ifthe workaround should be used. And if this
>> >> can be done automatically instead of setting up something in the conf
>> >> files, it's even better...
>> >>
>> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
>> >> > This is tricky.
>> >> > Is it possible to upgrade standalone zookeeper to 3.4.5 when you
>> >> upgrade to
>> >> > HBase 0.94.5 ?
>> >> >
>> >> > Anyway, looks like we need some config parameter that tells us the
>> >> version
>> >> > of standalone zookeeper :-) so that we can decide whether the
>> workaround
>> >> > should be used.
>> >> >
>> >> > On Tue, Feb 5, 2013 at 11:16 AM, Jean-Marc Spaggiari <
>> >> > [EMAIL PROTECTED]> wrote:
>> >> >
>> >> >> Hi Ted,
>> >> >>
>> >> >> Does it mean that 0.94.5 will not work anymore for those running
>> >> >> zookeeper separatly with a version < 3.4.5?
>> >> >>
>> >> >> I'm running 3.4.3 in my cluster...
>> >> >>
>> >> >> JM
>> >> >>
>> >> >> 2013/2/5, Ted Yu <[EMAIL PROTECTED]>:
>> >> >> > Patch is available for:
>> >> >> > HBASE-7771 Secure HBase Client in MR job causes tasks to wait
>> forever
>> >> >> >
>> >> >> > It removes the workaround from HBASE-4791 which went into 0.94.4
>> >> >> >
>> >> >> > Now that zookeeper 3.4.5 is used by 0.94.5, I think HBASE-7771