The first 0.94.0 RC is available for download here:

http://people.apache.org/~larsh/hbase-0.94.0-rc0/

(The tarballs are signed by Stack this time, since I do not have a signed Apache key, yet.)

HBase 0.94 is first and foremost a performance release with a few new features as well.

It is wire compatible with 0.92.x. 0.92 clients should work with 0.94 servers and vice versa.

You can do a rolling restart to get your 0.92.x HBase up on this 0.94.0RC.

The full list of changes is available here:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12316419.

Please take this RC for a spin, check out the doc, etc, and vote +1/-1 by April 4th on whether we should release this as 0.94.0.

Thanks.

-- Lars

I planned to perform rolling restart from (our variant of) 0.92 to 0.94.0
but found out that some internal changes prevented region server to talk to
0.94.0 master.
So I loaded every server with 0.94.0 jar and started a 5 RS cluster.
I went through master and RS UI. Performed 'balancer' command in shell.

Didn't do much testing and didn't see issue (therefore no vote).

Minor comment: yesterday Lars showed me the new percentile metrics added
recently. Since the readings were high, it would be nice to include unit of
time in the String form of RegionLoad.

Cheers

On Tue, Mar 27, 2012 at 11:28 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> The first 0.94.0 RC is available for download here:
>
> http://people.apache.org/~larsh/hbase-0.94.0-rc0/
>
> (The tarballs are signed by Stack this time, since I do not have a signed
> Apache key, yet.)
>
> HBase 0.94 is first and foremost a performance release with a few new
> features as well.
>
> It is wire compatible with 0.92.x. 0.92 clients should work with 0.94
> servers and vice versa.
>
> You can do a rolling restart to get your 0.92.x HBase up on this 0.94.0RC.
>
> The full list of changes is available here:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12316419
> .
>
> Please take this RC for a spin, check out the doc, etc, and vote +1/-1 by
> April 4th on whether we should release this as 0.94.0.
>
> Thanks.
>
> -- Lars
>
>

On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> I planned to perform rolling restart from (our variant of) 0.92 to 0.94.0
> but found out that some internal changes prevented region server to talk to
> 0.94.0 master.

What changes?  Do you have logs from that time?
St.Ack

The change was for HBASE-5258

Incompatibility was expected.

Thanks

On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:

> On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> > I planned to perform rolling restart from (our variant of) 0.92 to 0.94.0
> > but found out that some internal changes prevented region server to talk
> to
> > 0.94.0 master.
>
> What changes?  Do you have logs from that time?
> St.Ack
>

HBASE-5258 is not in 0.94. Did you mean a different one?

Or are you saying that you deployed HBASE-5258 locally to your 0.92 version, and that that was the reason you could not test rolling upgrade to 0.94?

Thanks.

-- Lars

________________________________
 From: Ted Yu <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Wednesday, March 28, 2012 5:11 PM
Subject: Re: ANN: The first hbase 0.94.0 release candidate is available for download
 
The change was for HBASE-5258

Incompatibility was expected.

Thanks

On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:

> On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> > I planned to perform rolling restart from (our variant of) 0.92 to 0.94.0
> > but found out that some internal changes prevented region server to talk
> to
> > 0.94.0 master.
>
> What changes?  Do you have logs from that time?
> St.Ack
>

The second scenario.

Thanks

On Wed, Mar 28, 2012 at 6:26 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> HBASE-5258 is not in 0.94. Did you mean a different one?
>
> Or are you saying that you deployed HBASE-5258 locally to your 0.92
> version, and that that was the reason you could not test rolling upgrade to
> 0.94?
>
> Thanks.
>
> -- Lars
>
>
>
> ________________________________
>  From: Ted Yu <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Sent: Wednesday, March 28, 2012 5:11 PM
> Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
> for download
>
> The change was for HBASE-5258
>
> Incompatibility was expected.
>
> Thanks
>
> On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:
>
> > On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> > > I planned to perform rolling restart from (our variant of) 0.92 to
> 0.94.0
> > > but found out that some internal changes prevented region server to
> talk
> > to
> > > 0.94.0 master.
> >
> > What changes?  Do you have logs from that time?
> > St.Ack
> >
>

Is it working for you Ted?  You going to +1 it?  You running on hadoop 0.22?
St.Ack

On Wed, Mar 28, 2012 at 6:28 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> The second scenario.
>
> Thanks
>
> On Wed, Mar 28, 2012 at 6:26 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>
>> HBASE-5258 is not in 0.94. Did you mean a different one?
>>
>> Or are you saying that you deployed HBASE-5258 locally to your 0.92
>> version, and that that was the reason you could not test rolling upgrade to
>> 0.94?
>>
>> Thanks.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>>  From: Ted Yu <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]
>> Sent: Wednesday, March 28, 2012 5:11 PM
>> Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
>> for download
>>
>> The change was for HBASE-5258
>>
>> Incompatibility was expected.
>>
>> Thanks
>>
>> On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:
>>
>> > On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>> > > I planned to perform rolling restart from (our variant of) 0.92 to
>> 0.94.0
>> > > but found out that some internal changes prevented region server to
>> talk
>> > to
>> > > 0.94.0 master.
>> >
>> > What changes?  Do you have logs from that time?
>> > St.Ack
>> >
>>

I only used 0.94 for 20 minutes :-)

It worked during that time. So yes to all questions.

On Mar 28, 2012, at 9:14 PM, Stack <[EMAIL PROTECTED]> wrote:

> Is it working for you Ted?  You going to +1 it?  You running on hadoop 0.22?
> St.Ack
>
> On Wed, Mar 28, 2012 at 6:28 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>> The second scenario.
>>
>> Thanks
>>
>> On Wed, Mar 28, 2012 at 6:26 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>>
>>> HBASE-5258 is not in 0.94. Did you mean a different one?
>>>
>>> Or are you saying that you deployed HBASE-5258 locally to your 0.92
>>> version, and that that was the reason you could not test rolling upgrade to
>>> 0.94?
>>>
>>> Thanks.
>>>
>>> -- Lars
>>>
>>>
>>>
>>> ________________________________
>>>  From: Ted Yu <[EMAIL PROTECTED]>
>>> To: [EMAIL PROTECTED]
>>> Sent: Wednesday, March 28, 2012 5:11 PM
>>> Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
>>> for download
>>>
>>> The change was for HBASE-5258
>>>
>>> Incompatibility was expected.
>>>
>>> Thanks
>>>
>>> On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:
>>>
>>>> On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>>>>> I planned to perform rolling restart from (our variant of) 0.92 to
>>> 0.94.0
>>>>> but found out that some internal changes prevented region server to
>>> talk
>>>> to
>>>>> 0.94.0 master.
>>>>
>>>> What changes?  Do you have logs from that time?
>>>> St.Ack
>>>>
>>>

Is it possible to upgrade from 0.90 to 0.94? Or should I upgrade to 0.92 and
then only do a rolling restart to 0.94?

Regards
Ram

> -----Original Message-----
> From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, March 29, 2012 9:50 AM
> To: [EMAIL PROTECTED]
> Cc: [EMAIL PROTECTED]
> Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
> for download
>
> I only used 0.94 for 20 minutes :-)
>
> It worked during that time. So yes to all questions.
>
>
>
> On Mar 28, 2012, at 9:14 PM, Stack <[EMAIL PROTECTED]> wrote:
>
> > Is it working for you Ted?  You going to +1 it?  You running on
> hadoop 0.22?
> > St.Ack
> >
> > On Wed, Mar 28, 2012 at 6:28 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> >> The second scenario.
> >>
> >> Thanks
> >>
> >> On Wed, Mar 28, 2012 at 6:26 PM, lars hofhansl <[EMAIL PROTECTED]>
> wrote:
> >>
> >>> HBASE-5258 is not in 0.94. Did you mean a different one?
> >>>
> >>> Or are you saying that you deployed HBASE-5258 locally to your 0.92
> >>> version, and that that was the reason you could not test rolling
> upgrade to
> >>> 0.94?
> >>>
> >>> Thanks.
> >>>
> >>> -- Lars
> >>>
> >>>
> >>>
> >>> ________________________________
> >>>  From: Ted Yu <[EMAIL PROTECTED]>
> >>> To: [EMAIL PROTECTED]
> >>> Sent: Wednesday, March 28, 2012 5:11 PM
> >>> Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> available
> >>> for download
> >>>
> >>> The change was for HBASE-5258
> >>>
> >>> Incompatibility was expected.
> >>>
> >>> Thanks
> >>>
> >>> On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:
> >>>
> >>>> On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]>
> wrote:
> >>>>> I planned to perform rolling restart from (our variant of) 0.92
> to
> >>> 0.94.0
> >>>>> but found out that some internal changes prevented region server
> to
> >>> talk
> >>>> to
> >>>>> 0.94.0 master.
> >>>>
> >>>> What changes?  Do you have logs from that time?
> >>>> St.Ack
> >>>>
> >>>

I am not aware of anything that was removed from 0.94 that would prevent that.
So to the extent that 0.90 can be upgraded in place to 0.92 it should be possible to upgrade in 0.90 in place to 0.94.

-- Lars

----- Original Message -----
From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Cc:
Sent: Wednesday, March 28, 2012 9:44 PM
Subject: RE: ANN: The first hbase 0.94.0 release candidate is available for download

Is it possible to upgrade from 0.90 to 0.94? Or should I upgrade to 0.92 and
then only do a rolling restart to 0.94?

Regards
Ram

> -----Original Message-----
> From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, March 29, 2012 9:50 AM
> To: [EMAIL PROTECTED]
> Cc: [EMAIL PROTECTED]
> Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
> for download
>
> I only used 0.94 for 20 minutes :-)
>
> It worked during that time. So yes to all questions.
>
>
>
> On Mar 28, 2012, at 9:14 PM, Stack <[EMAIL PROTECTED]> wrote:
>
> > Is it working for you Ted?  You going to +1 it?  You running on
> hadoop 0.22?
> > St.Ack
> >
> > On Wed, Mar 28, 2012 at 6:28 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> >> The second scenario.
> >>
> >> Thanks
> >>
> >> On Wed, Mar 28, 2012 at 6:26 PM, lars hofhansl <[EMAIL PROTECTED]>
> wrote:
> >>
> >>> HBASE-5258 is not in 0.94. Did you mean a different one?
> >>>
> >>> Or are you saying that you deployed HBASE-5258 locally to your 0.92
> >>> version, and that that was the reason you could not test rolling
> upgrade to
> >>> 0.94?
> >>>
> >>> Thanks.
> >>>
> >>> -- Lars
> >>>
> >>>
> >>>
> >>> ________________________________
> >>>  From: Ted Yu <[EMAIL PROTECTED]>
> >>> To: [EMAIL PROTECTED]
> >>> Sent: Wednesday, March 28, 2012 5:11 PM
> >>> Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> available
> >>> for download
> >>>
> >>> The change was for HBASE-5258
> >>>
> >>> Incompatibility was expected.
> >>>
> >>> Thanks
> >>>
> >>> On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:
> >>>
> >>>> On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]>
> wrote:
> >>>>> I planned to perform rolling restart from (our variant of) 0.92
> to
> >>> 0.94.0
> >>>>> but found out that some internal changes prevented region server
> to
> >>> talk
> >>>> to
> >>>>> 0.94.0 master.
> >>>>
> >>>> What changes?  Do you have logs from that time?
> >>>> St.Ack
> >>>>
> >>>

Thanks Lars and Jon.

I too expect the same to work.  I will try testing it that way.

Regards
Ram

> -----Original Message-----
> From: lars hofhansl [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, March 29, 2012 10:27 AM
> To: [EMAIL PROTECTED]
> Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
> for download
>
> I am not aware of anything that was removed from 0.94 that would
> prevent that.
> So to the extent that 0.90 can be upgraded in place to 0.92 it should
> be possible to upgrade in 0.90 in place to 0.94.
>
> -- Lars
>
>
>
> ----- Original Message -----
> From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Cc:
> Sent: Wednesday, March 28, 2012 9:44 PM
> Subject: RE: ANN: The first hbase 0.94.0 release candidate is available
> for download
>
> Is it possible to upgrade from 0.90 to 0.94? Or should I upgrade to
> 0.92 and
> then only do a rolling restart to 0.94?
>
> Regards
> Ram
>
> > -----Original Message-----
> > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> > Sent: Thursday, March 29, 2012 9:50 AM
> > To: [EMAIL PROTECTED]
> > Cc: [EMAIL PROTECTED]
> > Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> available
> > for download
> >
> > I only used 0.94 for 20 minutes :-)
> >
> > It worked during that time. So yes to all questions.
> >
> >
> >
> > On Mar 28, 2012, at 9:14 PM, Stack <[EMAIL PROTECTED]> wrote:
> >
> > > Is it working for you Ted?  You going to +1 it?  You running on
> > hadoop 0.22?
> > > St.Ack
> > >
> > > On Wed, Mar 28, 2012 at 6:28 PM, Ted Yu <[EMAIL PROTECTED]>
> wrote:
> > >> The second scenario.
> > >>
> > >> Thanks
> > >>
> > >> On Wed, Mar 28, 2012 at 6:26 PM, lars hofhansl
> <[EMAIL PROTECTED]>
> > wrote:
> > >>
> > >>> HBASE-5258 is not in 0.94. Did you mean a different one?
> > >>>
> > >>> Or are you saying that you deployed HBASE-5258 locally to your
> 0.92
> > >>> version, and that that was the reason you could not test rolling
> > upgrade to
> > >>> 0.94?
> > >>>
> > >>> Thanks.
> > >>>
> > >>> -- Lars
> > >>>
> > >>>
> > >>>
> > >>> ________________________________
> > >>>  From: Ted Yu <[EMAIL PROTECTED]>
> > >>> To: [EMAIL PROTECTED]
> > >>> Sent: Wednesday, March 28, 2012 5:11 PM
> > >>> Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> > available
> > >>> for download
> > >>>
> > >>> The change was for HBASE-5258
> > >>>
> > >>> Incompatibility was expected.
> > >>>
> > >>> Thanks
> > >>>
> > >>> On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:
> > >>>
> > >>>> On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]>
> > wrote:
> > >>>>> I planned to perform rolling restart from (our variant of) 0.92
> > to
> > >>> 0.94.0
> > >>>>> but found out that some internal changes prevented region
> server
> > to
> > >>> talk
> > >>>> to
> > >>>>> 0.94.0 master.
> > >>>>
> > >>>> What changes?  Do you have logs from that time?
> > >>>> St.Ack
> > >>>>
> > >>>

To be clear, a rolling restart from 90 to 94 isn't expected to work.
But a shutdown and restart ought to. (If not, like Jon said, we'll be
fixing it)

-Todd

On Wed, Mar 28, 2012 at 10:04 PM, Ramkrishna.S.Vasudevan
<[EMAIL PROTECTED]> wrote:
> Thanks Lars and Jon.
>
> I too expect the same to work.  I will try testing it that way.
>
> Regards
> Ram
>
>> -----Original Message-----
>> From: lars hofhansl [mailto:[EMAIL PROTECTED]]
>> Sent: Thursday, March 29, 2012 10:27 AM
>> To: [EMAIL PROTECTED]
>> Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
>> for download
>>
>> I am not aware of anything that was removed from 0.94 that would
>> prevent that.
>> So to the extent that 0.90 can be upgraded in place to 0.92 it should
>> be possible to upgrade in 0.90 in place to 0.94.
>>
>> -- Lars
>>
>>
>>
>> ----- Original Message -----
>> From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]
>> Cc:
>> Sent: Wednesday, March 28, 2012 9:44 PM
>> Subject: RE: ANN: The first hbase 0.94.0 release candidate is available
>> for download
>>
>> Is it possible to upgrade from 0.90 to 0.94? Or should I upgrade to
>> 0.92 and
>> then only do a rolling restart to 0.94?
>>
>> Regards
>> Ram
>>
>> > -----Original Message-----
>> > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
>> > Sent: Thursday, March 29, 2012 9:50 AM
>> > To: [EMAIL PROTECTED]
>> > Cc: [EMAIL PROTECTED]
>> > Subject: Re: ANN: The first hbase 0.94.0 release candidate is
>> available
>> > for download
>> >
>> > I only used 0.94 for 20 minutes :-)
>> >
>> > It worked during that time. So yes to all questions.
>> >
>> >
>> >
>> > On Mar 28, 2012, at 9:14 PM, Stack <[EMAIL PROTECTED]> wrote:
>> >
>> > > Is it working for you Ted?  You going to +1 it?  You running on
>> > hadoop 0.22?
>> > > St.Ack
>> > >
>> > > On Wed, Mar 28, 2012 at 6:28 PM, Ted Yu <[EMAIL PROTECTED]>
>> wrote:
>> > >> The second scenario.
>> > >>
>> > >> Thanks
>> > >>
>> > >> On Wed, Mar 28, 2012 at 6:26 PM, lars hofhansl
>> <[EMAIL PROTECTED]>
>> > wrote:
>> > >>
>> > >>> HBASE-5258 is not in 0.94. Did you mean a different one?
>> > >>>
>> > >>> Or are you saying that you deployed HBASE-5258 locally to your
>> 0.92
>> > >>> version, and that that was the reason you could not test rolling
>> > upgrade to
>> > >>> 0.94?
>> > >>>
>> > >>> Thanks.
>> > >>>
>> > >>> -- Lars
>> > >>>
>> > >>>
>> > >>>
>> > >>> ________________________________
>> > >>>  From: Ted Yu <[EMAIL PROTECTED]>
>> > >>> To: [EMAIL PROTECTED]
>> > >>> Sent: Wednesday, March 28, 2012 5:11 PM
>> > >>> Subject: Re: ANN: The first hbase 0.94.0 release candidate is
>> > available
>> > >>> for download
>> > >>>
>> > >>> The change was for HBASE-5258
>> > >>>
>> > >>> Incompatibility was expected.
>> > >>>
>> > >>> Thanks
>> > >>>
>> > >>> On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:
>> > >>>
>> > >>>> On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]>
>> > wrote:
>> > >>>>> I planned to perform rolling restart from (our variant of) 0.92
>> > to
>> > >>> 0.94.0
>> > >>>>> but found out that some internal changes prevented region
>> server
>> > to
>> > >>> talk
>> > >>>> to
>> > >>>>> 0.94.0 master.
>> > >>>>
>> > >>>> What changes?  Do you have logs from that time?
>> > >>>> St.Ack
>> > >>>>
>> > >>>
>

--
Todd Lipcon
Software Engineer, Cloudera

Hi

When we tried to start the 0.94 version with hadoop 0.23.1 we got the
following exception stack trace.. Even 0.92.2 snapshot also had the same
problem.  

2012-03-30 11:12:19,487 FATAL org.apache.hadoop.hbase.master.HMaster:
Unhandled exception. Starting shutdown.
java.lang.NoClassDefFoundError:
org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
        at
org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:524)
        at
org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSyste
m.java:324)
        at
org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayou
t(MasterFileSystem.java:127)
        at
org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java
:112)
        at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:496
)
        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:363)
        at java.lang.Thread.run(Thread.java:662)
Kristam Subba Swathi 00902724(k00902724) 2012-03-30 11:34:41
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        ... 7 more

I tried to build a jar with profile as 23 but still could not resolve this.
Am I doing some mistake with this?

Regards
Ram

> -----Original Message-----
> From: Todd Lipcon [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, March 29, 2012 9:27 PM
> To: [EMAIL PROTECTED]
> Cc: lars hofhansl
> Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
> for download
>
> To be clear, a rolling restart from 90 to 94 isn't expected to work.
> But a shutdown and restart ought to. (If not, like Jon said, we'll be
> fixing it)
>
> -Todd
>
> On Wed, Mar 28, 2012 at 10:04 PM, Ramkrishna.S.Vasudevan
> <[EMAIL PROTECTED]> wrote:
> > Thanks Lars and Jon.
> >
> > I too expect the same to work.  I will try testing it that way.
> >
> > Regards
> > Ram
> >
> >> -----Original Message-----
> >> From: lars hofhansl [mailto:[EMAIL PROTECTED]]
> >> Sent: Thursday, March 29, 2012 10:27 AM
> >> To: [EMAIL PROTECTED]
> >> Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> available
> >> for download
> >>
> >> I am not aware of anything that was removed from 0.94 that would
> >> prevent that.
> >> So to the extent that 0.90 can be upgraded in place to 0.92 it
> should
> >> be possible to upgrade in 0.90 in place to 0.94.
> >>
> >> -- Lars
> >>
> >>
> >>
> >> ----- Original Message -----
> >> From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
> >> To: [EMAIL PROTECTED]
> >> Cc:
> >> Sent: Wednesday, March 28, 2012 9:44 PM
> >> Subject: RE: ANN: The first hbase 0.94.0 release candidate is
> available
> >> for download
> >>
> >> Is it possible to upgrade from 0.90 to 0.94? Or should I upgrade to
> >> 0.92 and
> >> then only do a rolling restart to 0.94?
> >>
> >> Regards
> >> Ram
> >>
> >> > -----Original Message-----
> >> > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> >> > Sent: Thursday, March 29, 2012 9:50 AM
> >> > To: [EMAIL PROTECTED]
> >> > Cc: [EMAIL PROTECTED]
> >> > Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> >> available
> >> > for download
> >> >
> >> > I only used 0.94 for 20 minutes :-)
> >> >
> >> > It worked during that time. So yes to all questions.
> >> >
> >> >
> >> >
> >> > On Mar 28, 2012, at 9:14 PM, Stack <[EMAIL PROTECTED]> wrote:
> >> >
> >> > > Is it working for you Ted?  You going to +1 it?  You running on
> >> > hadoop 0.22?
> >> > > St.Ack
> >> > >
> >> > > On Wed, Mar 28, 2012 at 6:28 PM, Ted Yu <[EMAIL PROTECTED]>

And it works fine with 0.92.1?
I think that would sink this RC.

-- Lars

________________________________
 From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Cc: 'lars hofhansl' <[EMAIL PROTECTED]>
Sent: Friday, March 30, 2012 6:03 AM
Subject: RE: ANN: The first hbase 0.94.0 release candidate is available for download
 
Hi

When we tried to start the 0.94 version with hadoop 0.23.1 we got the
following exception stack trace.. Even 0.92.2 snapshot also had the same
problem. 

2012-03-30 11:12:19,487 FATAL org.apache.hadoop.hbase.master.HMaster:
Unhandled exception. Starting shutdown.
java.lang.NoClassDefFoundError:
org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
        at
org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:524)
        at
org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSyste
m.java:324)
        at
org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayou
t(MasterFileSystem.java:127)
        at
org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java
:112)
        at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:496
)
        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:363)
        at java.lang.Thread.run(Thread.java:662)
Kristam Subba Swathi 00902724(k00902724) 2012-03-30 11:34:41
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
        ... 7 more

I tried to build a jar with profile as 23 but still could not resolve this.
Am I doing some mistake with this?

Regards
Ram

> -----Original Message-----
> From: Todd Lipcon [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, March 29, 2012 9:27 PM
> To: [EMAIL PROTECTED]
> Cc: lars hofhansl
> Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
> for download
>
> To be clear, a rolling restart from 90 to 94 isn't expected to work.
> But a shutdown and restart ought to. (If not, like Jon said, we'll be
> fixing it)
>
> -Todd
>
> On Wed, Mar 28, 2012 at 10:04 PM, Ramkrishna.S.Vasudevan
> <[EMAIL PROTECTED]> wrote:
> > Thanks Lars and Jon.
> >
> > I too expect the same to work.  I will try testing it that way.
> >
> > Regards
> > Ram
> >
> >> -----Original Message-----
> >> From: lars hofhansl [mailto:[EMAIL PROTECTED]]
> >> Sent: Thursday, March 29, 2012 10:27 AM
> >> To: [EMAIL PROTECTED]
> >> Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> available
> >> for download
> >>
> >> I am not aware of anything that was removed from 0.94 that would
> >> prevent that.
> >> So to the extent that 0.90 can be upgraded in place to 0.92 it
> should
> >> be possible to upgrade in 0.90 in place to 0.94.
> >>
> >> -- Lars
> >>
> >>
> >>
> >> ----- Original Message -----
> >> From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
> >> To: [EMAIL PROTECTED]
> >> Cc:
> >> Sent: Wednesday, March 28, 2012 9:44 PM
> >> Subject: RE: ANN: The first hbase 0.94.0 release candidate is
> available
> >> for download
> >>
> >> Is it possible to upgrade from 0.90 to 0.94? Or should I upgrade to
> >> 0.92 and
> >> then only do a rolling restart to 0.94?
> >>
> >> Regards
> >> Ram
> >>
> >> > -----Original Message-----
> >> > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> >> > Sent: Thursday, March 29, 2012 9:50 AM
> >> > To: [EMAIL PROTECTED]
> >> > Cc: [EMAIL PROTECTED]
> >> > Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> >> available
> >> > for download
> >> >

So the apache hbase 0.92.1 release jars also has problems against hadoop
0.23.0.

Old 0.20.x/1.0.x MR jobs need to be recompiled for 0.23 (some classes
changed to interfaces).  This means RowCounter and some of the HBase MR
jobs are likely broken against 0.23.

At least in my situation (haven't not build 0.94 against hadoop 0.23.0) my
guess is that the HDFS problem may be something similar and may require a
recompile as well.

Back to digging...

Jon.
On Fri, Mar 30, 2012 at 10:47 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> And it works fine with 0.92.1?
> I think that would sink this RC.
>
> -- Lars
>
>
>
> ________________________________
>  From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Cc: 'lars hofhansl' <[EMAIL PROTECTED]>
> Sent: Friday, March 30, 2012 6:03 AM
> Subject: RE: ANN: The first hbase 0.94.0 release candidate is available
> for download
>
> Hi
>
> When we tried to start the 0.94 version with hadoop 0.23.1 we got the
> following exception stack trace.. Even 0.92.2 snapshot also had the same
> problem.
>
> 2012-03-30 11:12:19,487 FATAL org.apache.hadoop.hbase.master.HMaster:
> Unhandled exception. Starting shutdown.
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
>         at
> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:524)
>         at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSyste
> m.java:324)
>         at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayou
> t(MasterFileSystem.java:127)
>         at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java
> :112)
>         at
>
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:496
> )
>         at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:363)
>         at java.lang.Thread.run(Thread.java:662)
> Kristam Subba Swathi 00902724(k00902724) 2012-03-30 11:34:41
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>         ... 7 more
>
> I tried to build a jar with profile as 23 but still could not resolve this.
> Am I doing some mistake with this?
>
> Regards
> Ram
>
> > -----Original Message-----
> > From: Todd Lipcon [mailto:[EMAIL PROTECTED]]
> > Sent: Thursday, March 29, 2012 9:27 PM
> > To: [EMAIL PROTECTED]
> > Cc: lars hofhansl
> > Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
> > for download
> >
> > To be clear, a rolling restart from 90 to 94 isn't expected to work.
> > But a shutdown and restart ought to. (If not, like Jon said, we'll be
> > fixing it)
> >
> > -Todd
> >
> > On Wed, Mar 28, 2012 at 10:04 PM, Ramkrishna.S.Vasudevan
> > <[EMAIL PROTECTED]> wrote:
> > > Thanks Lars and Jon.
> > >
> > > I too expect the same to work.  I will try testing it that way.
> > >
> > > Regards
> > > Ram
> > >
> > >> -----Original Message-----
> > >> From: lars hofhansl [mailto:[EMAIL PROTECTED]]
> > >> Sent: Thursday, March 29, 2012 10:27 AM
> > >> To: [EMAIL PROTECTED]
> > >> Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> > available
> > >> for download
> > >>
> > >> I am not aware of anything that was removed from 0.94 that would
> > >> prevent that.
> > >> So to the extent that 0.90 can be upgraded in place to 0.92 it
> > should
> > >> be possible to upgrade in 0.90 in place to 0.94.
> > >>
> > >> -- Lars
> > >>
> > >>
> > >>
> > >> ----- Original Message -----
> > >> From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>

// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// [EMAIL PROTECTED]

This looks like a bug in hdfs 0.23 shim later added to 0.23.0 in HDFS-2412
(or or it is compiling against the wrong jars even with -Dhadoop.profile=23)

It seems that hdfs 0.23 moved  FSConstants to HdfsConstants, and in the
process moved the SafeModeAction enum  from FSConstants to
HdfsConstants. When compiled the SafeModeAction enum appears here:

org/apache/hadoop/hdfs/protocol/HdfsConstants$SafeModeAction.class.

HDFS-2412 re-adds  FSConstants as a  subclass of  HDFSConstants that
provides a compile time shim.  HBase can compile since it seems to
 "inherit" the enums from HdfsConstants.  However at run time, the master
process's classloader is looking for enum org.apache.hadoop.hdfs.
protocol.FSConstants$SafeModeAction, which is actually in HdfsConstants,
and fails!

If it is the "inherit" thing, it seems that the classloader doesn't check
super classes to see if the enums are present.

I'll try inheriting from the enum in the FSConstants shim to see, but this
still leaves HBase 0.94 in bad shape on hdfs 0.23.0, 0.23.1.

If this is considered a blocker for an 0.94 release, we could do some
reflection stuff.  Alternately, we could just have 0.94 not support 0.23
and say we it on hdfs 0.23.2  (or whenever that patch gets in).

I believe the 0.92 line suffers from this as well. (have to figure out how
I got my version up and running).

Jon.

On Fri, Mar 30, 2012 at 1:01 PM, Jonathan Hsieh <[EMAIL PROTECTED]> wrote:

> So the apache hbase 0.92.1 release jars also has problems against hadoop
> 0.23.0.
>
> Old 0.20.x/1.0.x MR jobs need to be recompiled for 0.23 (some classes
> changed to interfaces).  This means RowCounter and some of the HBase MR
> jobs are likely broken against 0.23.
>
> At least in my situation (haven't not build 0.94 against hadoop 0.23.0) my
> guess is that the HDFS problem may be something similar and may require a
> recompile as well.
>
> Back to digging...
>
> Jon.
>
>
> On Fri, Mar 30, 2012 at 10:47 AM, lars hofhansl <[EMAIL PROTECTED]>wrote:
>
>> And it works fine with 0.92.1?
>> I think that would sink this RC.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>>  From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]
>> Cc: 'lars hofhansl' <[EMAIL PROTECTED]>
>> Sent: Friday, March 30, 2012 6:03 AM
>> Subject: RE: ANN: The first hbase 0.94.0 release candidate is available
>> for download
>>
>> Hi
>>
>> When we tried to start the 0.94 version with hadoop 0.23.1 we got the
>> following exception stack trace.. Even 0.92.2 snapshot also had the same
>> problem.
>>
>> 2012-03-30 11:12:19,487 FATAL org.apache.hadoop.hbase.master.HMaster:
>> Unhandled exception. Starting shutdown.
>> java.lang.NoClassDefFoundError:
>> org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
>>         at
>> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:524)
>>         at
>>
>> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSyste
>> m.java:324)
>>         at
>>
>> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayou
>> t(MasterFileSystem.java:127)
>>         at
>>
>> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java
>> :112)
>>         at
>>
>> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:496
>> )
>>         at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:363)
>>         at java.lang.Thread.run(Thread.java:662)
>> Kristam Subba Swathi 00902724(k00902724) 2012-03-30 11:34:41
>> Caused by: java.lang.ClassNotFoundException:
>> org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>>         at java.security.AccessController.doPrivileged(Native Method)
>>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// [EMAIL PROTECTED]

If I recompile either  0.92.1 or the 0.94.0rc0 with security and with the
hadoop 23 profile, I've been able to get the 0.94rc0 daemons up.  Out of
the tarball or recompiles against 23 without security get the error Ram
pointed out.  Still hunting down the root cause.

My understanding is releases are about code and not necessarily about the
binaries (jars) so probably shouldn't block this or other release
candidates.

I'll move discussion of this to
https://issues.apache.org/jira/browse/HBASE-5680

Jon

On Fri, Mar 30, 2012 at 6:31 PM, Jonathan Hsieh <[EMAIL PROTECTED]> wrote:

>
> This looks like a bug in hdfs 0.23 shim later added to 0.23.0 in HDFS-2412
> (or or it is compiling against the wrong jars even with -Dhadoop.profile=23)
>
> It seems that hdfs 0.23 moved  FSConstants to HdfsConstants, and in the
> process moved the SafeModeAction enum  from FSConstants to
> HdfsConstants. When compiled the SafeModeAction enum appears here:
>
> org/apache/hadoop/hdfs/protocol/HdfsConstants$SafeModeAction.class.
>
> HDFS-2412 re-adds  FSConstants as a  subclass of  HDFSConstants that
> provides a compile time shim.  HBase can compile since it seems to
>  "inherit" the enums from HdfsConstants.  However at run time, the master
> process's classloader is looking for enum org.apache.hadoop.hdfs.
> protocol.FSConstants$SafeModeAction, which is actually in HdfsConstants,
> and fails!
>
> If it is the "inherit" thing, it seems that the classloader doesn't check
> super classes to see if the enums are present.
>
> I'll try inheriting from the enum in the FSConstants shim to see, but this
> still leaves HBase 0.94 in bad shape on hdfs 0.23.0, 0.23.1.
>
> If this is considered a blocker for an 0.94 release, we could do some
> reflection stuff.  Alternately, we could just have 0.94 not support 0.23
> and say we it on hdfs 0.23.2  (or whenever that patch gets in).
>
> I believe the 0.92 line suffers from this as well. (have to figure out how
> I got my version up and running).
>
> Jon.
>
> On Fri, Mar 30, 2012 at 1:01 PM, Jonathan Hsieh <[EMAIL PROTECTED]> wrote:
>
>> So the apache hbase 0.92.1 release jars also has problems against hadoop
>> 0.23.0.
>>
>> Old 0.20.x/1.0.x MR jobs need to be recompiled for 0.23 (some classes
>> changed to interfaces).  This means RowCounter and some of the HBase MR
>> jobs are likely broken against 0.23.
>>
>> At least in my situation (haven't not build 0.94 against hadoop 0.23.0)
>> my guess is that the HDFS problem may be something similar and may require
>> a recompile as well.
>>
>> Back to digging...
>>
>> Jon.
>>
>>
>> On Fri, Mar 30, 2012 at 10:47 AM, lars hofhansl <[EMAIL PROTECTED]>wrote:
>>
>>> And it works fine with 0.92.1?
>>> I think that would sink this RC.
>>>
>>> -- Lars
>>>
>>>
>>>
>>> ________________________________
>>>  From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
>>> To: [EMAIL PROTECTED]
>>> Cc: 'lars hofhansl' <[EMAIL PROTECTED]>
>>> Sent: Friday, March 30, 2012 6:03 AM
>>> Subject: RE: ANN: The first hbase 0.94.0 release candidate is available
>>> for download
>>>
>>> Hi
>>>
>>> When we tried to start the 0.94 version with hadoop 0.23.1 we got the
>>> following exception stack trace.. Even 0.92.2 snapshot also had the same
>>> problem.
>>>
>>> 2012-03-30 11:12:19,487 FATAL org.apache.hadoop.hbase.master.HMaster:
>>> Unhandled exception. Starting shutdown.
>>> java.lang.NoClassDefFoundError:
>>> org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
>>>         at
>>> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:524)
>>>         at
>>>
>>> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSyste
>>> m.java:324)
>>>         at
>>>
>>> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayou
>>> t(MasterFileSystem.java:127)
>>>         at
>>>
>>> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java
>>> :112)
>>>         at
>>>
>>> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:496
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// [EMAIL PROTECTED]

>I believe the 0.92 line suffers from this as well. (have to figure out how
>I got my version up and running).

Yes Jon.  Even 0.92 suffers from this problem.

We tried a restart of the 0.90 cluster(after shutting it down) and then again bringing it back with 0.94. This time we had a 0.20-append (related internal HDFS version)
of HDFS.  The cluster was able to come back with all the 1500+  regions and we were also able to scan some data using it.

I am not sure on voting the RC because of the 0.23 hdfs support with 0.92.1 and above.  My vote would be +0.

Regards
Ram
________________________________________
From: Jonathan Hsieh [[EMAIL PROTECTED]]
Sent: Saturday, March 31, 2012 7:01 AM
To: [EMAIL PROTECTED]; lars hofhansl
Subject: Re: ANN: The first hbase 0.94.0 release candidate is available for download

This looks like a bug in hdfs 0.23 shim later added to 0.23.0 in HDFS-2412
(or or it is compiling against the wrong jars even with -Dhadoop.profile=23)

It seems that hdfs 0.23 moved  FSConstants to HdfsConstants, and in the
process moved the SafeModeAction enum  from FSConstants to
HdfsConstants. When compiled the SafeModeAction enum appears here:

org/apache/hadoop/hdfs/protocol/HdfsConstants$SafeModeAction.class.

HDFS-2412 re-adds  FSConstants as a  subclass of  HDFSConstants that
provides a compile time shim.  HBase can compile since it seems to
 "inherit" the enums from HdfsConstants.  However at run time, the master
process's classloader is looking for enum org.apache.hadoop.hdfs.
protocol.FSConstants$SafeModeAction, which is actually in HdfsConstants,
and fails!

If it is the "inherit" thing, it seems that the classloader doesn't check
super classes to see if the enums are present.

I'll try inheriting from the enum in the FSConstants shim to see, but this
still leaves HBase 0.94 in bad shape on hdfs 0.23.0, 0.23.1.

If this is considered a blocker for an 0.94 release, we could do some
reflection stuff.  Alternately, we could just have 0.94 not support 0.23
and say we it on hdfs 0.23.2  (or whenever that patch gets in).

I believe the 0.92 line suffers from this as well. (have to figure out how
I got my version up and running).

Jon.

On Fri, Mar 30, 2012 at 1:01 PM, Jonathan Hsieh <[EMAIL PROTECTED]> wrote:

> So the apache hbase 0.92.1 release jars also has problems against hadoop
> 0.23.0.
>
> Old 0.20.x/1.0.x MR jobs need to be recompiled for 0.23 (some classes
> changed to interfaces).  This means RowCounter and some of the HBase MR
> jobs are likely broken against 0.23.
>
> At least in my situation (haven't not build 0.94 against hadoop 0.23.0) my
> guess is that the HDFS problem may be something similar and may require a
> recompile as well.
>
> Back to digging...
>
> Jon.
>
>
> On Fri, Mar 30, 2012 at 10:47 AM, lars hofhansl <[EMAIL PROTECTED]>wrote:
>
>> And it works fine with 0.92.1?
>> I think that would sink this RC.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>>  From: Ramkrishna.S.Vasudevan <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]
>> Cc: 'lars hofhansl' <[EMAIL PROTECTED]>
>> Sent: Friday, March 30, 2012 6:03 AM
>> Subject: RE: ANN: The first hbase 0.94.0 release candidate is available
>> for download
>>
>> Hi
>>
>> When we tried to start the 0.94 version with hadoop 0.23.1 we got the
>> following exception stack trace.. Even 0.92.2 snapshot also had the same
>> problem.
>>
>> 2012-03-30 11:12:19,487 FATAL org.apache.hadoop.hbase.master.HMaster:
>> Unhandled exception. Starting shutdown.
>> java.lang.NoClassDefFoundError:
>> org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
>>         at
>> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:524)
>>         at
>>
>> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSyste
>> m.java:324)
>>         at
>>
>> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayou
>> t(MasterFileSystem.java:127)
>>         at
>>
>> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// [EMAIL PROTECTED]

I've gotten the a similar result wiht 0.94rc0 on top of something close to
hadoop 0.23.0.  However,  I've gotten something very close to the 0.92.1
release up and running against at hadoop hdfs 0.23.0.

How do you link in hadoop 0.23.x? Like with 0.92.1 on hadoop 0.23.0, I've
removed the hadoop-core-1.0.0 from the rc lib dir and linked in a handful
of jars from hadoop/share/hadoop/hdfs/hadoop*,
hadoop/share/hadoop/admin/hadoop*, and hadoop/share/hadoop/common/hadoop*.
I have nothing conclusive yet, but am digging.  More details below.

----

The Safemode code in hbase was in 0.92.0 and last changed 5 months ago.

https://github.com/apache/hbase/commit/1bd11ced54c6a3f5995ddb90768436cf0e79a3ea#L1L456

The class in hadoop seems deprecated backwards compat shim (HDFS-2412):
https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/FSConstants.java

But inherits from here which has the constant:

https://github.com/apache/hadoop-common/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/HdfsConstants.java#L75

(which means with the 0.92.1/0.23.0 combo either it just works either never
exercised).

Jon.

On Fri, Mar 30, 2012 at 6:03 AM, Ramkrishna.S.Vasudevan <
[EMAIL PROTECTED]> wrote:

> Hi
>
> When we tried to start the 0.94 version with hadoop 0.23.1 we got the
> following exception stack trace.. Even 0.92.2 snapshot also had the same
> problem.
>
> 2012-03-30 11:12:19,487 FATAL org.apache.hadoop.hbase.master.HMaster:
> Unhandled exception. Starting shutdown.
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
>        at
> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:524)
>        at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSyste
> m.java:324)
>        at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayou
> t(MasterFileSystem.java:127)
>        at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java
> :112)
>        at
>
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:496
> )
>        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:363)
>        at java.lang.Thread.run(Thread.java:662)
> Kristam Subba Swathi 00902724(k00902724) 2012-03-30 11:34:41
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
>        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>        ... 7 more
>
> I tried to build a jar with profile as 23 but still could not resolve this.
> Am I doing some mistake with this?
>
> Regards
> Ram
>
> > -----Original Message-----
> > From: Todd Lipcon [mailto:[EMAIL PROTECTED]]
> > Sent: Thursday, March 29, 2012 9:27 PM
> > To: [EMAIL PROTECTED]
> > Cc: lars hofhansl
> > Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
> > for download
> >
> > To be clear, a rolling restart from 90 to 94 isn't expected to work.
> > But a shutdown and restart ought to. (If not, like Jon said, we'll be
> > fixing it)
> >
> > -Todd
> >
> > On Wed, Mar 28, 2012 at 10:04 PM, Ramkrishna.S.Vasudevan
> > <[EMAIL PROTECTED]> wrote:
> > > Thanks Lars and Jon.
> > >
> > > I too expect the same to work.  I will try testing it that way.
> > >
> > > Regards
> > > Ram
> > >
> > >> -----Original Message-----
> > >> From: lars hofhansl [mailto:[EMAIL PROTECTED]]
> > >> Sent: Thursday, March 29, 2012 10:27 AM
> > >> To: [EMAIL PROTECTED]
> > >> Subject: Re: ANN: The first hbase 0.94.0 release candidate is
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// [EMAIL PROTECTED]

Ram,

>From my point of view, ideally it should. It is something I going to test.

Jon.

On Wed, Mar 28, 2012 at 9:44 PM, Ramkrishna.S.Vasudevan <
[EMAIL PROTECTED]> wrote:

> Is it possible to upgrade from 0.90 to 0.94? Or should I upgrade to 0.92
> and
> then only do a rolling restart to 0.94?
>
> Regards
> Ram
>
> > -----Original Message-----
> > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]
> > Sent: Thursday, March 29, 2012 9:50 AM
> > To: [EMAIL PROTECTED]
> > Cc: [EMAIL PROTECTED]
> > Subject: Re: ANN: The first hbase 0.94.0 release candidate is available
> > for download
> >
> > I only used 0.94 for 20 minutes :-)
> >
> > It worked during that time. So yes to all questions.
> >
> >
> >
> > On Mar 28, 2012, at 9:14 PM, Stack <[EMAIL PROTECTED]> wrote:
> >
> > > Is it working for you Ted?  You going to +1 it?  You running on
> > hadoop 0.22?
> > > St.Ack
> > >
> > > On Wed, Mar 28, 2012 at 6:28 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> > >> The second scenario.
> > >>
> > >> Thanks
> > >>
> > >> On Wed, Mar 28, 2012 at 6:26 PM, lars hofhansl <[EMAIL PROTECTED]>
> > wrote:
> > >>
> > >>> HBASE-5258 is not in 0.94. Did you mean a different one?
> > >>>
> > >>> Or are you saying that you deployed HBASE-5258 locally to your 0.92
> > >>> version, and that that was the reason you could not test rolling
> > upgrade to
> > >>> 0.94?
> > >>>
> > >>> Thanks.
> > >>>
> > >>> -- Lars
> > >>>
> > >>>
> > >>>
> > >>> ________________________________
> > >>>  From: Ted Yu <[EMAIL PROTECTED]>
> > >>> To: [EMAIL PROTECTED]
> > >>> Sent: Wednesday, March 28, 2012 5:11 PM
> > >>> Subject: Re: ANN: The first hbase 0.94.0 release candidate is
> > available
> > >>> for download
> > >>>
> > >>> The change was for HBASE-5258
> > >>>
> > >>> Incompatibility was expected.
> > >>>
> > >>> Thanks
> > >>>
> > >>> On Wed, Mar 28, 2012 at 5:01 PM, Stack <[EMAIL PROTECTED]> wrote:
> > >>>
> > >>>> On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]>
> > wrote:
> > >>>>> I planned to perform rolling restart from (our variant of) 0.92
> > to
> > >>> 0.94.0
> > >>>>> but found out that some internal changes prevented region server
> > to
> > >>> talk
> > >>>> to
> > >>>>> 0.94.0 master.
> > >>>>
> > >>>> What changes?  Do you have logs from that time?
> > >>>> St.Ack
> > >>>>
> > >>>
>
>
--
// Jonathan Hsieh (shay)
// Software Engineer, Cloudera
// [EMAIL PROTECTED]

So I stopped 0.94 cluster, renamed 0.94 jar file and put back 0.92 jar file.
When restarting 0.92 cluster, I found that region server couldn't open
-ROOT- region.
See:
http://pastebin.com/Qqq6qiaw

FYI

On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> I planned to perform rolling restart from (our variant of) 0.92 to 0.94.0
> but found out that some internal changes prevented region server to talk to
> 0.94.0 master.
> So I loaded every server with 0.94.0 jar and started a 5 RS cluster.
> I went through master and RS UI. Performed 'balancer' command in shell.
>
> Didn't do much testing and didn't see issue (therefore no vote).
>
> Minor comment: yesterday Lars showed me the new percentile metrics added
> recently. Since the readings were high, it would be nice to include unit of
> time in the String form of RegionLoad.
>
> Cheers
>
>
> On Tue, Mar 27, 2012 at 11:28 PM, lars hofhansl <[EMAIL PROTECTED]>wrote:
>
>> The first 0.94.0 RC is available for download here:
>>
>> http://people.apache.org/~larsh/hbase-0.94.0-rc0/
>>
>> (The tarballs are signed by Stack this time, since I do not have a signed
>> Apache key, yet.)
>>
>> HBase 0.94 is first and foremost a performance release with a few new
>> features as well.
>>
>> It is wire compatible with 0.92.x. 0.92 clients should work with 0.94
>> servers and vice versa.
>>
>> You can do a rolling restart to get your 0.92.x HBase up on this 0.94.0RC.
>>
>> The full list of changes is available here:
>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12316419
>> .
>>
>> Please take this RC for a spin, check out the doc, etc, and vote +1/-1 by
>> April 4th on whether we should release this as 0.94.0.
>>
>> Thanks.
>>
>> -- Lars
>>
>>
>

On Wed, Mar 28, 2012 at 4:10 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> So I stopped 0.94 cluster, renamed 0.94 jar file and put back 0.92 jar file.
> When restarting 0.92 cluster, I found that region server couldn't open
> -ROOT- region.
> See:
> http://pastebin.com/Qqq6qiaw
>

No where do we guarantee your being able to go back to your old
version once you've upgraded.
St.Ack

After brief review of HBASE-5074 code, I think this call at line 214 of
FixedFileTrailer.serialize() caused what I saw:
     baosDos.writeInt(materializeVersion(majorVersion, minorVersion));
where 16777218 corresponds to majorVersion of 2 and minorVersion of 1.

Cheers

On Wed, Mar 28, 2012 at 4:10 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> So I stopped 0.94 cluster, renamed 0.94 jar file and put back 0.92 jar
> file.
> When restarting 0.92 cluster, I found that region server couldn't open
> -ROOT- region.
> See:
> http://pastebin.com/Qqq6qiaw
>
> FYI
>
>
> On Wed, Mar 28, 2012 at 3:54 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
>> I planned to perform rolling restart from (our variant of) 0.92 to 0.94.0
>> but found out that some internal changes prevented region server to talk to
>> 0.94.0 master.
>> So I loaded every server with 0.94.0 jar and started a 5 RS cluster.
>> I went through master and RS UI. Performed 'balancer' command in shell.
>>
>> Didn't do much testing and didn't see issue (therefore no vote).
>>
>> Minor comment: yesterday Lars showed me the new percentile metrics added
>> recently. Since the readings were high, it would be nice to include unit of
>> time in the String form of RegionLoad.
>>
>> Cheers
>>
>>
>> On Tue, Mar 27, 2012 at 11:28 PM, lars hofhansl <[EMAIL PROTECTED]>wrote:
>>
>>> The first 0.94.0 RC is available for download here:
>>>
>>> http://people.apache.org/~larsh/hbase-0.94.0-rc0/
>>>
>>> (The tarballs are signed by Stack this time, since I do not have a
>>> signed Apache key, yet.)
>>>
>>> HBase 0.94 is first and foremost a performance release with a few new
>>> features as well.
>>>
>>> It is wire compatible with 0.92.x. 0.92 clients should work with 0.94
>>> servers and vice versa.
>>>
>>> You can do a rolling restart to get your 0.92.x HBase up on this
>>> 0.94.0RC.
>>>
>>> The full list of changes is available here:
>>>
>>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12316419
>>> .
>>>
>>> Please take this RC for a spin, check out the doc, etc, and vote +1/-1
>>> by April 4th on whether we should release this as 0.94.0.
>>>
>>> Thanks.
>>>
>>> -- Lars
>>>
>>>
>>
>

On Tue, Mar 27, 2012 at 11:28 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
> The first 0.94.0 RC is available for download here:
>
> http://people.apache.org/~larsh/hbase-0.94.0-rc0/
>

Reasons to test 0.94.0RC are performance improvements, mostly savings
in i/o but also more cache because blocks stay compressed in memory.

HBASE-4465 Lazy-seek optimization for StoreFile scanners
HBASE-5074 Support checksums in HBase block cache
HBASE-4608 HLog Compression
HBASE-5199 Delete out of TTL store files before compaction selection
HBASE-4532 Avoid top row seek by dedicated bloom filter for delete
family bloom filter
HBASE-4218 Data Block Encoding of KeyValues

Other features:

HBASE-5128 [uber hbck] Online automated repair of table integrity and
region consistency problems
HBASE-3584 Allow atomic put/delete in one call
HBASE-4536 Allow CF to retain deleted rows
HBASE-5229 Provide basic building blocks for "multi-row" local transactions.

St.Ack

Would HBASE-5690 sink rc0 ?

compression does not work in Store.java of 0.94

Thanks

On Tue, Mar 27, 2012 at 11:28 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> The first 0.94.0 RC is available for download here:
>
> http://people.apache.org/~larsh/hbase-0.94.0-rc0/
>
> (The tarballs are signed by Stack this time, since I do not have a signed
> Apache key, yet.)
>
> HBase 0.94 is first and foremost a performance release with a few new
> features as well.
>
> It is wire compatible with 0.92.x. 0.92 clients should work with 0.94
> servers and vice versa.
>
> You can do a rolling restart to get your 0.92.x HBase up on this 0.94.0RC.
>
> The full list of changes is available here:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12316419
> .
>
> Please take this RC for a spin, check out the doc, etc, and vote +1/-1 by
> April 4th on whether we should release this as 0.94.0.
>
> Thanks.
>
> -- Lars
>
>

And we have to fix HBASE-5689: Skipping RecoveredEdits may cause data loss.

FYI

On Sat, Mar 31, 2012 at 6:44 AM, Ted Yu <[EMAIL PROTECTED]> wrote:

> Would HBASE-5690 sink rc0 ?
>
> compression does not work in Store.java of 0.94
>
> Thanks
>
>
> On Tue, Mar 27, 2012 at 11:28 PM, lars hofhansl <[EMAIL PROTECTED]>wrote:
>
>> The first 0.94.0 RC is available for download here:
>>
>> http://people.apache.org/~larsh/hbase-0.94.0-rc0/
>>
>> (The tarballs are signed by Stack this time, since I do not have a signed
>> Apache key, yet.)
>>
>> HBase 0.94 is first and foremost a performance release with a few new
>> features as well.
>>
>> It is wire compatible with 0.92.x. 0.92 clients should work with 0.94
>> servers and vice versa.
>>
>> You can do a rolling restart to get your 0.92.x HBase up on this 0.94.0RC.
>>
>> The full list of changes is available here:
>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12316419
>> .
>>
>> Please take this RC for a spin, check out the doc, etc, and vote +1/-1 by
>> April 4th on whether we should release this as 0.94.0.
>>
>> Thanks.
>>
>> -- Lars
>>
>>
>

Yeah, let's declared 0.94.0.rc0 dead. I retargeted some other issues back to 0.94.0.

-- Lars

________________________________
 From: Ted Yu <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
Sent: Saturday, March 31, 2012 7:12 AM
Subject: Re: ANN: The first hbase 0.94.0 release candidate is available for download
 

And we have to fix HBASE-5689: Skipping RecoveredEdits may cause data loss.

FYI
On Sat, Mar 31, 2012 at 6:44 AM, Ted Yu <[EMAIL PROTECTED]> wrote:

Would HBASE-5690 sink rc0 ?
>
>compression does not work in Store.java of 0.94
>
>Thanks
>
>
>
>On Tue, Mar 27, 2012 at 11:28 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>
>The first 0.94.0 RC is available for download here:
>>
>>http://people.apache.org/%7Elarsh/hbase-0.94.0-rc0/
>>
>>(The tarballs are signed by Stack this time, since I do not have a signed Apache key, yet.)
>>
>>HBase 0.94 is first and foremost a performance release with a few new features as well.
>>
>>It is wire compatible with 0.92.x. 0.92 clients should work with 0.94 servers and vice versa.
>>
>>You can do a rolling restart to get your 0.92.x HBase up on this 0.94.0RC.
>>
>>The full list of changes is available here:
>>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12316419.
>>
>>Please take this RC for a spin, check out the doc, etc, and vote +1/-1 by April 4th on whether we should release this as 0.94.0.
>>
>>Thanks.
>>
>>-- Lars
>>
>>
>