Hello,

I am getting the following when trying to create a table from the
load-tester tool ported from 0.89-fb (https://reviews.facebook.net/D549).
It is weird that configuration instantiation fails given that it succeeded
earlier in the tool's workflow. Does anyone know why are we instantiating a
new configuration in HadoopUser's constructor, and why it could fail as if
it had a different classpath without the normal hbase-default.xml on it?

Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException:
java.lang.RuntimeException: hbase-default.xml file seems to be for and old
version of HBase (null), this version is 0.93-SNAPSHOT
        at
org.apache.hadoop.hbase.HBaseConfiguration.checkDefaultsVersion(HBaseConfiguration.java:68)
        at
org.apache.hadoop.hbase.HBaseConfiguration.addHbaseResources(HBaseConfiguration.java:100)
        at
org.apache.hadoop.hbase.HBaseConfiguration.create(HBaseConfiguration.java:111)
        at
org.apache.hadoop.hbase.security.User$HadoopUser.<init>(User.java:243)
        at
org.apache.hadoop.hbase.security.User$HadoopUser.<init>(User.java:235)
        at org.apache.hadoop.hbase.security.User.getCurrent(User.java:141)
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionKey.<init>(HConnectionManager.java:411)
        at
org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:181)
        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:165)
        at
org.apache.hadoop.hbase.catalog.MetaReader.getHTable(MetaReader.java:198)
        at
org.apache.hadoop.hbase.catalog.MetaReader.getMetaHTable(MetaReader.java:224)
        at
org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:698)
        at
org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:181)
        at
org.apache.hadoop.hbase.catalog.MetaReader.tableExists(MetaReader.java:446)
        at
org.apache.hadoop.hbase.master.handler.CreateTableHandler.<init>(CreateTableHandler.java:89)
        at
org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1084)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
        at
org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1325)

        at
org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:897)
        at
org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
        at $Proxy4.createTable(Unknown Source)
        at
org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:451)
        ... 4 more
org.apache.hadoop.hbase.TableNotFoundException: load_test1
        at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHTableDescriptor(HConnectionManager.java:1881)
        at
org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:274)
        at
org.apache.hadoop.hbase.manual.HBaseClusterTest.applyBloomFilterAndCompression(HBaseClusterTest.java:239)
        at
org.apache.hadoop.hbase.manual.HBaseClusterTest.createTables(HBaseClusterTest.java:83)
        at
org.apache.hadoop.hbase.manual.HBaseClusterTest.main(HBaseClusterTest.java:323)

Thanks,
--Mikhail

Do you have an hbase-default.xml file somewhere? It should only exist
in the jar now, it's not in conf/ anymore.

J-D

On Wed, Nov 30, 2011 at 3:34 PM, Mikhail Bautin
<[EMAIL PROTECTED]> wrote:
> Hello,
>
> I am getting the following when trying to create a table from the
> load-tester tool ported from 0.89-fb (https://reviews.facebook.net/D549).
> It is weird that configuration instantiation fails given that it succeeded
> earlier in the tool's workflow. Does anyone know why are we instantiating a
> new configuration in HadoopUser's constructor, and why it could fail as if
> it had a different classpath without the normal hbase-default.xml on it?
>
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException:
> java.lang.RuntimeException: hbase-default.xml file seems to be for and old
> version of HBase (null), this version is 0.93-SNAPSHOT
>        at
> org.apache.hadoop.hbase.HBaseConfiguration.checkDefaultsVersion(HBaseConfiguration.java:68)
>        at
> org.apache.hadoop.hbase.HBaseConfiguration.addHbaseResources(HBaseConfiguration.java:100)
>        at
> org.apache.hadoop.hbase.HBaseConfiguration.create(HBaseConfiguration.java:111)
>        at
> org.apache.hadoop.hbase.security.User$HadoopUser.<init>(User.java:243)
>        at
> org.apache.hadoop.hbase.security.User$HadoopUser.<init>(User.java:235)
>        at org.apache.hadoop.hbase.security.User.getCurrent(User.java:141)
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionKey.<init>(HConnectionManager.java:411)
>        at
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:181)
>        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:165)
>        at
> org.apache.hadoop.hbase.catalog.MetaReader.getHTable(MetaReader.java:198)
>        at
> org.apache.hadoop.hbase.catalog.MetaReader.getMetaHTable(MetaReader.java:224)
>        at
> org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:698)
>        at
> org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:181)
>        at
> org.apache.hadoop.hbase.catalog.MetaReader.tableExists(MetaReader.java:446)
>        at
> org.apache.hadoop.hbase.master.handler.CreateTableHandler.<init>(CreateTableHandler.java:89)
>        at
> org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1084)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1325)
>
>        at
> org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:897)
>        at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
>        at $Proxy4.createTable(Unknown Source)
>        at
> org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:451)
>        ... 4 more
> org.apache.hadoop.hbase.TableNotFoundException: load_test1
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHTableDescriptor(HConnectionManager.java:1881)
>        at
> org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:274)
>        at
> org.apache.hadoop.hbase.manual.HBaseClusterTest.applyBloomFilterAndCompression(HBaseClusterTest.java:239)
>        at
> org.apache.hadoop.hbase.manual.HBaseClusterTest.createTables(HBaseClusterTest.java:83)
>        at
> org.apache.hadoop.hbase.manual.HBaseClusterTest.main(HBaseClusterTest.java:323)
>
> Thanks,
> --Mikhail

Figured this out -- this was a false alarm. I accidentally overrode my
hbase jar with the hbase test jar, so it was legitimately complaining about
not being able to find a valid hbase-default.xml.

Thanks!
--Mikhail

On Wed, Nov 30, 2011 at 4:15 PM, Jean-Daniel Cryans <[EMAIL PROTECTED]>wrote:

> Do you have an hbase-default.xml file somewhere? It should only exist
> in the jar now, it's not in conf/ anymore.
>
> J-D
>
> On Wed, Nov 30, 2011 at 3:34 PM, Mikhail Bautin
> <[EMAIL PROTECTED]> wrote:
> > Hello,
> >
> > I am getting the following when trying to create a table from the
> > load-tester tool ported from 0.89-fb (https://reviews.facebook.net/D549
> ).
> > It is weird that configuration instantiation fails given that it
> succeeded
> > earlier in the tool's workflow. Does anyone know why are we
> instantiating a
> > new configuration in HadoopUser's constructor, and why it could fail as
> if
> > it had a different classpath without the normal hbase-default.xml on it?
> >
> > Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException:
> > java.lang.RuntimeException: hbase-default.xml file seems to be for and
> old
> > version of HBase (null), this version is 0.93-SNAPSHOT
> >        at
> >
> org.apache.hadoop.hbase.HBaseConfiguration.checkDefaultsVersion(HBaseConfiguration.java:68)
> >        at
> >
> org.apache.hadoop.hbase.HBaseConfiguration.addHbaseResources(HBaseConfiguration.java:100)
> >        at
> >
> org.apache.hadoop.hbase.HBaseConfiguration.create(HBaseConfiguration.java:111)
> >        at
> > org.apache.hadoop.hbase.security.User$HadoopUser.<init>(User.java:243)
> >        at
> > org.apache.hadoop.hbase.security.User$HadoopUser.<init>(User.java:235)
> >        at org.apache.hadoop.hbase.security.User.getCurrent(User.java:141)
> >        at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionKey.<init>(HConnectionManager.java:411)
> >        at
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:181)
> >        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:165)
> >        at
> > org.apache.hadoop.hbase.catalog.MetaReader.getHTable(MetaReader.java:198)
> >        at
> >
> org.apache.hadoop.hbase.catalog.MetaReader.getMetaHTable(MetaReader.java:224)
> >        at
> > org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:698)
> >        at
> > org.apache.hadoop.hbase.catalog.MetaReader.fullScan(MetaReader.java:181)
> >        at
> >
> org.apache.hadoop.hbase.catalog.MetaReader.tableExists(MetaReader.java:446)
> >        at
> >
> org.apache.hadoop.hbase.master.handler.CreateTableHandler.<init>(CreateTableHandler.java:89)
> >        at
> > org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1084)
> >        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >        at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >        at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
> >        at
> >
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1325)
> >
> >        at
> > org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:897)
> >        at
> >
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
> >        at $Proxy4.createTable(Unknown Source)
> >        at
> >
> org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:451)
> >        ... 4 more
> > org.apache.hadoop.hbase.TableNotFoundException: load_test1
> >        at
> >
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getHTableDescriptor(HConnectionManager.java:1881)
> >        at
> >
> org.apache.hadoop.hbase.client.HBaseAdmin.getTableDescriptor(HBaseAdmin.java:274)

Glad this was just a false alarm.

If you do try out security features, or believe you see errors as a consequence of them going in, I am very interested in hearing about it, even if a false alarm, and will take care of it if there is a real issue.

Best regards,
   - Andy

>________________________________
> From: Mikhail Bautin <[EMAIL PROTECTED]>
>To: [EMAIL PROTECTED]
>Sent: Wednesday, November 30, 2011 6:04 PM
>Subject: Re: security/configuration-related error when trying to create a table
>
>Figured this out -- this was a false alarm. I accidentally overrode my
>hbase jar with the hbase test jar, so it was legitimately complaining about
>not being able to find a valid hbase-default.xml.
>
>Thanks!
>--Mikhail
>
>On Wed, Nov 30, 2011 at 4:15 PM, Jean-Daniel Cryans <[EMAIL PROTECTED]>wrote:
>
>> Do you have an hbase-default.xml file somewhere? It should only exist
>> in the jar now, it's not in conf/ anymore.
>>
>> J-D
>>
>> On Wed, Nov 30, 2011 at 3:34 PM, Mikhail Bautin
>> <[EMAIL PROTECTED]> wrote:
>> > Hello,
>> >
>> > I am getting the following when trying to create a table from the
>> > load-tester tool ported from 0.89-fb (https://reviews.facebook.net/D549
>> ).
>> > It is weird that configuration instantiation fails given that it
>> succeeded
>> > earlier in the tool's workflow. Does anyone know why are we
>> instantiating a
>> > new configuration in HadoopUser's constructor, and why it could fail as
>> if
>> > it had a different classpath without the normal hbase-default.xml on it?
>> >
>> > Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException:
>> > java.lang.RuntimeException: hbase-default.xml file seems to be for and
>> old
>> > version of HBase (null), this version is 0.93-SNAPSHOT
>

On Wed, Nov 30, 2011 at 6:15 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:
> Glad this was just a false alarm.
>
> If you do try out security features, or believe you see errors as a consequence of them going in,
> I am very interested in hearing about it, even if a false alarm, and will take care of it if there is a real issue.

Andrew, do you have some docs for those would would like to play with security ?

Thanks,
Roman.

On Wed, Nov 30, 2011 at 6:24 PM, Roman Shaposhnik <[EMAIL PROTECTED]> wrote:
> On Wed, Nov 30, 2011 at 6:15 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:
>> Glad this was just a false alarm.
>>
>> If you do try out security features, or believe you see errors as a consequence of them going in,
>> I am very interested in hearing about it, even if a false alarm, and will take care of it if there is a real issue.
>
> Andrew, do you have some docs for those would would like to play with security ?
>

If you Andrew or Eugene make a few paragraphs on how to do setup, I'll
take care shoehorning them into the book.  Here's what we have at mo:
http://hbase.apache.org/book.html#hadoop.security

Good stuff,
St.Ack

Roman,

There are some out of date blog posts which need rework into proper documentation. Gary Helmling was talking about doing this, to be committed into the HBase xml book. Gary, do you still have interest and time for doing this?
 

  - Andy
>________________________________
> From: Roman Shaposhnik <[EMAIL PROTECTED]>
>To: [EMAIL PROTECTED]; Andrew Purtell <[EMAIL PROTECTED]>
>Sent: Wednesday, November 30, 2011 6:24 PM
>Subject: Re: security/configuration-related error when trying to create a table
>
>On Wed, Nov 30, 2011 at 6:15 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:
>> Glad this was just a false alarm.
>>
>> If you do try out security features, or believe you see errors as a consequence of them going in,
>> I am very interested in hearing about it, even if a false alarm, and will take care of it if there is a real issue.
>
>Andrew, do you have some docs for those would would like to play with security ?
>
>Thanks,
>Roman.
>
>
>

Yes I'm still interested but probably won't get to it til this weekend. I
think there's an open jira for security docs. I'll put a patch for
book.xml  up on that.

I think it would be great to have an updated blog post on setup as well,
but I'm not sure where it can go.
On Nov 30, 2011 7:36 PM, "Andrew Purtell" <[EMAIL PROTECTED]> wrote:

> Roman,
>
> There are some out of date blog posts which need rework into proper
> documentation. Gary Helmling was talking about doing this, to be committed
> into the HBase xml book. Gary, do you still have interest and time for
> doing this?
>
>   - Andy
>
>
>   ------------------------------
> *From:* Roman Shaposhnik <[EMAIL PROTECTED]>
> *To:* [EMAIL PROTECTED]; Andrew Purtell <[EMAIL PROTECTED]>
> *Sent:* Wednesday, November 30, 2011 6:24 PM
> *Subject:* Re: security/configuration-related error when trying to create
> a table
>
> On Wed, Nov 30, 2011 at 6:15 PM, Andrew Purtell <[EMAIL PROTECTED]>
> wrote:
> > Glad this was just a false alarm.
> >
> > If you do try out security features, or believe you see errors as a
> consequence of them going in,
> > I am very interested in hearing about it, even if a false alarm, and
> will take care of it if there is a real issue.
>
> Andrew, do you have some docs for those would would like to play with
> security ?
>
> Thanks,
> Roman.
>
>
>

Let me know if you need any help on that.

On 12/1/11 11:14 AM, "Gary Helmling" <[EMAIL PROTECTED]> wrote:

>Yes I'm still interested but probably won't get to it til this weekend. I
>think there's an open jira for security docs. I'll put a patch for
>book.xml  up on that.
>
>I think it would be great to have an updated blog post on setup as well,
>but I'm not sure where it can go.
>On Nov 30, 2011 7:36 PM, "Andrew Purtell" <[EMAIL PROTECTED]> wrote:
>
>> Roman,
>>
>> There are some out of date blog posts which need rework into proper
>> documentation. Gary Helmling was talking about doing this, to be
>>committed
>> into the HBase xml book. Gary, do you still have interest and time for
>> doing this?
>>
>>   - Andy
>>
>>
>>   ------------------------------
>> *From:* Roman Shaposhnik <[EMAIL PROTECTED]>
>> *To:* [EMAIL PROTECTED]; Andrew Purtell <[EMAIL PROTECTED]>
>> *Sent:* Wednesday, November 30, 2011 6:24 PM
>> *Subject:* Re: security/configuration-related error when trying to
>>create
>> a table
>>
>> On Wed, Nov 30, 2011 at 6:15 PM, Andrew Purtell <[EMAIL PROTECTED]>
>> wrote:
>> > Glad this was just a false alarm.
>> >
>> > If you do try out security features, or believe you see errors as a
>> consequence of them going in,
>> > I am very interested in hearing about it, even if a false alarm, and
>> will take care of it if there is a real issue.
>>
>> Andrew, do you have some docs for those would would like to play with
>> security ?
>>
>> Thanks,
>> Roman.
>>
>>
>>