|
Bob Futrelle
2012-12-18, 04:15
Jimmy Xiang
2012-12-18, 04:25
Bob Futrelle
2012-12-18, 04:47
Nick Dimiduk
2012-12-18, 08:19
Bob Futrelle
2012-12-18, 18:15
Nick Dimiduk
2012-12-18, 18:26
Mesika, Asaf
2012-12-18, 20:33
Bob Futrelle
2012-12-18, 22:27
Bob Futrelle
2012-12-18, 23:36
Nick Dimiduk
2012-12-18, 23:24
Bob Futrelle
2012-12-19, 03:03
Andrew Purtell
2012-12-19, 04:28
Bob Futrelle
2012-12-19, 04:58
Andrew Purtell
2012-12-19, 05:14
Bob Futrelle
2012-12-19, 05:45
|
-
HBase 0.94 security configurationsBob Futrelle 2012-12-18, 04:15
I have the same problem that Amit Sela had - an endlessly repeating message
in my Eclipse console: java.net.ConnectException : Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport( ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) 12/12/17 20:54:51 INFO zookeeper.ClientCnxn: Opening socket connection to server /fe80:0:0:0:0:0:0:1%1:2181 12/12/17 20:54:51 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master 12/12/17 20:54:51 INFO util.RetryCounter: Sleeping 2000ms before retry #1... 12/12/17 20:54:56 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration. 12/12/17 20:54:56 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 12/12/17 20:54:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect I'm about as much of a newbie as you can imagine. I found a small piece of code that creates a table. It threw endless exceptions. I fixed each by finding the correct jars (7 in all) and occasionally changing a bit of the code, e.g., using, not a constructor, but HBaseConfiguration.create(); I'm using hbase-0.94.3 and Eclipse 4.2.1 (Juno). No apache/hbase plugins, just straight Eclipse/Java. The only setting I've touched is hbase-site.xml in which I put the path to the directory that I want my DBs in. It worked from HBase Shell. But of course I want it to work from Java. I suspect that the right info in the hbase-policy.xml would fix all this. But my understanding of HBase so far is too skimpy to know what to put there. My goal is to do all this work entirely within my own machine (MacBook Pro). Single user, nothing remote, no clients/cluster. For total disclosure, here's the entire source - my little HBase Hello World : package us.tsos.nlpng.hbase.test1; import java.io.IOException; import org.apache.hadoop.hbase.HColumnDescriptor; import org.apache.hadoop.hbase.HTableDescriptor; import org.apache.hadoop.hbase.client.HBaseAdmin; import org.apache.hadoop.hbase.HBaseConfiguration; public class JustCreateTable { public static void main(String[] args) throws IOException { org.apache.hadoop.conf.Configuration conf = HBaseConfiguration.create(); conf.set("hbase.master","localhost:60000"); HBaseAdmin hbase = new HBaseAdmin(conf); HTableDescriptor desc = new HTableDescriptor("TEST"); HColumnDescriptor meta = new HColumnDescriptor("personal".getBytes()); HColumnDescriptor prefix = new HColumnDescriptor("account".getBytes()); desc.addFamily(meta); desc.addFamily(prefix); hbase.createTable(desc); } } -- Bob Futrelle retired CS prof. working hard on an NLP system HBase will really fit the ticket "You never *learn* anything, you just get used to it." +
Bob Futrelle 2012-12-18, 04:15
-
Re: HBase 0.94 security configurationsJimmy Xiang 2012-12-18, 04:25
Have you tried IPv4? As to secure HBase configuration, this
instruction may be of some help: https://ccp.cloudera.com/display/CDH4DOC/HBase+Security+Configuration Thanks, Jimmy On Mon, Dec 17, 2012 at 8:15 PM, Bob Futrelle <[EMAIL PROTECTED]> wrote: > I have the same problem that Amit Sela had - an endlessly repeating message > in my Eclipse console: > > java.net.ConnectException > : Connection refused > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599) > > at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport( > ClientCnxnSocketNIO.java:286) > > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) > > 12/12/17 20:54:51 INFO zookeeper.ClientCnxn: Opening socket connection to > server /fe80:0:0:0:0:0:0:1%1:2181 > > 12/12/17 20:54:51 WARN zookeeper.RecoverableZooKeeper: Possibly transient > ZooKeeper exception: > org.apache.zookeeper.KeeperException$ConnectionLossException: > KeeperErrorCode = ConnectionLoss for /hbase/master > > 12/12/17 20:54:51 INFO util.RetryCounter: Sleeping 2000ms before retry #1... > > 12/12/17 20:54:56 WARN client.ZooKeeperSaslClient: SecurityException: > java.lang.SecurityException: Unable to locate a login configuration > occurred when trying to find JAAS configuration. > > 12/12/17 20:54:56 INFO client.ZooKeeperSaslClient: Client will not > SASL-authenticate because the default JAAS configuration section 'Client' > could not be found. If you are not using SASL, you may ignore this. On the > other hand, if you expected SASL to work, please fix your JAAS > configuration. > > 12/12/17 20:54:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > > > I'm about as much of a newbie as you can imagine. > > I found a small piece of code that creates a table. > It threw endless exceptions. I fixed each by finding the correct jars (7 > in all) > and occasionally changing a bit of the code, e.g., using, not a > constructor, but > > HBaseConfiguration.create(); > > > I'm using hbase-0.94.3 and Eclipse 4.2.1 (Juno). > No apache/hbase plugins, just straight Eclipse/Java. > > The only setting I've touched is hbase-site.xml > in which I put the path to the directory that I want my DBs in. > It worked from HBase Shell. > But of course I want it to work from Java. > > I suspect that the right info in the hbase-policy.xml would fix all this. > But my understanding of HBase so far is too skimpy to know what to put > there. > > My goal is to do all this work entirely within my own machine (MacBook Pro). > Single user, nothing remote, no clients/cluster. > > For total disclosure, here's the entire source - my little HBase Hello World > : > > package us.tsos.nlpng.hbase.test1; > > > import java.io.IOException; > > > import org.apache.hadoop.hbase.HColumnDescriptor; > > import org.apache.hadoop.hbase.HTableDescriptor; > > import org.apache.hadoop.hbase.client.HBaseAdmin; > > import org.apache.hadoop.hbase.HBaseConfiguration; > > > public class JustCreateTable { > > > public static void main(String[] args) throws IOException { > > > org.apache.hadoop.conf.Configuration conf = HBaseConfiguration.create(); > > conf.set("hbase.master","localhost:60000"); > > > HBaseAdmin hbase = new HBaseAdmin(conf); > > HTableDescriptor desc = new HTableDescriptor("TEST"); > > HColumnDescriptor meta = new HColumnDescriptor("personal".getBytes()); > > HColumnDescriptor prefix = new HColumnDescriptor("account".getBytes()); > > desc.addFamily(meta); > > desc.addFamily(prefix); > > hbase.createTable(desc); > > } > > } > > > -- Bob Futrelle > > > retired CS prof. > > working hard on an NLP system > > HBase will really fit the ticket > > > "You never *learn* anything, you just get used to it." +
Jimmy Xiang 2012-12-18, 04:25
-
Re: HBase 0.94 security configurationsBob Futrelle 2012-12-18, 04:47
Thanks for your quick reply.
On Mon, Dec 17, 2012 at 11:25 PM, Jimmy Xiang <[EMAIL PROTECTED]> wrote: > Have you tried IPv4? I can disable IPv6 in Mountain Lion, but all my "communication" is *within*my own machine, so I don't understand why I'd be messing with IP, since nothing I'm doing is going through my ethernet or WiFi. But that may be the HBase view of communication, even when entirely within a machine(?) It's late - will try in the morning. As for the cloudera page, it seems like a huge amount of information that goes way beyond the trivial setup that I'm trying to arrange for. Maybe what I need is buried in the page somewhere (emphasis on "buried"). As they say: "My code is so simple, what could possibly go wrong?" ;-) - Bob > As to secure HBase configuration, this > instruction may be of some help: > > https://ccp.cloudera.com/display/CDH4DOC/HBase+Security+Configuration > > Thanks, > Jimmy > > On Mon, Dec 17, 2012 at 8:15 PM, Bob Futrelle <[EMAIL PROTECTED]> > wrote: > > I have the same problem that Amit Sela had - an endlessly repeating > message > > in my Eclipse console: > > > > java.net.ConnectException > > : Connection refused > > > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > > > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599) > > > > at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport( > > ClientCnxnSocketNIO.java:286) > > > > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) > > > > 12/12/17 20:54:51 INFO zookeeper.ClientCnxn: Opening socket connection to > > server /fe80:0:0:0:0:0:0:1%1:2181 > > > > 12/12/17 20:54:51 WARN zookeeper.RecoverableZooKeeper: Possibly transient > > ZooKeeper exception: > > org.apache.zookeeper.KeeperException$ConnectionLossException: > > KeeperErrorCode = ConnectionLoss for /hbase/master > > > > 12/12/17 20:54:51 INFO util.RetryCounter: Sleeping 2000ms before retry > #1... > > > > 12/12/17 20:54:56 WARN client.ZooKeeperSaslClient: SecurityException: > > java.lang.SecurityException: Unable to locate a login configuration > > occurred when trying to find JAAS configuration. > > > > 12/12/17 20:54:56 INFO client.ZooKeeperSaslClient: Client will not > > SASL-authenticate because the default JAAS configuration section 'Client' > > could not be found. If you are not using SASL, you may ignore this. On > the > > other hand, if you expected SASL to work, please fix your JAAS > > configuration. > > > > 12/12/17 20:54:56 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > > unexpected error, closing socket connection and attempting reconnect > > > > > > I'm about as much of a newbie as you can imagine. > > > > I found a small piece of code that creates a table. > > It threw endless exceptions. I fixed each by finding the correct jars (7 > > in all) > > and occasionally changing a bit of the code, e.g., using, not a > > constructor, but > > > > HBaseConfiguration.create(); > > > > > > I'm using hbase-0.94.3 and Eclipse 4.2.1 (Juno). > > No apache/hbase plugins, just straight Eclipse/Java. > > > > The only setting I've touched is hbase-site.xml > > in which I put the path to the directory that I want my DBs in. > > It worked from HBase Shell. > > But of course I want it to work from Java. > > > > I suspect that the right info in the hbase-policy.xml would fix all this. > > But my understanding of HBase so far is too skimpy to know what to put > > there. > > > > My goal is to do all this work entirely within my own machine (MacBook > Pro). > > Single user, nothing remote, no clients/cluster. > > > > For total disclosure, here's the entire source - my little HBase Hello > World > > : > > > > package us.tsos.nlpng.hbase.test1; > > > > > > import java.io.IOException; > > > > > > import org.apache.hadoop.hbase.HColumnDescriptor; > > > > import org.apache.hadoop.hbase.HTableDescriptor; > > > > import org.apache.hadoop.hbase.client.HBaseAdmin; > > > > import org.apache.hadoop.hbase.HBaseConfiguration; +
Bob Futrelle 2012-12-18, 04:47
-
Re: HBase 0.94 security configurationsNick Dimiduk 2012-12-18, 08:19
Are you using secure HBase? Don't -- it'll only get in the way for a simple
example. Is the master running? Be sure to run ./bin/start-hbase.sh from the directory where you unpacked the tgz. You can omit the conf.set(...) business from your code. By default, the configuration will point to local host. Does any of that help? -n On Dec 17, 2012 8:47 PM, "Bob Futrelle" <[EMAIL PROTECTED]> wrote: > Thanks for your quick reply. > > > On Mon, Dec 17, 2012 at 11:25 PM, Jimmy Xiang <[EMAIL PROTECTED]> wrote: > > > Have you tried IPv4? > > > I can disable IPv6 in Mountain Lion, but all my "communication" is > *within*my own machine, so I don't understand why I'd be messing with > IP, since > nothing I'm doing is going through my ethernet or WiFi. But that may be > the HBase view of communication, even when entirely within a machine(?) > It's late - will try in the morning. > > As for the cloudera page, it seems like a huge amount of information that > goes way beyond the trivial setup that I'm trying to arrange for. Maybe > what I need is buried in the page somewhere (emphasis on "buried"). > > As they say: "My code is so simple, what could possibly go wrong?" ;-) > > - Bob > > > > As to secure HBase configuration, this > > instruction may be of some help: > > > > https://ccp.cloudera.com/display/CDH4DOC/HBase+Security+Configuration > > > > Thanks, > > Jimmy > > > > On Mon, Dec 17, 2012 at 8:15 PM, Bob Futrelle <[EMAIL PROTECTED]> > > wrote: > > > I have the same problem that Amit Sela had - an endlessly repeating > > message > > > in my Eclipse console: > > > > > > java.net.ConnectException > > > : Connection refused > > > > > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > > > > > at > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599) > > > > > > at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport( > > > ClientCnxnSocketNIO.java:286) > > > > > > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) > > > > > > 12/12/17 20:54:51 INFO zookeeper.ClientCnxn: Opening socket connection > to > > > server /fe80:0:0:0:0:0:0:1%1:2181 > > > > > > 12/12/17 20:54:51 WARN zookeeper.RecoverableZooKeeper: Possibly > transient > > > ZooKeeper exception: > > > org.apache.zookeeper.KeeperException$ConnectionLossException: > > > KeeperErrorCode = ConnectionLoss for /hbase/master > > > > > > 12/12/17 20:54:51 INFO util.RetryCounter: Sleeping 2000ms before retry > > #1... > > > > > > 12/12/17 20:54:56 WARN client.ZooKeeperSaslClient: SecurityException: > > > java.lang.SecurityException: Unable to locate a login configuration > > > occurred when trying to find JAAS configuration. > > > > > > 12/12/17 20:54:56 INFO client.ZooKeeperSaslClient: Client will not > > > SASL-authenticate because the default JAAS configuration section > 'Client' > > > could not be found. If you are not using SASL, you may ignore this. On > > the > > > other hand, if you expected SASL to work, please fix your JAAS > > > configuration. > > > > > > 12/12/17 20:54:56 WARN zookeeper.ClientCnxn: Session 0x0 for server > null, > > > unexpected error, closing socket connection and attempting reconnect > > > > > > > > > I'm about as much of a newbie as you can imagine. > > > > > > I found a small piece of code that creates a table. > > > It threw endless exceptions. I fixed each by finding the correct jars > (7 > > > in all) > > > and occasionally changing a bit of the code, e.g., using, not a > > > constructor, but > > > > > > HBaseConfiguration.create(); > > > > > > > > > I'm using hbase-0.94.3 and Eclipse 4.2.1 (Juno). > > > No apache/hbase plugins, just straight Eclipse/Java. > > > > > > The only setting I've touched is hbase-site.xml > > > in which I put the path to the directory that I want my DBs in. > > > It worked from HBase Shell. > > > But of course I want it to work from Java. > > > > > > I suspect that the right info in the hbase-policy.xml would fix all > this. > > > But my understanding of HBase so far is too skimpy to know what to put +
Nick Dimiduk 2012-12-18, 08:19
-
Re: HBase 0.94 security configurationsBob Futrelle 2012-12-18, 18:15
Nick's suggestions appear to have helped, but we're not home yet.
Start-up, CLI: $./bin/start-hbase.sh starting master, logging to /Users/robertfutrelle/Research/HBase/hbase/bin/../logs/hbase-robertfutrelle-master-Macintosh.local.out Then I run my Java code, w. conf.set(…) commented out per Nick's suggestion. 23 lines of output in Eclipse console. Last line of the 23 is, 12/12/18 12:56:51 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x13baf2762e80004, negotiated timeout = 40000 Then this exception brings things to a halt, Exception in thread "main" java.lang.NoClassDefFoundError: com/google/protobuf/Message I'm a bit confused by the mixed approach in which I start HBase from the command line and then execute Java code. How do the two come together? Thank you, everyone, for your continued help. As for security, it's not even listed in the index of Lars George's HBase book. I'm confident that *persistence* will get things working (see my PS below). - Bob PS on persistence: Nothing in the world can take the place of Persistence. Talent will not; nothing is more common than unsuccessful men with talent. Genius will not; unrewarded genius is almost a proverb. Education will not; the world is full of educated derelicts. Persistence and determination alone are omnipotent. The slogan 'Press On' has solved and always will solve the problems of the human race. <http://www.quotationspage.com/quote/2771.html> [image: [info]] <http://www.quotationspage.com/quote/2771.html>[image: [add]] <http://www.quotationspage.com/myquotations.php?add=2771>[image: [mail]] <http://www.quotationspage.com/quote/2771.html#email>[image: [note]]<http://www.quotationspage.com/quote/2771.html#note> *Calvin Coolidge* On Tue, Dec 18, 2012 at 3:19 AM, Nick Dimiduk <[EMAIL PROTECTED]> wrote: > Are you using secure HBase? Don't -- it'll only get in the way for a simple > example. Is the master running? Be sure to run ./bin/start-hbase.sh from > the directory where you unpacked the tgz. You can omit the conf.set(...) > business from your code. By default, the configuration will point to local > host. > > Does any of that help? > > -n > On Dec 17, 2012 8:47 PM, "Bob Futrelle" <[EMAIL PROTECTED]> wrote: > > > Thanks for your quick reply. > > > > > > On Mon, Dec 17, 2012 at 11:25 PM, Jimmy Xiang <[EMAIL PROTECTED]> > wrote: > > > > > Have you tried IPv4? > > > > > > I can disable IPv6 in Mountain Lion, but all my "communication" is > > *within*my own machine, so I don't understand why I'd be messing with > > IP, since > > nothing I'm doing is going through my ethernet or WiFi. But that may be > > the HBase view of communication, even when entirely within a machine(?) > > It's late - will try in the morning. > > > > As for the cloudera page, it seems like a huge amount of information that > > goes way beyond the trivial setup that I'm trying to arrange for. Maybe > > what I need is buried in the page somewhere (emphasis on "buried"). > > > > As they say: "My code is so simple, what could possibly go wrong?" ;-) > > > > - Bob > > > > > > > As to secure HBase configuration, this > > > instruction may be of some help: > > > > > > https://ccp.cloudera.com/display/CDH4DOC/HBase+Security+Configuration > > > > > > Thanks, > > > Jimmy > > > > > > On Mon, Dec 17, 2012 at 8:15 PM, Bob Futrelle <[EMAIL PROTECTED]> > > > wrote: > > > > I have the same problem that Amit Sela had - an endlessly repeating > > > message > > > > in my Eclipse console: > > > > > > > > java.net.ConnectException > > > > : Connection refused > > > > > > > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > > > > > > > at > > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599) > > > > > > > > at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport( > > > > ClientCnxnSocketNIO.java:286) > > > > > > > > at > org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java +
Bob Futrelle 2012-12-18, 18:15
-
Re: HBase 0.94 security configurationsNick Dimiduk 2012-12-18, 18:26
Glad to hear you're making progress. Can you provide more information about
your environment? Are you running a released version of HBase or from a checkout of trunk? How did you install HBase -- or are you running from the tgz? How do you have the HBase dependencies specified for your Java application? Are you following along some getting started tutorial or exploring the APIs on your own? I'm a bit confused by the mixed approach in which I start HBase from the > command line and then execute Java code. How do the two come together? Even when using local/development mode, the HBase process needs to be running. the start-hbase.sh script launches the HBase processes according to your configuration. HBase ships with a reasonable default configuration, so you don't have to do any configuration and things should "just work". Your application code communicates with the HBase services using the client library. In this case, it's all encapsulated by the HBaseAdmin class. Again, the client figures out how to locate the HBase processes via configuration and again, the default configurations are sane. Why don't you start a little simpler. Start HBase and then try to create your table from the shell (`./bin/hbase shell`). Once you know your local HBase deployment is working from the shell, then you can move on to writing Java code. Best of luck! -n On Tue, Dec 18, 2012 at 10:15 AM, Bob Futrelle <[EMAIL PROTECTED]>wrote: > Nick's suggestions appear to have helped, but we're not home yet. > > Start-up, CLI: > > $./bin/start-hbase.sh > starting master, logging to > > /Users/robertfutrelle/Research/HBase/hbase/bin/../logs/hbase-robertfutrelle-master-Macintosh.local.out > > Then I run my Java code, w. conf.set(…) commented out per Nick's > suggestion. > 23 lines of output in Eclipse console. Last line of the 23 is, > > 12/12/18 12:56:51 INFO zookeeper.ClientCnxn: Session establishment complete > on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x13baf2762e80004, > negotiated timeout = 40000 > > > Then this exception brings things to a halt, > > Exception in thread "main" java.lang.NoClassDefFoundError: > com/google/protobuf/Message > > I'm a bit confused by the mixed approach in which I start HBase from the > command line and then execute Java code. How do the two come together? > > Thank you, everyone, for your continued help. > > As for security, it's not even listed in the index of Lars George's HBase > book. > > I'm confident that *persistence* will get things working (see my PS below). > > - Bob > > PS on persistence: > > Nothing in the world can take the place of Persistence. Talent will not; > nothing is more common than unsuccessful men with talent. Genius will not; > unrewarded genius is almost a proverb. Education will not; the world is > full of educated derelicts. Persistence and determination alone are > omnipotent. The slogan 'Press On' has solved and always will solve the > problems of the human race. <http://www.quotationspage.com/quote/2771.html > > > [image: [info]] <http://www.quotationspage.com/quote/2771.html>[image: > [add]] <http://www.quotationspage.com/myquotations.php?add=2771>[image: > [mail]] <http://www.quotationspage.com/quote/2771.html#email>[image: > [note]]<http://www.quotationspage.com/quote/2771.html#note> > *Calvin Coolidge* > > > On Tue, Dec 18, 2012 at 3:19 AM, Nick Dimiduk <[EMAIL PROTECTED]> wrote: > > > Are you using secure HBase? Don't -- it'll only get in the way for a > simple > > example. Is the master running? Be sure to run ./bin/start-hbase.sh from > > the directory where you unpacked the tgz. You can omit the conf.set(...) > > business from your code. By default, the configuration will point to > local > > host. > > > > Does any of that help? > > > > -n > > On Dec 17, 2012 8:47 PM, "Bob Futrelle" <[EMAIL PROTECTED]> wrote: > > > > > Thanks for your quick reply. > > > > > > > > > On Mon, Dec 17, 2012 at 11:25 PM, Jimmy Xiang <[EMAIL PROTECTED]> > > wrote: > > > > > > > Have you tried IPv4? +
Nick Dimiduk 2012-12-18, 18:26
-
Re: HBase 0.94 security configurationsMesika, Asaf 2012-12-18, 20:33
I suggest you use a Maven project.
I can copy-paste a small pom.xml for you to get you started. It will solve all of those missing JARS you have. Just make sure to install M2Eclipse plugin (Eclipse Marketplace) On Dec 18, 2012, at 8:15 PM, Bob Futrelle wrote: > Nick's suggestions appear to have helped, but we're not home yet. > > Start-up, CLI: > > $./bin/start-hbase.sh > starting master, logging to > /Users/robertfutrelle/Research/HBase/hbase/bin/../logs/hbase-robertfutrelle-master-Macintosh.local.out > > Then I run my Java code, w. conf.set(…) commented out per Nick's > suggestion. > 23 lines of output in Eclipse console. Last line of the 23 is, > > 12/12/18 12:56:51 INFO zookeeper.ClientCnxn: Session establishment complete > on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x13baf2762e80004, > negotiated timeout = 40000 > > > Then this exception brings things to a halt, > > Exception in thread "main" java.lang.NoClassDefFoundError: > com/google/protobuf/Message > > I'm a bit confused by the mixed approach in which I start HBase from the > command line and then execute Java code. How do the two come together? > > Thank you, everyone, for your continued help. > > As for security, it's not even listed in the index of Lars George's HBase > book. > > I'm confident that *persistence* will get things working (see my PS below). > > - Bob > > PS on persistence: > > Nothing in the world can take the place of Persistence. Talent will not; > nothing is more common than unsuccessful men with talent. Genius will not; > unrewarded genius is almost a proverb. Education will not; the world is > full of educated derelicts. Persistence and determination alone are > omnipotent. The slogan 'Press On' has solved and always will solve the > problems of the human race. <http://www.quotationspage.com/quote/2771.html> > [image: [info]] <http://www.quotationspage.com/quote/2771.html>[image: > [add]] <http://www.quotationspage.com/myquotations.php?add=2771>[image: > [mail]] <http://www.quotationspage.com/quote/2771.html#email>[image: > [note]]<http://www.quotationspage.com/quote/2771.html#note> > *Calvin Coolidge* > > > On Tue, Dec 18, 2012 at 3:19 AM, Nick Dimiduk <[EMAIL PROTECTED]> wrote: > >> Are you using secure HBase? Don't -- it'll only get in the way for a simple >> example. Is the master running? Be sure to run ./bin/start-hbase.sh from >> the directory where you unpacked the tgz. You can omit the conf.set(...) >> business from your code. By default, the configuration will point to local >> host. >> >> Does any of that help? >> >> -n >> On Dec 17, 2012 8:47 PM, "Bob Futrelle" <[EMAIL PROTECTED]> wrote: >> >>> Thanks for your quick reply. >>> >>> >>> On Mon, Dec 17, 2012 at 11:25 PM, Jimmy Xiang <[EMAIL PROTECTED]> >> wrote: >>> >>>> Have you tried IPv4? >>> >>> >>> I can disable IPv6 in Mountain Lion, but all my "communication" is >>> *within*my own machine, so I don't understand why I'd be messing with >>> IP, since >>> nothing I'm doing is going through my ethernet or WiFi. But that may be >>> the HBase view of communication, even when entirely within a machine(?) >>> It's late - will try in the morning. >>> >>> As for the cloudera page, it seems like a huge amount of information that >>> goes way beyond the trivial setup that I'm trying to arrange for. Maybe >>> what I need is buried in the page somewhere (emphasis on "buried"). >>> >>> As they say: "My code is so simple, what could possibly go wrong?" ;-) >>> >>> - Bob >>> >>> >>>> As to secure HBase configuration, this >>>> instruction may be of some help: >>>> >>>> https://ccp.cloudera.com/display/CDH4DOC/HBase+Security+Configuration >>>> >>>> Thanks, >>>> Jimmy >>>> >>>> On Mon, Dec 17, 2012 at 8:15 PM, Bob Futrelle <[EMAIL PROTECTED]> >>>> wrote: >>>>> I have the same problem that Amit Sela had - an endlessly repeating >>>> message >>>>> in my Eclipse console: >>>>> >>>>> java.net.ConnectException >>>>> : Connection refused +
Mesika, Asaf 2012-12-18, 20:33
-
Re: HBase 0.94 security configurationsBob Futrelle 2012-12-18, 22:27
I'm sure I found all the jars I need.
I'm not a Maven user. My son understands Maven well. He knows about the system I'm developing. He suggests that there is no need for me to learn and use Maven. My approach is straightforward. I let Eclipse do the builds and have been for, I don't know - the last ten years? Before that I guess I was using Ant for builds. It's pretty smart too. I've been able to get past hundreds of apparent showstoppers, but not this one, yet. I get plenty of "Warn" and "Info" lines in my console. Then it settles down to repeating this block of lines indefinitely: 12/12/18 17:00:22 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master 12/12/18 17:00:22 INFO util.RetryCounter: Sleeping 2000ms before retry #1... 12/12/18 17:00:22 INFO zookeeper.ClientCnxn: Opening socket connection to server /fe80:0:0:0:0:0:0:1%1:2181 12/12/18 17:00:27 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration. 12/12/18 17:00:27 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 12/12/18 17:00:27 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport( ClientCnxnSocketNIO.java:286) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) The serious exception is the java.net.ConnectException. This develops after the four calls above listed below the exception, starting in ZooKeeper. I'm thinking that I have to arrange what ./bin/start-hbase.sh does so it is in synch with what my code is trying to do, or vice-versa --- some common object/protocol that they agree on. Then a connection should work. There's lots of info about enabling HBase security, but I think I should disable it, though all the output above suggest that the SaslClient exception is only a *warn*. I've found no explicit discussions out there about disabling security or about not enabling it - same thing in the end. All my work is behind my firewall. I'm impressed how complicated it is to do something of a Hello World in HBase. I used Java DB embedded in my apps for some years. It is simple to use. It is slow. It is SQL. I want NOSlow and NOSQL, but I don't want NOSimple ;-) - Bob On Tue, Dec 18, 2012 at 3:33 PM, Mesika, Asaf <[EMAIL PROTECTED]> wrote: > I suggest you use a Maven project. > I can copy-paste a small pom.xml for you to get you started. > It will solve all of those missing JARS you have. > > Just make sure to install M2Eclipse plugin (Eclipse Marketplace) > > On Dec 18, 2012, at 8:15 PM, Bob Futrelle wrote: > > > Nick's suggestions appear to have helped, but we're not home yet. > > > > Start-up, CLI: > > > > $./bin/start-hbase.sh > > starting master, logging to > > > /Users/robertfutrelle/Research/HBase/hbase/bin/../logs/hbase-robertfutrelle-master-Macintosh.local.out > > > > Then I run my Java code, w. conf.set(…) commented out per Nick's > > suggestion. > > 23 lines of output in Eclipse console. Last line of the 23 is, > > > > 12/12/18 12:56:51 INFO zookeeper.ClientCnxn: Session establishment > complete > > on server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x13baf2762e80004, > > negotiated timeout = 40000 > > > > > > Then this exception brings things to a halt, > > > > Exception in thread "main" java.lang.NoClassDefFoundError: +
Bob Futrelle 2012-12-18, 22:27
-
Re: HBase 0.94 security configurationsBob Futrelle 2012-12-18, 23:36
I'm able to duplicate the problems I've described by using only the first
two lines of code. Entire class is: package us.tsos.nlpng.hbase.test1; import java.io.IOException; import org.apache.hadoop.hbase.client.HBaseAdmin; import org.apache.hadoop.hbase.HBaseConfiguration; public class JustCreateTable { public static void main(String[] args) throws IOException { org.apache.hadoop.conf.Configuration conf = HBaseConfiguration.create(); HBaseAdmin hbase = new HBaseAdmin(conf); } } I was careful to do ./bin/stop-hbase.sh and then ./bin/start-hbase.sh before running the code. Leaving out the second line gives immediate termination, no errors, no surprise. - Bob On Tue, Dec 18, 2012 at 5:27 PM, Bob Futrelle <[EMAIL PROTECTED]>wrote: > I'm sure I found all the jars I need. > I'm not a Maven user. > My son understands Maven well. > He knows about the system I'm developing. > He suggests that there is no need for me to learn and use Maven. > > My approach is straightforward. > I let Eclipse do the builds and have been for, > I don't know - the last ten years? > Before that I guess I was using Ant for builds. > It's pretty smart too. > > I've been able to get past hundreds of apparent showstoppers, > but not this one, yet. > > I get plenty of "Warn" and "Info" lines in my console. > Then it settles down to repeating this block of lines indefinitely: > > 12/12/18 17:00:22 WARN zookeeper.RecoverableZooKeeper: Possibly transient > ZooKeeper exception: > org.apache.zookeeper.KeeperException$ConnectionLossException: > KeeperErrorCode = ConnectionLoss for /hbase/master > > 12/12/18 17:00:22 INFO util.RetryCounter: Sleeping 2000ms before retry > #1... > > 12/12/18 17:00:22 INFO zookeeper.ClientCnxn: Opening socket connection to > server /fe80:0:0:0:0:0:0:1%1:2181 > > 12/12/18 17:00:27 WARN client.ZooKeeperSaslClient: SecurityException: > java.lang.SecurityException: Unable to locate a login configuration > occurred when trying to find JAAS configuration. > > 12/12/18 17:00:27 INFO client.ZooKeeperSaslClient: Client will not > SASL-authenticate because the default JAAS configuration section 'Client' > could not be found. If you are not using SASL, you may ignore this. On the > other hand, if you expected SASL to work, please fix your JAAS > configuration. > > 12/12/18 17:00:27 WARN zookeeper.ClientCnxn: Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > > java.net.ConnectException: Connection refused > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) > > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599) > > at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport( > ClientCnxnSocketNIO.java:286) > > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035) > > The serious exception is the java.net.ConnectException. This develops > after the four calls above listed below the exception, starting in > ZooKeeper. > > I'm thinking that I have to arrange what ./bin/start-hbase.sh does so it > is in synch with what my code is trying to do, or vice-versa --- some > common object/protocol that they agree on. Then a connection should work. > > There's lots of info about enabling HBase security, but I think I should > disable it, though all the output above suggest that the SaslClient > exception is only a *warn*. I've found no explicit discussions out there > about disabling security or about not enabling it - same thing in the end. > All my work is behind my firewall. > > I'm impressed how complicated it is to do something of a Hello World in > HBase. > > I used Java DB embedded in my apps for some years. It is simple to use. > It is slow. It is SQL. > I want NOSlow and NOSQL, but I don't want NOSimple ;-) > > - Bob > > > > On Tue, Dec 18, 2012 at 3:33 PM, Mesika, Asaf <[EMAIL PROTECTED]>wrote: > >> I suggest you use a Maven project. >> I can copy-paste a small pom.xml for you to get you started. >> It will solve all of those missing JARS you have. +
Bob Futrelle 2012-12-18, 23:36
-
Re: HBase 0.94 security configurationsNick Dimiduk 2012-12-18, 23:24
Responses inline.
On Tue, Dec 18, 2012 at 2:27 PM, Bob Futrelle <[EMAIL PROTECTED]>wrote: > I'm sure I found all the jars I need. > The suggestion that you didn't have all the jars you need is based on the NoClassDefFound exception you mentioned earlier. I'm not a Maven user. > I don't think anyone really *wants* to be a maven user. It is a MoreSimple solution to dependency management. If you're an Eclipse and Ant user, you are accustomed to pulling in dependencies by hand, and then dependencies' dependencies, and so on. Maven, for all the NotSoSimple it introduces, makes this part almost pleasant. You don't need to understand maven well to make basic use of it. My son understands Maven well. > He knows about the system I'm developing. > He suggests that there is no need for me to learn and use Maven. > I cannot comment regarding this claim. My approach is straightforward. > I let Eclipse do the builds and have been for, > I don't know - the last ten years? > You can still let Eclipse do the builds; use maven to define the dependencies and Eclipse can invoke it on your behalf. That's how many of us work every day. I get plenty of "Warn" and "Info" lines in my console. > Then it settles down to repeating this block of lines indefinitely: > > 12/12/18 17:00:22 WARN zookeeper.RecoverableZooKeeper: Possibly transient > ZooKeeper exception: > org.apache.zookeeper.KeeperException$ConnectionLossException: > KeeperErrorCode = ConnectionLoss for /hbase/master > I wonder if your HMaster process stopped for some reason. You can verify that it's running using this command, your output will look something like this: $ jps -l 22783 org.apache.hadoop.hbase.master.HMaster 22846 sun.tools.jps.Jps 15687 A simple confirmation that the process is up and running. I recommend running this a couple minutes after you run start-hbase. It can take a while for the JVM to launch, spawn threads, bind to ports, etc. All this business is because HBase is a bit more complex than an embedded SQL engine -- different beasts. java.lang.SecurityException: Unable to locate a login configuration > occurred when trying to find JAAS configuration. > This is to annoying. From my understanding, it's related to a bug in the JVM that Apple ships. See more details on this ticket: https://issues.apache.org/jira/browse/HADOOP-7489. See the comment about exporting HADOOP_OPTS for a potential method for silencing this warning. The serious exception is the java.net.ConnectException. This develops > after the four calls above listed below the exception, starting in > ZooKeeper. > Yep, this sounds like try, try, try, fail logic happening. Do be absolutely sure the HMaster process is running. I'm thinking that I have to arrange what ./bin/start-hbase.sh does so it is > in synch with what my code is trying to do, or vice-versa --- some common > object/protocol that they agree on. Then a connection should work. > So long as the hbase-client matches the hbase-serve jar versions, you should be all good. If something is broken in the start-hbase script, we (the HBase project) has much bigger issues. There's lots of info about enabling HBase security, but I think I should > disable it, though all the output above suggest that the SaslClient > exception is only a *warn*. I've found no explicit discussions out there > about disabling security or about not enabling it - same thing in the end. > All my work is behind my firewall. > Aside from the JAAS error I described above, the best way to not have security hassles is to be sure you're running a version of HBase that doesn't include security. Hence my earlier questions regarding which distribution you're running. I'm impressed how complicated it is to do something of a Hello World in > HBase. I used Java DB embedded in my apps for some years. It is simple to use. > It is slow. It is SQL. > I want NOSlow and NOSQL, but I don't want NOSimple ;-) > Nothing says "complex" like a massively concurrent, distributed state-management system like the combined powers of HDFS and HBase. That said, I want our client interfaces to be as simple and intuitive as possible. HBase is very different from the embedded SQL engines to which you're likely accustomed. If you're looking for an embedded NoSQL instead of a distributed NoSQL, maybe we can recommend a better alternative to HBase? Can you describe further your expectations? Thanks, Nick On Tue, Dec 18, 2012 at 3:33 PM, Mesika, Asaf <[EMAIL PROTECTED]> wrote: +
Nick Dimiduk 2012-12-18, 23:24
-
Re: HBase 0.94 security configurationsBob Futrelle 2012-12-19, 03:03
Nick: Thanks still again for the lengthy comments.
This is a quick reply covering some of the points. There have been no "Class not found" exceptions in the more recent versions of my system setup. jps -l immediately after starting hbase, shows: 8904 20689 sun.tools.jps.Jps 7899 467 20643 org.apache.hadoop.hbase.master.HMaster I have been unable to find a version of HBase that doesn't include security. I'd be most happy to use one if I can find it. Suggestions? ------------------- My goals and needs: Store/access about one giga words of full text biology research papers (XML, HTML), about 10GB. As I analyze them, I'll probably generate a total of ten times that amount of related data, 100GB, such as machine learning results, part-of-speech tagged text, lexicons, ontologies, parse trees, etc. All will need DBs. All of this, including a concept retrieval system, will be proof of concept. After I get some publications based on the system and results, I'll distribute the code and data. I'll leave it to others to use it as they see fit. The system is so novel, and hopefully powerful, that I can imagine writing a monograph describing it. My focus is, and always has been, basic science, with a career spanning theoretical physics, experimental biology, and for the last 25 years, a faculty member of the College of Computer and Information Science at Northeastern University in Boston. I retired at the end of June, 2011. I've gone back to have another look at Cassandra. The CLI is straightforward, but Java will be the test. - Bob Futrelle On Tue, Dec 18, 2012 at 6:24 PM, Nick Dimiduk <[EMAIL PROTECTED]> wrote: > Responses inline. > > On Tue, Dec 18, 2012 at 2:27 PM, Bob Futrelle <[EMAIL PROTECTED] > >wrote: > > > I'm sure I found all the jars I need. > > > > The suggestion that you didn't have all the jars you need is based on the > NoClassDefFound exception you mentioned earlier. > > I'm not a Maven user. > > > > I don't think anyone really *wants* to be a maven user. It is a MoreSimple > solution to dependency management. If you're an Eclipse and Ant user, you > are accustomed to pulling in dependencies by hand, and then dependencies' > dependencies, and so on. Maven, for all the NotSoSimple it introduces, > makes this part almost pleasant. You don't need to understand maven well to > make basic use of it. > > My son understands Maven well. > > He knows about the system I'm developing. > > He suggests that there is no need for me to learn and use Maven. > > > > I cannot comment regarding this claim. > > My approach is straightforward. > > I let Eclipse do the builds and have been for, > > I don't know - the last ten years? > > > > You can still let Eclipse do the builds; use maven to define the > dependencies and Eclipse can invoke it on your behalf. That's how many of > us work every day. > > I get plenty of "Warn" and "Info" lines in my console. > > Then it settles down to repeating this block of lines indefinitely: > > > > 12/12/18 17:00:22 WARN zookeeper.RecoverableZooKeeper: Possibly transient > > ZooKeeper exception: > > org.apache.zookeeper.KeeperException$ConnectionLossException: > > KeeperErrorCode = ConnectionLoss for /hbase/master > > > > I wonder if your HMaster process stopped for some reason. You can verify > that it's running using this command, your output will look something like > this: > > $ jps -l > 22783 org.apache.hadoop.hbase.master.HMaster > 22846 sun.tools.jps.Jps > 15687 > > A simple confirmation that the process is up and running. I recommend > running this a couple minutes after you run start-hbase. It can take a > while for the JVM to launch, spawn threads, bind to ports, etc. All this > business is because HBase is a bit more complex than an embedded SQL engine > -- different beasts. > > java.lang.SecurityException: Unable to locate a login configuration > > occurred when trying to find JAAS configuration. > > > > This is to annoying. From my understanding, it's related to a bug in the +
Bob Futrelle 2012-12-19, 03:03
-
Re: HBase 0.94 security configurationsAndrew Purtell 2012-12-19, 04:28
Wow.
That security exception encountered was harmless and a red herring unfortunately (HBase security is not enabled unless you take several steps not done here), and assumptions from that point have made this quite unsatisfactory for everyone. I wish you well with your explorations of Cassandra. Perhaps with a bit more humility when approaching an unfamiliar system in that case you'll have a better result. On Tuesday, December 18, 2012, Bob Futrelle wrote: > Nick: Thanks still again for the lengthy comments. > This is a quick reply covering some of the points. > > There have been no "Class not found" exceptions in the more recent versions > of my system setup. > > jps -l immediately after starting hbase, shows: > > 8904 > 20689 sun.tools.jps.Jps > 7899 > 467 > 20643 org.apache.hadoop.hbase.master.HMaster > > > I have been unable to find a version of HBase that doesn't include > security. > I'd be most happy to use one if I can find it. Suggestions? > > ------------------- > > My goals and needs: Store/access about one giga words of full text biology > research papers (XML, HTML), about 10GB. As I analyze them, I'll probably > generate a total of ten times that amount of related data, 100GB, such as > machine learning results, part-of-speech tagged text, lexicons, ontologies, > parse trees, etc. All will need DBs. > > All of this, including a concept retrieval system, will be proof of > concept. After I get some publications based on the system and results, > I'll distribute the code and data. I'll leave it to others to use it as > they see fit. > > The system is so novel, and hopefully powerful, that I can imagine writing > a monograph describing it. > > My focus is, and always has been, basic science, with a career spanning > theoretical physics, experimental biology, and for the last 25 years, a > faculty member of the College of Computer and Information Science at > Northeastern University in Boston. I retired at the end of June, 2011. > > I've gone back to have another look at Cassandra. The CLI is > straightforward, but Java will be the test. > > - Bob Futrelle > > > > > On Tue, Dec 18, 2012 at 6:24 PM, Nick Dimiduk <[EMAIL PROTECTED]> wrote: > > > Responses inline. > > > > On Tue, Dec 18, 2012 at 2:27 PM, Bob Futrelle <[EMAIL PROTECTED] > > >wrote: > > > > > I'm sure I found all the jars I need. > > > > > > > The suggestion that you didn't have all the jars you need is based on the > > NoClassDefFound exception you mentioned earlier. > > > > I'm not a Maven user. > > > > > > > I don't think anyone really *wants* to be a maven user. It is a > MoreSimple > > solution to dependency management. If you're an Eclipse and Ant user, you > > are accustomed to pulling in dependencies by hand, and then dependencies' > > dependencies, and so on. Maven, for all the NotSoSimple it introduces, > > makes this part almost pleasant. You don't need to understand maven well > to > > make basic use of it. > > > > My son understands Maven well. > > > He knows about the system I'm developing. > > > He suggests that there is no need for me to learn and use Maven. > > > > > > > I cannot comment regarding this claim. > > > > My approach is straightforward. > > > I let Eclipse do the builds and have been for, > > > I don't know - the last ten years? > > > > > > > You can still let Eclipse do the builds; use maven to define the > > dependencies and Eclipse can invoke it on your behalf. That's how many of > > us work every day. > > > > I get plenty of "Warn" and "Info" lines in my console. > > > Then it settles down to repeating this block of lines indefinitely: > > > > > > 12/12/18 17:00:22 WARN zookeeper.RecoverableZooKeeper: Possibly > transient > > > ZooKeeper exception: > > > org.apache.zookeeper.KeeperException$ConnectionLossException: > > > KeeperErrorCode = ConnectionLoss for /hbase/master > > > > > > > I wonder if your HMaster process stopped for some reason. You can verify > > that it's running using this command, your output will look something Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White) +
Andrew Purtell 2012-12-19, 04:28
-
Re: HBase 0.94 security configurationsBob Futrelle 2012-12-19, 04:58
I really don't understand what you are saying.
>From the beginning I stated that I was very much a beginner. I valued all the advice I got. I felt humble in the presence of you true experts. So to interpret my actions as lacking humility is confusing. What in the world did I do "wrong" that I could have done "right", given my weak understanding of HBase? I'm sorry if somehow I've made this "unsatisfactory" for everyone. Are you suggesting that Nick and the others had an unsatisfactory experience? I didn't sense that in any of his helpful answers. Again, I do apologize for my actions and responses. Though in all honesty I don't understand what of what I said was "lacking humility". After 50+ years of computing experience I fully respect the complexities of computing and would never and have never pretended that somehow I know a lot about things I actually don't know much about. My friends will tell you that I don't have an arrogant bone in my body. I am certainly not abandoning my pursuit of HBase, though I will look into Cassandra. Looks like I'll really have to work on HBase entirely on my own, since you seem to be suggesting that I'm a persona non grata on this user list. As I said, I will persist. I have work to do and I was seeking the best tools to help me in my work, which is not databases, but natural language understanding. - Bob Futrelle On Tue, Dec 18, 2012 at 11:28 PM, Andrew Purtell <[EMAIL PROTECTED]>wrote: > Wow. > > That security exception encountered was harmless and a red herring > unfortunately (HBase security is not enabled unless you take several steps > not done here), and assumptions from that point have made this quite > unsatisfactory for everyone. I wish you well with your explorations of > Cassandra. Perhaps with a bit more humility when approaching an unfamiliar > system in that case you'll have a better result. > > > On Tuesday, December 18, 2012, Bob Futrelle wrote: > > > Nick: Thanks still again for the lengthy comments. > > This is a quick reply covering some of the points. > > > > There have been no "Class not found" exceptions in the more recent > versions > > of my system setup. > > > > jps -l immediately after starting hbase, shows: > > > > 8904 > > 20689 sun.tools.jps.Jps > > 7899 > > 467 > > 20643 org.apache.hadoop.hbase.master.HMaster > > > > > > I have been unable to find a version of HBase that doesn't include > > security. > > I'd be most happy to use one if I can find it. Suggestions? > > > > ------------------- > > > > My goals and needs: Store/access about one giga words of full text > biology > > research papers (XML, HTML), about 10GB. As I analyze them, I'll > probably > > generate a total of ten times that amount of related data, 100GB, such as > > machine learning results, part-of-speech tagged text, lexicons, > ontologies, > > parse trees, etc. All will need DBs. > > > > All of this, including a concept retrieval system, will be proof of > > concept. After I get some publications based on the system and results, > > I'll distribute the code and data. I'll leave it to others to use it as > > they see fit. > > > > The system is so novel, and hopefully powerful, that I can imagine > writing > > a monograph describing it. > > > > My focus is, and always has been, basic science, with a career spanning > > theoretical physics, experimental biology, and for the last 25 years, a > > faculty member of the College of Computer and Information Science at > > Northeastern University in Boston. I retired at the end of June, 2011. > > > > I've gone back to have another look at Cassandra. The CLI is > > straightforward, but Java will be the test. > > > > - Bob Futrelle > > > > > > > > > > On Tue, Dec 18, 2012 at 6:24 PM, Nick Dimiduk <[EMAIL PROTECTED]> > wrote: > > > > > Responses inline. > > > > > > On Tue, Dec 18, 2012 at 2:27 PM, Bob Futrelle <[EMAIL PROTECTED] > > > >wrote: > > > > > > > I'm sure I found all the jars I need. > > > > > > > > > > The suggestion that you didn't have all the jars you need is based on +
Bob Futrelle 2012-12-19, 04:58
-
Re: HBase 0.94 security configurationsAndrew Purtell 2012-12-19, 05:14
Many more assumptions. The *only* thing I said is you should try
approaching an unfamiliar system with a bit more humility. I doubt Nick wouldn't be interested in helping you further. It might be helpful, rather than argue what you or your son might think, to ask Nick et al for clarification or more step by step help. On Tuesday, December 18, 2012, Bob Futrelle wrote: > I really don't understand what you are saying. > From the beginning I stated that I was very much a beginner. > I valued all the advice I got. > I felt humble in the presence of you true experts. > So to interpret my actions as lacking humility is confusing. > > What in the world did I do "wrong" that I could have done "right", > given my weak understanding of HBase? > > I'm sorry if somehow I've made this "unsatisfactory" for everyone. > Are you suggesting that Nick and the others had an unsatisfactory > experience? > I didn't sense that in any of his helpful answers. > > Again, I do apologize for my actions and responses. > Though in all honesty I don't understand what of what I said > was "lacking humility". After 50+ years of computing experience > I fully respect the complexities of computing and would never > and have never pretended that somehow I know a lot about > things I actually don't know much about. > > My friends will tell you that I don't have an arrogant bone in my body. > > I am certainly not abandoning my pursuit of HBase, > though I will look into Cassandra. > > Looks like I'll really have to work on HBase entirely on my own, since > you seem to be suggesting that I'm a persona non grata on this > user list. > > As I said, I will persist. I have work to do and I was seeking the best > tools > to help me in my work, which is not databases, but natural language > understanding. > > - Bob Futrelle > > > > On Tue, Dec 18, 2012 at 11:28 PM, Andrew Purtell <[EMAIL PROTECTED]<javascript:;> > >wrote: > > > Wow. > > > > That security exception encountered was harmless and a red herring > > unfortunately (HBase security is not enabled unless you take several > steps > > not done here), and assumptions from that point have made this quite > > unsatisfactory for everyone. I wish you well with your explorations of > > Cassandra. Perhaps with a bit more humility when approaching an > unfamiliar > > system in that case you'll have a better result. > > > > > > On Tuesday, December 18, 2012, Bob Futrelle wrote: > > > > > Nick: Thanks still again for the lengthy comments. > > > This is a quick reply covering some of the points. > > > > > > There have been no "Class not found" exceptions in the more recent > > versions > > > of my system setup. > > > > > > jps -l immediately after starting hbase, shows: > > > > > > 8904 > > > 20689 sun.tools.jps.Jps > > > 7899 > > > 467 > > > 20643 org.apache.hadoop.hbase.master.HMaster > > > > > > > > > I have been unable to find a version of HBase that doesn't include > > > security. > > > I'd be most happy to use one if I can find it. Suggestions? > > > > > > ------------------- > > > > > > My goals and needs: Store/access about one giga words of full text > > biology > > > research papers (XML, HTML), about 10GB. As I analyze them, I'll > > probably > > > generate a total of ten times that amount of related data, 100GB, such > as > > > machine learning results, part-of-speech tagged text, lexicons, > > ontologies, > > > parse trees, etc. All will need DBs. > > > > > > All of this, including a concept retrieval system, will be proof of > > > concept. After I get some publications based on the system and > results, > > > I'll distribute the code and data. I'll leave it to others to use it > as > > > they see fit. > > > > > > The system is so novel, and hopefully powerful, that I can imagine > > writing > > > a monograph describing it. > > > > > > My focus is, and always has been, basic science, with a career spanning > > > theoretical physics, experimental biology, and for the last 25 years, a > > > faculty member of the College of Computer and Information Science at Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White) +
Andrew Purtell 2012-12-19, 05:14
-
Re: HBase 0.94 security configurationsBob Futrelle 2012-12-19, 05:45
There sure is a major misunderstanding here.
I approach all unfamiliar systems with a great deal of humility. How you managed to detect something other than that in the things I said, I don't know. I am rather high-spirited so sometimes in the rush of things I say things that make it appear that I'm something I'm not. I was not "arguing" about what my son and I thought. I was simply *reporting* a conversation I had with him. He's a true expert in many areas with excellent skills. He is also familiar with my working style, so he adjusts his advice accordingly. Nick has been extremely helpful and I've been careful to thank him and all of you as your advice arrived. I do that because I am in fact grateful when people take the time to help a neophyte like me who is trying to work through the thickets of complexity in large modern systems such as HBase. I haven't had time to thoroughly digest all the helpful advice I've been given. I'll print out the entire stream tomorrow and study it on my own and experiment on my own for a while. I'll also do some designing and prototype them via the Shell. I've had no problems with the Shell so far. With luck, you won't hear from me for a while and when you do I hope it will be a brief note that things are working for me. - Bob On Wed, Dec 19, 2012 at 12:14 AM, Andrew Purtell <[EMAIL PROTECTED]>wrote: > Many more assumptions. The *only* thing I said is you should try > approaching an unfamiliar system with a bit more humility. I doubt Nick > wouldn't be interested in helping you further. It might be helpful, rather > than argue what you or your son might think, to ask Nick et al for > clarification or more step by step help. > > On Tuesday, December 18, 2012, Bob Futrelle wrote: > > > I really don't understand what you are saying. > > From the beginning I stated that I was very much a beginner. > > I valued all the advice I got. > > I felt humble in the presence of you true experts. > > So to interpret my actions as lacking humility is confusing. > > > > What in the world did I do "wrong" that I could have done "right", > > given my weak understanding of HBase? > > > > I'm sorry if somehow I've made this "unsatisfactory" for everyone. > > Are you suggesting that Nick and the others had an unsatisfactory > > experience? > > I didn't sense that in any of his helpful answers. > > > > Again, I do apologize for my actions and responses. > > Though in all honesty I don't understand what of what I said > > was "lacking humility". After 50+ years of computing experience > > I fully respect the complexities of computing and would never > > and have never pretended that somehow I know a lot about > > things I actually don't know much about. > > > > My friends will tell you that I don't have an arrogant bone in my body. > > > > I am certainly not abandoning my pursuit of HBase, > > though I will look into Cassandra. > > > > Looks like I'll really have to work on HBase entirely on my own, since > > you seem to be suggesting that I'm a persona non grata on this > > user list. > > > > As I said, I will persist. I have work to do and I was seeking the best > > tools > > to help me in my work, which is not databases, but natural language > > understanding. > > > > - Bob Futrelle > > > > > > > > On Tue, Dec 18, 2012 at 11:28 PM, Andrew Purtell <[EMAIL PROTECTED] > <javascript:;> > > >wrote: > > > > > Wow. > > > > > > That security exception encountered was harmless and a red herring > > > unfortunately (HBase security is not enabled unless you take several > > steps > > > not done here), and assumptions from that point have made this quite > > > unsatisfactory for everyone. I wish you well with your explorations of > > > Cassandra. Perhaps with a bit more humility when approaching an > > unfamiliar > > > system in that case you'll have a better result. > > > > > > > > > On Tuesday, December 18, 2012, Bob Futrelle wrote: > > > > > > > Nick: Thanks still again for the lengthy comments. > > > > This is a quick reply covering some of the points. +
Bob Futrelle 2012-12-19, 05:45
|