|
Jean-Marc Spaggiari
2012-11-18, 13:59
Kevin O'dell
2012-11-18, 15:37
Kevin O'dell
2012-11-18, 15:47
Jean-Marc Spaggiari
2012-11-18, 16:42
Jean-Marc Spaggiari
2012-11-18, 16:52
Jean-Marc Spaggiari
2012-11-18, 23:34
Kevin O'dell
2012-11-19, 01:16
Jean-Marc Spaggiari
2012-11-19, 02:31
|
-
Merging regionsJean-Marc Spaggiari 2012-11-18, 13:59
Hi,
I'm trying to merge 2 regions based on the book documentation and I'm getting the exception at the bottom of this message. Any idea why? I got the regions names from the HTML UI. I tried also to scan the .META. table like in Lars' book. Both are giving me the same info (a chance!), but it's still not working. Also, the HBase online book is not giving the right class info for the merge. I will open a Jira and propose a patch. Thanks, JM hbase@node3:~/hbase-0.94.2$ bin/hbase org.apache.hadoop.hbase.util.Merge work_proposed work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378. work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d. 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is available... 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not running... 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:host.name=node3 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_05 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/local/jdk1.7.0_05/jre 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hbase/hbase-0.94.2//lib/jettison-1.1.jar:/home/hbase/hbase-0.94.2//lib/jetty-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jetty-util-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jruby-complete-1.6.5.jar:/home/hbase/hbase-0.94.2//lib/jsp-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsp-api-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsr305-1.3.9.jar:/home/hbase/hbase-0.94.2//lib/junit-4.10-HBASE-1.jar:/home/hbase/hbase-0.94.2//lib/libthrift-0.8.0.jar:/home/hbase/hbase-0.94.2//lib/log4j-1.2.16.jar:/home/hbase/hbase-0.94.2//lib/metrics-core-2.1.2.jar:/home/hbase/hbase-0.94.2//lib/netty-3.2.4.Final.jar:/home/hbase/hbase-0.94.2//lib/protobuf-java-2.4.0a.jar:/home/hbase/hbase-0.94.2//lib/servlet-api-2.5-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/slf4j-api-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/slf4j-log4j12-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/snappy-java-1.0.3.2.jar:/home/hbase/hbase-0.94.2//lib/stax-api-1.0.1.jar:/home/hbase/hbase-0.94.2//lib/velocity-1.7.jar:/home/hbase/hbase-0.94.2//lib/xmlenc-0.52.jar:/home/hbase/hbase-0.94.2//lib/zookeeper-3.4.3.jar: 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/home/hbase/hbase-0.94.2//lib/native/Linux-amd64-64 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:os.version=3.2.0-4-amd64 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:user.name=hbase 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/hbase 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/hbase/hbase-0.94.2 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=latitude:2181,cube:2181,node3:2181 sessionTimeout=180000 watcher=hconnection 12/11/18 08:54:05 INFO zookeeper.ClientCnxn: Opening socket connection to server /192.168.23.1:2181 12/11/18 08:54:05 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 7006@node3 12/11/18 08:54:05 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration. 12/11/18 08:54
-
Re: Merging regionsKevin O'dell 2012-11-18, 15:37
Looks like your configuration is pointing local.
On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari" <[EMAIL PROTECTED]> wrote: > Hi, > > I'm trying to merge 2 regions based on the book documentation and I'm > getting the exception at the bottom of this message. Any idea why? > > I got the regions names from the HTML UI. I tried also to scan the > .META. table like in Lars' book. Both are giving me the same info (a > chance!), but it's still not working. > > Also, the HBase online book is not giving the right class info for the > merge. I will open a Jira and propose a patch. > > Thanks, > > JM > > hbase@node3:~/hbase-0.94.2$ bin/hbase > org.apache.hadoop.hbase.util.Merge work_proposed > work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378. > work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d. > 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is > available... > 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not running... > 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 > GMT > 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:host.name > =node3 > 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > environment:java.version=1.7.0_05 > 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > environment:java.vendor=Oracle Corporation > 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > environment:java.home=/usr/local/jdk1.7.0_05/jre > 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > > environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hbase/hbase-0.94.2//lib/jettison-1.1.jar:/home/hbase/hbase-0.94.2//lib/jetty-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jetty-util-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jruby-complete-1.6.5.jar:/home/hbase/hbase-0.94.2//lib/jsp-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsp-api-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsr305-1.3.9.jar:/home/hbase/hbase-0.94.2//lib/junit-4.10-HBASE-1.jar:/home/hbase/hbase-0.94.2//lib/libthrift-0.8.0.jar:/home/hbase/hbase-0.94.2//lib/log4j-1.2.16.jar:/home/hbase/hbase-0.94.2//lib/metrics-core-2.1.2.jar:/home/hbase/hbase-0.94.2//lib/netty-3.2.4.Final.jar:/home/hbase/hbase-0.94.2//lib/protobuf-java-2.4.0a.jar:/home/hbase/hbase-0.94.2//lib/servlet-api-2.5-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/slf4j-api-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/slf4j-log4j12-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/snappy-java-1.0.3.2.jar:/home/hbase/hbase-0.94.2//lib/stax-api-1.0.1.jar:/home/hbase/hbase-0.94.2//lib/velocity-1.7.jar:/home/hbase/hbase-0.94.2//lib/xmlenc-0.52.jar:/home/hbase/hbase-0.94.2//lib/zookeeper-3.4.3.jar:
-
Re: Merging regionsKevin O'dell 2012-11-18, 15:47
Rather it is expecting local:
12/11/18 08:54:05 FATAL util.Merge: Merge failed java.lang.IllegalArgumentException: Wrong FS: hdfs://node3:9000/hbase/-ROOT-/70236052/.regioninfo, expected: file:///at org.apache.hadoop.fs. FileSystem.checkPath(FileSystem.java:381) On Nov 18, 2012 10:37 AM, "Kevin O'dell" <[EMAIL PROTECTED]> wrote: > Looks like your configuration is pointing local. > On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari" <[EMAIL PROTECTED]> > wrote: > >> Hi, >> >> I'm trying to merge 2 regions based on the book documentation and I'm >> getting the exception at the bottom of this message. Any idea why? >> >> I got the regions names from the HTML UI. I tried also to scan the >> .META. table like in Lars' book. Both are giving me the same info (a >> chance!), but it's still not working. >> >> Also, the HBase online book is not giving the right class info for the >> merge. I will open a Jira and propose a patch. >> >> Thanks, >> >> JM >> >> hbase@node3:~/hbase-0.94.2$ bin/hbase >> org.apache.hadoop.hbase.util.Merge work_proposed >> work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378. >> work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d. >> 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is >> available... >> 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not running... >> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 >> GMT >> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:host.name >> =node3 >> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >> environment:java.version=1.7.0_05 >> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >> environment:java.vendor=Oracle Corporation >> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >> environment:java.home=/usr/local/jdk1.7.0_05/jre >> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >> >> environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hbase/hbase-0.94.2//lib/jettison-1.1.jar:/home/hbase/hbase-0.94.2//lib/jetty-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jetty-util-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jruby-complete-1.6.5.jar:/home/hbase/hbase-0.94.2//lib/jsp-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsp-api-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsr305-1.3.9.jar:/home/hbase/hbase-0.94.2//lib/junit-4.10-HBASE-1.jar:/home/hbase/hbase-0.94.2//lib/libthrift-0.8.0.jar:/home/hbase/hbase-0.94.2//lib/log4j-1.2.16.jar:/home/hbase/hbase-0.94.2//lib/metrics-core-2.1.2.jar:/home/hbase/hbase-0.94.2//lib/netty-3.2.4.Final.jar:/home/hbase/hbase-0.94.2//lib/protobuf-java-2.4.0a.jar:/home/hbase/hbase-0.94.2//lib/servlet-api-2.5-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/slf4j-api-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/slf4j-log4j12-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/snappy-java-1.0.3.2.jar:/home/hbase/hbase-0.94.2//lib/stax-api-1.0.1.jar:/home/hbase/hbase-0.94.2//lib/velocity-1.7.jar:/home/hbase/hbase-0.94.2//lib/xmlenc-0.52.jar:/home/hbase/hbase-0.94.2//lib/zookeeper-3.4.3.jar:
-
Re: Merging regionsJean-Marc Spaggiari 2012-11-18, 16:42
And that's the issue.
I have an 8 nodes cluster, with 3 ZK servers, everything working fine. I just ran a MP last week which has generated a 400M rows table. But I hae wrongly pre-split the table. so I want to merge and re-split it. I tried with the cluster on and it has detected it and stopped the merge. I stoped de cluster but it's trying to access the file locally? I ran the merge on the master server directly from the HBase directory. I will take a look at see if there is any other parameter I should pass, or if I missed something... JM 2012/11/18, Kevin O'dell <[EMAIL PROTECTED]>: > Rather it is expecting local: > > 12/11/18 08:54:05 FATAL util.Merge: Merge failed > java.lang.IllegalArgumentException: Wrong FS: > hdfs://node3:9000/hbase/-ROOT-/70236052/.regioninfo, expected: file:///at > org.apache.hadoop.fs. FileSystem.checkPath(FileSystem.java:381) > On Nov 18, 2012 10:37 AM, "Kevin O'dell" <[EMAIL PROTECTED]> wrote: > >> Looks like your configuration is pointing local. >> On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari" <[EMAIL PROTECTED]> >> wrote: >> >>> Hi, >>> >>> I'm trying to merge 2 regions based on the book documentation and I'm >>> getting the exception at the bottom of this message. Any idea why? >>> >>> I got the regions names from the HTML UI. I tried also to scan the >>> .META. table like in Lars' book. Both are giving me the same info (a >>> chance!), but it's still not working. >>> >>> Also, the HBase online book is not giving the right class info for the >>> merge. I will open a Jira and propose a patch. >>> >>> Thanks, >>> >>> JM >>> >>> hbase@node3:~/hbase-0.94.2$ bin/hbase >>> org.apache.hadoop.hbase.util.Merge work_proposed >>> work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378. >>> work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d. >>> 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is >>> available... >>> 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not >>> running... >>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 >>> GMT >>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:host.name >>> =node3 >>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>> environment:java.version=1.7.0_05 >>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>> environment:java.vendor=Oracle Corporation >>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>> environment:java.home=/usr/local/jdk1.7.0_05/jre >>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>> >>> environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hbase/hbase-0.94.2//lib/jettison-1.1.jar:/home/hbase/hbase-0.94.2//lib/jetty-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jetty-util-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jruby-complete-1.6.5.jar:/home/hbase/hbase-0.94.2//lib/jsp-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsp-api-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsr305-1.3.9.jar:/home/hbase/hbase-0.94.2//lib/junit-4.10-HBASE-1.jar:/home/hbase/hbase-0.94.2//lib/libthrift-0.8.0.jar:/home/hbase/hbase-0.94.2//lib/log4j-1.2.16.jar:/home/hbase/hbase-0.94.2//lib/metrics-core-2.1.2.jar:/home/hbase/hbase-0.94.2//lib/netty-3.2.4.Final.jar:/home/hbase/hbase-0.94.2//lib/protobuf-java-2.4.0a.jar:/home/hbase/hbase-0.94.2//lib/servlet-api-2.5-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/slf4j-api-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/slf4j-log4j12-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/snappy-java-1.0.3.2.jar:/home/hbase/hbase-0.94.2//lib/stax-api-1.0.1.jar:/home/hbase/hbase-0.94.2//lib/velocity-1.7.jar:/home/hbase/hbase-0.94.2//lib/xmlenc-0.52.jar:/home/hbase/hbase-0.94.2//lib/zookeeper-3.4.3.jar:
-
Re: Merging regionsJean-Marc Spaggiari 2012-11-18, 16:52
Hum
I tried the --config parameters but I donc think bin/hbase is reading it. I have exported HBASE_CONFIG but same result. Does anyone have succeed in a merge recently? I will try to google that to see if there is something I missed 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>: > And that's the issue. > > I have an 8 nodes cluster, with 3 ZK servers, everything working fine. > I just ran a MP last week which has generated a 400M rows table. But I > hae wrongly pre-split the table. so I want to merge and re-split it. > > I tried with the cluster on and it has detected it and stopped the merge. > I stoped de cluster but it's trying to access the file locally? I ran > the merge on the master server directly from the HBase directory. > > I will take a look at see if there is any other parameter I should > pass, or if I missed something... > > JM > > 2012/11/18, Kevin O'dell <[EMAIL PROTECTED]>: >> Rather it is expecting local: >> >> 12/11/18 08:54:05 FATAL util.Merge: Merge failed >> java.lang.IllegalArgumentException: Wrong FS: >> hdfs://node3:9000/hbase/-ROOT-/70236052/.regioninfo, expected: file:///at >> org.apache.hadoop.fs. FileSystem.checkPath(FileSystem.java:381) >> On Nov 18, 2012 10:37 AM, "Kevin O'dell" <[EMAIL PROTECTED]> >> wrote: >> >>> Looks like your configuration is pointing local. >>> On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari" <[EMAIL PROTECTED]> >>> wrote: >>> >>>> Hi, >>>> >>>> I'm trying to merge 2 regions based on the book documentation and I'm >>>> getting the exception at the bottom of this message. Any idea why? >>>> >>>> I got the regions names from the HTML UI. I tried also to scan the >>>> .META. table like in Lars' book. Both are giving me the same info (a >>>> chance!), but it's still not working. >>>> >>>> Also, the HBase online book is not giving the right class info for the >>>> merge. I will open a Jira and propose a patch. >>>> >>>> Thanks, >>>> >>>> JM >>>> >>>> hbase@node3:~/hbase-0.94.2$ bin/hbase >>>> org.apache.hadoop.hbase.util.Merge work_proposed >>>> work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378. >>>> work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d. >>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is >>>> available... >>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not >>>> running... >>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 >>>> GMT >>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>> environment:host.name >>>> =node3 >>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>> environment:java.version=1.7.0_05 >>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>> environment:java.vendor=Oracle Corporation >>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>> environment:java.home=/usr/local/jdk1.7.0_05/jre >>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>> >>>> environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hbase/hbase-0.94.2//lib/jettison-1.1.jar:/home/hbase/hbase-0.94.2//lib/jetty-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jetty-util-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jruby-complete-1.6.5.jar:/home/hbase/hbase-0.94.2//lib/jsp-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsp-api-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsr305-1.3.9.jar:/home/hbase/hbase-0.94.2//lib/junit-4.10-HBASE-1.jar:/home/hbase/hbase-0.94.2//lib/libthrift-0.8.0.jar:/home/hbase/hbase-0.94.2//lib/log4j-1.2.16.jar:/home/hbase/hbase-0.94.2//lib/metrics-core-2.1.2.jar:/home/hbase/hbase-0.94.2//lib/netty-3.2.4.Final.jar:/home/hbase/hbase-0.94.2//lib/protobuf-java-2.4.0a.jar:/home/hbase/hbase-0.94.2//lib/servlet-api-2.5-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/slf4j-api-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/slf4j-log4j12-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/snappy-java-1.0.3.2.jar:/home/hbase/hbase-0.94.2//lib/stax-a
-
Re: Merging regionsJean-Marc Spaggiari 2012-11-18, 23:34
Seems it has been discussed a year ago ;)
http://www.mail-archive.com/[EMAIL PROTECTED]/msg11383.html It looks like I need to setup fs.default.name ... I tried few different values, but even so it's not working. What should this value look like? I used hdfs://localhost/ and the same with the master (also hosting the namenode) with no success. Any idea what it should be? Thanks, JM 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>: > Hum > > I tried the --config parameters but I donc think bin/hbase is reading it. > > I have exported HBASE_CONFIG but same result. > > Does anyone have succeed in a merge recently? > > I will try to google that to see if there is something I missed > > 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>: >> And that's the issue. >> >> I have an 8 nodes cluster, with 3 ZK servers, everything working fine. >> I just ran a MP last week which has generated a 400M rows table. But I >> hae wrongly pre-split the table. so I want to merge and re-split it. >> >> I tried with the cluster on and it has detected it and stopped the merge. >> I stoped de cluster but it's trying to access the file locally? I ran >> the merge on the master server directly from the HBase directory. >> >> I will take a look at see if there is any other parameter I should >> pass, or if I missed something... >> >> JM >> >> 2012/11/18, Kevin O'dell <[EMAIL PROTECTED]>: >>> Rather it is expecting local: >>> >>> 12/11/18 08:54:05 FATAL util.Merge: Merge failed >>> java.lang.IllegalArgumentException: Wrong FS: >>> hdfs://node3:9000/hbase/-ROOT-/70236052/.regioninfo, expected: >>> file:///at >>> org.apache.hadoop.fs. FileSystem.checkPath(FileSystem.java:381) >>> On Nov 18, 2012 10:37 AM, "Kevin O'dell" <[EMAIL PROTECTED]> >>> wrote: >>> >>>> Looks like your configuration is pointing local. >>>> On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari" >>>> <[EMAIL PROTECTED]> >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> I'm trying to merge 2 regions based on the book documentation and I'm >>>>> getting the exception at the bottom of this message. Any idea why? >>>>> >>>>> I got the regions names from the HTML UI. I tried also to scan the >>>>> .META. table like in Lars' book. Both are giving me the same info (a >>>>> chance!), but it's still not working. >>>>> >>>>> Also, the HBase online book is not giving the right class info for the >>>>> merge. I will open a Jira and propose a patch. >>>>> >>>>> Thanks, >>>>> >>>>> JM >>>>> >>>>> hbase@node3:~/hbase-0.94.2$ bin/hbase >>>>> org.apache.hadoop.hbase.util.Merge work_proposed >>>>> work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378. >>>>> work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d. >>>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is >>>>> available... >>>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not >>>>> running... >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>>> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 >>>>> GMT >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>>> environment:host.name >>>>> =node3 >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>>> environment:java.version=1.7.0_05 >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>>> environment:java.vendor=Oracle Corporation >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>>> environment:java.home=/usr/local/jdk1.7.0_05/jre >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client >>>>> >>>>> environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hbase/hbase-0.94.2//lib/jettison-1.1.jar:/home/hbase/hbase-0.94.2//lib/jetty-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jetty-util-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jruby-complete-1.6.5.jar:/home/hbase/hbase-0.94.2//lib/jsp-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsp-api-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsr305-1.3.9.jar:/home/hbase/hba
-
Re: Merging regionsKevin O'dell 2012-11-19, 01:16
You should be able to grab that from the core-site and add it into you
hbase-site. On Nov 18, 2012 6:34 PM, "Jean-Marc Spaggiari" <[EMAIL PROTECTED]> wrote: > Seems it has been discussed a year ago ;) > > http://www.mail-archive.com/[EMAIL PROTECTED]/msg11383.html > > It looks like I need to setup fs.default.name ... I tried few > different values, but even so it's not working. What should this value > look like? I used hdfs://localhost/ and the same with the master (also > hosting the namenode) with no success. Any idea what it should be? > > Thanks, > > JM > > 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>: > > Hum > > > > I tried the --config parameters but I donc think bin/hbase is reading it. > > > > I have exported HBASE_CONFIG but same result. > > > > Does anyone have succeed in a merge recently? > > > > I will try to google that to see if there is something I missed > > > > 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>: > >> And that's the issue. > >> > >> I have an 8 nodes cluster, with 3 ZK servers, everything working fine. > >> I just ran a MP last week which has generated a 400M rows table. But I > >> hae wrongly pre-split the table. so I want to merge and re-split it. > >> > >> I tried with the cluster on and it has detected it and stopped the > merge. > >> I stoped de cluster but it's trying to access the file locally? I ran > >> the merge on the master server directly from the HBase directory. > >> > >> I will take a look at see if there is any other parameter I should > >> pass, or if I missed something... > >> > >> JM > >> > >> 2012/11/18, Kevin O'dell <[EMAIL PROTECTED]>: > >>> Rather it is expecting local: > >>> > >>> 12/11/18 08:54:05 FATAL util.Merge: Merge failed > >>> java.lang.IllegalArgumentException: Wrong FS: > >>> hdfs://node3:9000/hbase/-ROOT-/70236052/.regioninfo, expected: > >>> file:///at > >>> org.apache.hadoop.fs. FileSystem.checkPath(FileSystem.java:381) > >>> On Nov 18, 2012 10:37 AM, "Kevin O'dell" <[EMAIL PROTECTED]> > >>> wrote: > >>> > >>>> Looks like your configuration is pointing local. > >>>> On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari" > >>>> <[EMAIL PROTECTED]> > >>>> wrote: > >>>> > >>>>> Hi, > >>>>> > >>>>> I'm trying to merge 2 regions based on the book documentation and I'm > >>>>> getting the exception at the bottom of this message. Any idea why? > >>>>> > >>>>> I got the regions names from the HTML UI. I tried also to scan the > >>>>> .META. table like in Lars' book. Both are giving me the same info (a > >>>>> chance!), but it's still not working. > >>>>> > >>>>> Also, the HBase online book is not giving the right class info for > the > >>>>> merge. I will open a Jira and propose a patch. > >>>>> > >>>>> Thanks, > >>>>> > >>>>> JM > >>>>> > >>>>> hbase@node3:~/hbase-0.94.2$ bin/hbase > >>>>> org.apache.hadoop.hbase.util.Merge work_proposed > >>>>> work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378. > >>>>> work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d. > >>>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is > >>>>> available... > >>>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not > >>>>> running... > >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > >>>>> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 > 10:48 > >>>>> GMT > >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > >>>>> environment:host.name > >>>>> =node3 > >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > >>>>> environment:java.version=1.7.0_05 > >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > >>>>> environment:java.vendor=Oracle Corporation > >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > >>>>> environment:java.home=/usr/local/jdk1.7.0_05/jre > >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client > >>>>> > >>>>> > environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hb
-
Re: Merging regionsJean-Marc Spaggiari 2012-11-19, 02:31
I don't have a core-site :(
But I was able to figure that I had to add: <property> <name>fs.default.name</name> <value>hdfs://node3:9000/</value> <description>The name of the default file system. A URI whose scheme and authority determine the FileSystem implementation. The uri's scheme determines the config property (fs.SCHEME.impl) naming the FileSystem implementation class. The uri's authority is used to determine the host, port, etc. for a filesystem. </description> </property> With that it's working fine. I was able to merge 2 regions. Now I "just" need to build a script to merge all the regions into a single one. Thanks, JM 2012/11/18, Kevin O'dell <[EMAIL PROTECTED]>: > You should be able to grab that from the core-site and add it into you > hbase-site. > On Nov 18, 2012 6:34 PM, "Jean-Marc Spaggiari" <[EMAIL PROTECTED]> > wrote: > >> Seems it has been discussed a year ago ;) >> >> http://www.mail-archive.com/[EMAIL PROTECTED]/msg11383.html >> >> It looks like I need to setup fs.default.name ... I tried few >> different values, but even so it's not working. What should this value >> look like? I used hdfs://localhost/ and the same with the master (also >> hosting the namenode) with no success. Any idea what it should be? >> >> Thanks, >> >> JM >> >> 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>: >> > Hum >> > >> > I tried the --config parameters but I donc think bin/hbase is reading >> > it. >> > >> > I have exported HBASE_CONFIG but same result. >> > >> > Does anyone have succeed in a merge recently? >> > >> > I will try to google that to see if there is something I missed >> > >> > 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>: >> >> And that's the issue. >> >> >> >> I have an 8 nodes cluster, with 3 ZK servers, everything working fine. >> >> I just ran a MP last week which has generated a 400M rows table. But I >> >> hae wrongly pre-split the table. so I want to merge and re-split it. >> >> >> >> I tried with the cluster on and it has detected it and stopped the >> merge. >> >> I stoped de cluster but it's trying to access the file locally? I ran >> >> the merge on the master server directly from the HBase directory. >> >> >> >> I will take a look at see if there is any other parameter I should >> >> pass, or if I missed something... >> >> >> >> JM >> >> >> >> 2012/11/18, Kevin O'dell <[EMAIL PROTECTED]>: >> >>> Rather it is expecting local: >> >>> >> >>> 12/11/18 08:54:05 FATAL util.Merge: Merge failed >> >>> java.lang.IllegalArgumentException: Wrong FS: >> >>> hdfs://node3:9000/hbase/-ROOT-/70236052/.regioninfo, expected: >> >>> file:///at >> >>> org.apache.hadoop.fs. FileSystem.checkPath(FileSystem.java:381) >> >>> On Nov 18, 2012 10:37 AM, "Kevin O'dell" <[EMAIL PROTECTED]> >> >>> wrote: >> >>> >> >>>> Looks like your configuration is pointing local. >> >>>> On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari" >> >>>> <[EMAIL PROTECTED]> >> >>>> wrote: >> >>>> >> >>>>> Hi, >> >>>>> >> >>>>> I'm trying to merge 2 regions based on the book documentation and >> >>>>> I'm >> >>>>> getting the exception at the bottom of this message. Any idea why? >> >>>>> >> >>>>> I got the regions names from the HTML UI. I tried also to scan the >> >>>>> .META. table like in Lars' book. Both are giving me the same info >> >>>>> (a >> >>>>> chance!), but it's still not working. >> >>>>> >> >>>>> Also, the HBase online book is not giving the right class info for >> the >> >>>>> merge. I will open a Jira and propose a patch. >> >>>>> >> >>>>> Thanks, >> >>>>> >> >>>>> JM >> >>>>> >> >>>>> hbase@node3:~/hbase-0.94.2$ bin/hbase >> >>>>> org.apache.hadoop.hbase.util.Merge work_proposed >> >>>>> work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378. >> >>>>> work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d. >> >>>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is >> >>>>> available... |