Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Merging regions


+
Jean-Marc Spaggiari 2012-11-18, 13:59
+
Kevin Odell 2012-11-18, 15:37
+
Kevin Odell 2012-11-18, 15:47
Copy link to this message
-
Re: Merging regions
And that's the issue.

I have an 8 nodes cluster, with 3 ZK servers, everything working fine.
I just ran a MP last week which has generated a 400M rows table. But I
hae wrongly pre-split the table. so I want to merge and re-split it.

I tried with the cluster on and it has detected it and stopped the merge.
I stoped de cluster but it's trying to access the file locally? I ran
the merge on the master server directly from the HBase directory.

I will take a look at see if there is any other parameter I should
pass, or if I missed something...

JM

2012/11/18, Kevin O'dell <[EMAIL PROTECTED]>:
> Rather it is expecting local:
>
> 12/11/18 08:54:05 FATAL util.Merge: Merge failed
> java.lang.IllegalArgumentException: Wrong FS:
> hdfs://node3:9000/hbase/-ROOT-/70236052/.regioninfo, expected: file:///at
> org.apache.hadoop.fs. FileSystem.checkPath(FileSystem.java:381)
> On Nov 18, 2012 10:37 AM, "Kevin O'dell" <[EMAIL PROTECTED]> wrote:
>
>> Looks like your configuration is pointing local.
>> On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari" <[EMAIL PROTECTED]>
>> wrote:
>>
>>> Hi,
>>>
>>> I'm trying to merge 2 regions based on the book documentation and I'm
>>> getting the exception at the bottom of this message. Any idea why?
>>>
>>> I got the regions names from the HTML UI. I tried also to scan the
>>> .META. table like in Lars' book. Both are giving me the same info (a
>>> chance!), but it's still not working.
>>>
>>> Also, the HBase online book is not giving the right class info for the
>>> merge. I will open a Jira and propose a patch.
>>>
>>> Thanks,
>>>
>>> JM
>>>
>>> hbase@node3:~/hbase-0.94.2$ bin/hbase
>>> org.apache.hadoop.hbase.util.Merge work_proposed
>>> work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378.
>>> work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d.
>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is
>>> available...
>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not
>>> running...
>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48
>>> GMT
>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client environment:host.name
>>> =node3
>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>> environment:java.version=1.7.0_05
>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>> environment:java.vendor=Oracle Corporation
>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>> environment:java.home=/usr/local/jdk1.7.0_05/jre
>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>>
>>> environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hbase/hbase-0.94.2//lib/jettison-1.1.jar:/home/hbase/hbase-0.94.2//lib/jetty-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jetty-util-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jruby-complete-1.6.5.jar:/home/hbase/hbase-0.94.2//lib/jsp-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsp-api-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsr305-1.3.9.jar:/home/hbase/hbase-0.94.2//lib/junit-4.10-HBASE-1.jar:/home/hbase/hbase-0.94.2//lib/libthrift-0.8.0.jar:/home/hbase/hbase-0.94.2//lib/log4j-1.2.16.jar:/home/hbase/hbase-0.94.2//lib/metrics-core-2.1.2.jar:/home/hbase/hbase-0.94.2//lib/netty-3.2.4.Final.jar:/home/hbase/hbase-0.94.2//lib/protobuf-java-2.4.0a.jar:/home/hbase/hbase-0.94.2//lib/servlet-api-2.5-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/slf4j-api-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/slf4j-log4j12-1.4.3.jar:/home/hbase/hbase-0.94.2//lib/snappy-java-1.0.3.2.jar:/home/hbase/hbase-0.94.2//lib/stax-api-1.0.1.jar:/home/hbase/hbase-0.94.2//lib/velocity-1.7.jar:/home/hbase/hbase-0.94.2//lib/xmlenc-0.52.jar:/home/hbase/hbase-0.94.2//lib/zookeeper-3.4.3.jar:
+
Jean-Marc Spaggiari 2012-11-18, 16:52
+
Jean-Marc Spaggiari 2012-11-18, 23:34
+
Kevin Odell 2012-11-19, 01:16
+
Jean-Marc Spaggiari 2012-11-19, 02:31