Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Merging regions

Copy link to this message
Re: Merging regions
Seems it has been discussed a year ago ;)

http://www.mail-archive.com/[EMAIL PROTECTED]/msg11383.html

It looks like I need to setup fs.default.name ... I tried few
different values, but even so it's not working. What should this value
look like? I used hdfs://localhost/ and the same with the master (also
hosting the namenode) with no success. Any idea what it should be?



2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>:
> Hum
> I tried the --config parameters but I donc think bin/hbase is reading it.
> I have exported HBASE_CONFIG but  same result.
> Does anyone have succeed in a merge recently?
> I will try to google that to see if there is something I missed
> 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>:
>> And that's the issue.
>> I have an 8 nodes cluster, with 3 ZK servers, everything working fine.
>> I just ran a MP last week which has generated a 400M rows table. But I
>> hae wrongly pre-split the table. so I want to merge and re-split it.
>> I tried with the cluster on and it has detected it and stopped the merge.
>> I stoped de cluster but it's trying to access the file locally? I ran
>> the merge on the master server directly from the HBase directory.
>> I will take a look at see if there is any other parameter I should
>> pass, or if I missed something...
>> JM
>> 2012/11/18, Kevin O'dell <[EMAIL PROTECTED]>:
>>> Rather it is expecting local:
>>> 12/11/18 08:54:05 FATAL util.Merge: Merge failed
>>> java.lang.IllegalArgumentException: Wrong FS:
>>> hdfs://node3:9000/hbase/-ROOT-/70236052/.regioninfo, expected:
>>> file:///at
>>> org.apache.hadoop.fs. FileSystem.checkPath(FileSystem.java:381)
>>> On Nov 18, 2012 10:37 AM, "Kevin O'dell" <[EMAIL PROTECTED]>
>>> wrote:
>>>> Looks like your configuration is pointing local.
>>>> On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari"
>>>> wrote:
>>>>> Hi,
>>>>> I'm trying to merge 2 regions based on the book documentation and I'm
>>>>> getting the exception at the bottom of this message. Any idea why?
>>>>> I got the regions names from the HTML UI. I tried also to scan the
>>>>> .META. table like in Lars' book. Both are giving me the same info (a
>>>>> chance!), but it's still not working.
>>>>> Also, the HBase online book is not giving the right class info for the
>>>>> merge. I will open a Jira and propose a patch.
>>>>> Thanks,
>>>>> JM
>>>>> hbase@node3:~/hbase-0.94.2$ bin/hbase
>>>>> org.apache.hadoop.hbase.util.Merge work_proposed
>>>>> work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378.
>>>>> work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d.
>>>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is
>>>>> available...
>>>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not
>>>>> running...
>>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>>>> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48
>>>>> GMT
>>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>>>> environment:host.name
>>>>> =node3
>>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.version=1.7.0_05
>>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.vendor=Oracle Corporation
>>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.home=/usr/local/jdk1.7.0_05/jre
>>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
>>>>> environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hbase/hbase-0.94.2//lib/jettison-1.1.jar:/home/hbase/hbase-0.94.2//lib/jetty-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jetty-util-6.1.26.jar:/home/hbase/hbase-0.94.2//lib/jruby-complete-1.6.5.jar:/home/hbase/hbase-0.94.2//lib/jsp-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsp-api-2.1-6.1.14.jar:/home/hbase/hbase-0.94.2//lib/jsr305-1.3.9.jar:/home/hbase/hba
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB