Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Merging regions


+
Jean-Marc Spaggiari 2012-11-18, 13:59
+
Kevin Odell 2012-11-18, 15:37
+
Kevin Odell 2012-11-18, 15:47
+
Jean-Marc Spaggiari 2012-11-18, 16:42
+
Jean-Marc Spaggiari 2012-11-18, 16:52
+
Jean-Marc Spaggiari 2012-11-18, 23:34
Copy link to this message
-
Re: Merging regions
You should be able to grab that from the core-site and add it into you
hbase-site.
On Nov 18, 2012 6:34 PM, "Jean-Marc Spaggiari" <[EMAIL PROTECTED]>
wrote:

> Seems it has been discussed a year ago ;)
>
> http://www.mail-archive.com/[EMAIL PROTECTED]/msg11383.html
>
> It looks like I need to setup fs.default.name ... I tried few
> different values, but even so it's not working. What should this value
> look like? I used hdfs://localhost/ and the same with the master (also
> hosting the namenode) with no success. Any idea what it should be?
>
> Thanks,
>
> JM
>
> 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>:
> > Hum
> >
> > I tried the --config parameters but I donc think bin/hbase is reading it.
> >
> > I have exported HBASE_CONFIG but  same result.
> >
> > Does anyone have succeed in a merge recently?
> >
> > I will try to google that to see if there is something I missed
> >
> > 2012/11/18, Jean-Marc Spaggiari <[EMAIL PROTECTED]>:
> >> And that's the issue.
> >>
> >> I have an 8 nodes cluster, with 3 ZK servers, everything working fine.
> >> I just ran a MP last week which has generated a 400M rows table. But I
> >> hae wrongly pre-split the table. so I want to merge and re-split it.
> >>
> >> I tried with the cluster on and it has detected it and stopped the
> merge.
> >> I stoped de cluster but it's trying to access the file locally? I ran
> >> the merge on the master server directly from the HBase directory.
> >>
> >> I will take a look at see if there is any other parameter I should
> >> pass, or if I missed something...
> >>
> >> JM
> >>
> >> 2012/11/18, Kevin O'dell <[EMAIL PROTECTED]>:
> >>> Rather it is expecting local:
> >>>
> >>> 12/11/18 08:54:05 FATAL util.Merge: Merge failed
> >>> java.lang.IllegalArgumentException: Wrong FS:
> >>> hdfs://node3:9000/hbase/-ROOT-/70236052/.regioninfo, expected:
> >>> file:///at
> >>> org.apache.hadoop.fs. FileSystem.checkPath(FileSystem.java:381)
> >>> On Nov 18, 2012 10:37 AM, "Kevin O'dell" <[EMAIL PROTECTED]>
> >>> wrote:
> >>>
> >>>> Looks like your configuration is pointing local.
> >>>> On Nov 18, 2012 8:59 AM, "Jean-Marc Spaggiari"
> >>>> <[EMAIL PROTECTED]>
> >>>> wrote:
> >>>>
> >>>>> Hi,
> >>>>>
> >>>>> I'm trying to merge 2 regions based on the book documentation and I'm
> >>>>> getting the exception at the bottom of this message. Any idea why?
> >>>>>
> >>>>> I got the regions names from the HTML UI. I tried also to scan the
> >>>>> .META. table like in Lars' book. Both are giving me the same info (a
> >>>>> chance!), but it's still not working.
> >>>>>
> >>>>> Also, the HBase online book is not giving the right class info for
> the
> >>>>> merge. I will open a Jira and propose a patch.
> >>>>>
> >>>>> Thanks,
> >>>>>
> >>>>> JM
> >>>>>
> >>>>> hbase@node3:~/hbase-0.94.2$ bin/hbase
> >>>>> org.apache.hadoop.hbase.util.Merge work_proposed
> >>>>> work_proposed,\x0A,1342541226467.19929d1e6b6ecb3beae91e316b790378.
> >>>>> work_proposed,\x14,1342541226467.622a3e62c4cf3f3b59655bdaf915908d.
> >>>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that file system is
> >>>>> available...
> >>>>> 12/11/18 08:54:05 INFO util.Merge: Verifying that HBase is not
> >>>>> running...
> >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
> >>>>> environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012
> 10:48
> >>>>> GMT
> >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
> >>>>> environment:host.name
> >>>>> =node3
> >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
> >>>>> environment:java.version=1.7.0_05
> >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
> >>>>> environment:java.vendor=Oracle Corporation
> >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
> >>>>> environment:java.home=/usr/local/jdk1.7.0_05/jre
> >>>>> 12/11/18 08:54:05 INFO zookeeper.ZooKeeper: Client
> >>>>>
> >>>>>
> environment:java.class.path=/home/hbase/hbase-0.94.2//conf:/usr/local/jdk1.7.0_05/lib/tools.jar:/home/hbase/hbase-0.94.2/:/home/hbase/hbase-0.94.2//hbase-0.94.2.jar:/home/hbase/hbase-0.94.2//hbase-0.94.2-tests.jar:/home/hbase/hbase-0.94.2//lib/activation-1.1.jar:/home/hbase/hbase-0.94.2//lib/asm-3.1.jar:/home/hbase/hbase-0.94.2//lib/avro-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/avro-ipc-1.5.3.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-1.7.0.jar:/home/hbase/hbase-0.94.2//lib/commons-beanutils-core-1.8.0.jar:/home/hbase/hbase-0.94.2//lib/commons-cli-1.2.jar:/home/hbase/hbase-0.94.2//lib/commons-codec-1.4.jar:/home/hbase/hbase-0.94.2//lib/commons-collections-3.2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-configuration-1.6.jar:/home/hbase/hbase-0.94.2//lib/commons-digester-1.8.jar:/home/hbase/hbase-0.94.2//lib/commons-el-1.0.jar:/home/hbase/hbase-0.94.2//lib/commons-httpclient-3.1.jar:/home/hbase/hbase-0.94.2//lib/commons-io-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-lang-2.5.jar:/home/hbase/hbase-0.94.2//lib/commons-logging-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/commons-math-2.1.jar:/home/hbase/hbase-0.94.2//lib/commons-net-1.4.1.jar:/home/hbase/hbase-0.94.2//lib/core-3.1.1.jar:/home/hbase/hbase-0.94.2//lib/guava-11.0.2.jar:/home/hbase/hbase-0.94.2//lib/hadoop-core-1.0.3.jar:/home/hbase/hbase-0.94.2//lib/high-scale-lib-1.1.1.jar:/home/hbase/hbase-0.94.2//lib/httpclient-4.1.2.jar:/home/hbase/hbase-0.94.2//lib/httpcore-4.1.3.jar:/home/hbase/hbase-0.94.2//lib/jackson-core-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-jaxrs-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-mapper-asl-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jackson-xc-1.8.8.jar:/home/hbase/hbase-0.94.2//lib/jamon-runtime-2.3.1.jar:/home/hbase/hbase-0.94.2//lib/jasper-compiler-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jasper-runtime-5.5.23.jar:/home/hbase/hbase-0.94.2//lib/jaxb-api-2.1.jar:/home/hbase/hbase-0.94.2//lib/jaxb-impl-2.2.3-1.jar:/home/hbase/hbase-0.94.2//lib/jersey-core-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-json-1.8.jar:/home/hbase/hbase-0.94.2//lib/jersey-server-1.8.jar:/home/hb
+
Jean-Marc Spaggiari 2012-11-19, 02:31
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB