Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> copyTable from 0.94 to 0.96?


+
Jean-Marc Spaggiari 2013-11-14, 03:07
+
Jean-Marc Spaggiari 2013-11-14, 12:23
+
Stack 2013-11-14, 12:42
Copy link to this message
-
Re: copyTable from 0.94 to 0.96?
Thanks for looking a it St.Ack.

Here are my regions on the source table:
Table RegionsNameRegion ServerStart KeyEnd Key Requests
dns,,1379202070789.bb65f685cdefc4f2491d246f376fc1f0. node3:60030
gestion-v.com 0  dns,gestion-v.com
,1379202070789.d02ce8e3fa1a200c7f034b349acf8cc8. buldo:60030 gestion-v.com
rfkcenter.org 0  dns,rfkcenter.org
,1379202071281.c6569a72cc3c2750d14976ab85f02315. node5:60030 rfkcenter.org
theafronews.ca 0  dns,theafronews.ca
,1379202071281.d5b74aaa2853b00b0ad0f20f60c74398. node7:60030 theafronews.ca
0
Sound like "normal".

I tried to scan the source table from the shell and it's working fine.
Now, since the stack show TableOutputFormat does it mean it's on the
destination cluster? If I put a wrong server name or port, I get a
connection exception, which mean server name is right.

So on the target side, I can also scan the table:

hbase(main):001:0> scan 'dns'
2013-11-14 07:58:20,597 WARN  [main] util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
ROW
COLUMN+CELL

0 row(s) in 0.0620 seconds

hbase(main):002:0>
Also put is working fine:
hbase(main):003:0> put 'dns', 'test', '@:@', 'TestValue'
0 row(s) in 0.2090 seconds

hbase(main):004:0> scan 'dns'
ROW
COLUMN+CELL

 test                                         column=@:@,
timestamp=1384433996320,
value=TestValue

1 row(s) in 0.0570 seconds

hbase(main):005:0>
I have 3 ZK servers on the source and one on the target.

ZK shell is working fine on target cluster. However, there is this:
[zk: localhost:2181(CONNECTED) 6] ls /hbase/master
[]

It's the same on 0.94. The master ZNode is empty. Is that normal? Can this
be the issue?

JM
2013/11/14 Stack <[EMAIL PROTECTED]>

> On Thu, Nov 14, 2013 at 9:23 PM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
> > Hum. I let is run over night and got that:
> > 13/11/13 22:24:17 INFO zookeeper.ClientCnxn: Session establishment
> complete
> > on server hbasetest1/192.168.23.51:2181, sessionid = 0x1423ef50f7d0241,
> > negotiated timeout = 40000
> > 13/11/13 23:24:41 ERROR mapreduce.TableOutputFormat:
> > org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find
> > region for dns,,99999999999999 after 14 tries.
> >
>
> dns,,99999999999999 is an artificial key made in the client doing get
> closest or before; it is how we find start key for a region (the first
> region in the table in this case).  It should not be coming up and out as
> an exception.  Was there no region whose key was '',,' in the dns table?
>
> St.Ack
>
>
> > 13/11/13 23:24:41 INFO mapred.JobClient: Cleaning up the staging area
> >
> >
> file:/tmp/hadoop-hbase/mapred/staging/hbase-368698754/.staging/job_local_0001
> > Exception in thread "main" java.lang.RuntimeException:
> > org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find
> > region for dns,,99999999999999 after 14 tries.
> >     at
> >
> >
> org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:206)
> >     at
> > org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
> >     at
> >
> >
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
> >     at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:884)
> >     at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
> >     at java.security.AccessController.doPrivileged(Native Method)
> >     at javax.security.auth.Subject.doAs(Subject.java:415)
> >     at
> >
> >
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> >     at
> > org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
> >     at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
> >     at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
> >     at
> org.apache.hadoop.hbase.mapreduce.CopyTable.run(CopyTable.java:274)
> >     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >     at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
+
Jean-Marc Spaggiari 2013-11-15, 01:47
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB