Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - copyTable from 0.94 to 0.96?


Copy link to this message
-
Re: copyTable from 0.94 to 0.96?
Jean-Marc Spaggiari 2013-11-14, 12:23
Hum. I let is run over night and got that:
13/11/13 22:24:17 INFO zookeeper.ClientCnxn: Session establishment complete
on server hbasetest1/192.168.23.51:2181, sessionid = 0x1423ef50f7d0241,
negotiated timeout = 40000
13/11/13 23:24:41 ERROR mapreduce.TableOutputFormat:
org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find
region for dns,,99999999999999 after 14 tries.
13/11/13 23:24:41 INFO mapred.JobClient: Cleaning up the staging area
file:/tmp/hadoop-hbase/mapred/staging/hbase-368698754/.staging/job_local_0001
Exception in thread "main" java.lang.RuntimeException:
org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find
region for dns,,99999999999999 after 14 tries.
    at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:206)
    at
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
    at
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:884)
    at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
    at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
    at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
    at org.apache.hadoop.hbase.mapreduce.CopyTable.run(CopyTable.java:274)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
    at org.apache.hadoop.hbase.mapreduce.CopyTable.main(CopyTable.java:265)
Caused by: org.apache.hadoop.hbase.client.NoServerForRegionException:
Unable to find region for dns,,99999999999999 after 14 tries.
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1095)
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1000)
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1102)
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:1004)
    at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:961)
    at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:227)
    at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:170)
    at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:129)
    at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:201)
    ... 14 more
Looking at the destination server I can see that my table and regions are
online nut not with the same name:
dns,,1384397901249.cfcf94a7ec8186baf462b2627d138481

I don't have anywhere (nor source, neither destination) a region called
dns,,99999999999999.

Strange.

JM
2013/11/13 Jean-Marc Spaggiari <[EMAIL PROTECTED]>

> Hi,
>
> Is there anything I missed for my copyTable command?
>
> hbase@node3:~/hbase-0.94.12$ bin/hbase
> org.apache.hadoop.hbase.mapreduce.CopyTable --endtime=1384395265000
> --peer.adr=hbasetest1:2181:/hbase dns
> 13/11/13 21:28:37 INFO zookeeper.RecoverableZooKeeper: The identifier of
> this process is 31738@node3
>
> I killed it after 30 minutes. There was nothing done. I have my 2 clusters
> running. DistCP between the 2 is working fine, and my 2 HBase are also
> working fine. If I stop HBase on the target, distcp, upgrade and start, I
> have all my data. I dropped all the tables and tried CopyTable and I see
> nothing going.
>
> I tried with the short name (hbasetest1) or with FQDN, same result. I
> tried to run rowcount on the target cluster on an existing table, it's