Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Data import from Distributed Hbase cluster to Pseudo Distributed Hbase cluster


+
arun sirimalla 2012-05-29, 18:42
+
Amandeep Khurana 2012-05-29, 18:45
Copy link to this message
-
Re: Data import from Distributed Hbase cluster to Pseudo Distributed Hbase cluster
Hi Amandeep,

Thanks for your reply. I tried the copytable tool to copy the table from
Distributed Hbase cluster to Pseudo Distributed Hbase Cluster using the
below command

hadoop jar hbase-0.90.3-cdh3u1.jar copytable
--peer.adr=sand001.rssand001:2181:/storage/hbase test

It initializes the job and fails with following error

12/05/29 19:05:15 INFO mapred.JobClient: Running job: job_201204122048_0004
12/05/29 19:05:16 INFO mapred.JobClient:  map 0% reduce 0%
12/05/29 19:05:26 INFO mapred.JobClient: Task Id :
attempt_201204122048_0004_m_000000_0, Status : FAILED
java.lang.NullPointerException
    at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:127)
    at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:82)
    at
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:531)
    at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
    at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:60)
    at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:45)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
    at org.apache.hadoop.mapred.Child.main(Child.java:264)
On Tue, May 29, 2012 at 11:45 AM, Amandeep Khurana <[EMAIL PROTECTED]> wrote:

> Assuming that your data fits into the pseudo dist cluster and both
> clusters can talk to each other, the CopyTable job that comes bundled with
> HBase should work.
>
> -ak
>
>
> On Tuesday, May 29, 2012 at 11:42 AM, arun sirimalla wrote:
>
> > Hi,
> >
> > I want to copy a table from Distributed Hbase cluster to Pseudo
> > Distributed Hbase Cluster. Here the Pseudo Distributed Hbase cluster uses
> > Linux Filesystem as storage.
> > How can i import data from Distributed Hbase cluster to Pseudo
> Distributed
> > Hbase Cluster.
> >
> > Thanks
> > Arun
> > Cloudwick Technologies
> >
> >
>
>
>
+
Andrew Purtell 2012-05-29, 21:22