Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Data import from Distributed Hbase cluster to Pseudo Distributed Hbase cluster


+
arun sirimalla 2012-05-29, 18:42
+
Amandeep Khurana 2012-05-29, 18:45
Copy link to this message
-
Re: Data import from Distributed Hbase cluster to Pseudo Distributed Hbase cluster
Hi Amandeep,

Thanks for your reply. I tried the copytable tool to copy the table from
Distributed Hbase cluster to Pseudo Distributed Hbase Cluster using the
below command

hadoop jar hbase-0.90.3-cdh3u1.jar copytable
--peer.adr=sand001.rssand001:2181:/storage/hbase test

It initializes the job and fails with following error

12/05/29 19:05:15 INFO mapred.JobClient: Running job: job_201204122048_0004
12/05/29 19:05:16 INFO mapred.JobClient:  map 0% reduce 0%
12/05/29 19:05:26 INFO mapred.JobClient: Task Id :
attempt_201204122048_0004_m_000000_0, Status : FAILED
java.lang.NullPointerException
    at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:127)
    at
org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:82)
    at
org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:531)
    at
org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
    at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:60)
    at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:45)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
    at org.apache.hadoop.mapred.Child.main(Child.java:264)
On Tue, May 29, 2012 at 11:45 AM, Amandeep Khurana <[EMAIL PROTECTED]> wrote:

> Assuming that your data fits into the pseudo dist cluster and both
> clusters can talk to each other, the CopyTable job that comes bundled with
> HBase should work.
>
> -ak
>
>
> On Tuesday, May 29, 2012 at 11:42 AM, arun sirimalla wrote:
>
> > Hi,
> >
> > I want to copy a table from Distributed Hbase cluster to Pseudo
> > Distributed Hbase Cluster. Here the Pseudo Distributed Hbase cluster uses
> > Linux Filesystem as storage.
> > How can i import data from Distributed Hbase cluster to Pseudo
> Distributed
> > Hbase Cluster.
> >
> > Thanks
> > Arun
> > Cloudwick Technologies
> >
> >
>
>
>
+
Andrew Purtell 2012-05-29, 21:22
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB