|
|
-
Data import from Distributed Hbase cluster to Pseudo Distributed Hbase cluster
arun sirimalla 2012-05-29, 18:42
Hi,
I want to copy a table from Distributed Hbase cluster to Pseudo Distributed Hbase Cluster. Here the Pseudo Distributed Hbase cluster uses Linux Filesystem as storage. How can i import data from Distributed Hbase cluster to Pseudo Distributed Hbase Cluster.
Thanks Arun Cloudwick Technologies
-
Re: Data import from Distributed Hbase cluster to Pseudo Distributed Hbase cluster
Amandeep Khurana 2012-05-29, 18:45
Assuming that your data fits into the pseudo dist cluster and both clusters can talk to each other, the CopyTable job that comes bundled with HBase should work.
-ak On Tuesday, May 29, 2012 at 11:42 AM, arun sirimalla wrote:
> Hi, > > I want to copy a table from Distributed Hbase cluster to Pseudo > Distributed Hbase Cluster. Here the Pseudo Distributed Hbase cluster uses > Linux Filesystem as storage. > How can i import data from Distributed Hbase cluster to Pseudo Distributed > Hbase Cluster. > > Thanks > Arun > Cloudwick Technologies > >
-
Re: Data import from Distributed Hbase cluster to Pseudo Distributed Hbase cluster
arun sirimalla 2012-05-29, 19:13
Hi Amandeep,
Thanks for your reply. I tried the copytable tool to copy the table from Distributed Hbase cluster to Pseudo Distributed Hbase Cluster using the below command
hadoop jar hbase-0.90.3-cdh3u1.jar copytable --peer.adr=sand001.rssand001:2181:/storage/hbase test
It initializes the job and fails with following error
12/05/29 19:05:15 INFO mapred.JobClient: Running job: job_201204122048_0004 12/05/29 19:05:16 INFO mapred.JobClient: map 0% reduce 0% 12/05/29 19:05:26 INFO mapred.JobClient: Task Id : attempt_201204122048_0004_m_000000_0, Status : FAILED java.lang.NullPointerException at org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:127) at org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:82) at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:531) at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80) at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:60) at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:45) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323) at org.apache.hadoop.mapred.Child$4.run(Child.java:270) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) at org.apache.hadoop.mapred.Child.main(Child.java:264) On Tue, May 29, 2012 at 11:45 AM, Amandeep Khurana <[EMAIL PROTECTED]> wrote:
> Assuming that your data fits into the pseudo dist cluster and both > clusters can talk to each other, the CopyTable job that comes bundled with > HBase should work. > > -ak > > > On Tuesday, May 29, 2012 at 11:42 AM, arun sirimalla wrote: > > > Hi, > > > > I want to copy a table from Distributed Hbase cluster to Pseudo > > Distributed Hbase Cluster. Here the Pseudo Distributed Hbase cluster uses > > Linux Filesystem as storage. > > How can i import data from Distributed Hbase cluster to Pseudo > Distributed > > Hbase Cluster. > > > > Thanks > > Arun > > Cloudwick Technologies > > > > > > >
-
Re: Data import from Distributed Hbase cluster to Pseudo Distributed Hbase cluster
Andrew Purtell 2012-05-29, 21:22
As this is a quite old version of HBase and a CDH version, you should ask on the CDH lists.
- Andy
On Tue, May 29, 2012 at 12:13 PM, arun sirimalla <[EMAIL PROTECTED]> wrote: > Hi Amandeep, > > Thanks for your reply. I tried the copytable tool to copy the table from > Distributed Hbase cluster to Pseudo Distributed Hbase Cluster using the > below command > > hadoop jar hbase-0.90.3-cdh3u1.jar copytable > --peer.adr=sand001.rssand001:2181:/storage/hbase test > > It initializes the job and fails with following error > > 12/05/29 19:05:15 INFO mapred.JobClient: Running job: job_201204122048_0004 > 12/05/29 19:05:16 INFO mapred.JobClient: map 0% reduce 0% > 12/05/29 19:05:26 INFO mapred.JobClient: Task Id : > attempt_201204122048_0004_m_000000_0, Status : FAILED > java.lang.NullPointerException > at > org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:127) > at > org.apache.hadoop.hbase.mapreduce.TableOutputFormat$TableRecordWriter.write(TableOutputFormat.java:82) > at > org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:531) > at > org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80) > at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:60) > at org.apache.hadoop.hbase.mapreduce.Import$Importer.map(Import.java:45) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323) > at org.apache.hadoop.mapred.Child$4.run(Child.java:270) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127) > at org.apache.hadoop.mapred.Child.main(Child.java:264) > > > On Tue, May 29, 2012 at 11:45 AM, Amandeep Khurana <[EMAIL PROTECTED]> wrote: > >> Assuming that your data fits into the pseudo dist cluster and both >> clusters can talk to each other, the CopyTable job that comes bundled with >> HBase should work. >> >> -ak >> >> >> On Tuesday, May 29, 2012 at 11:42 AM, arun sirimalla wrote: >> >> > Hi, >> > >> > I want to copy a table from Distributed Hbase cluster to Pseudo >> > Distributed Hbase Cluster. Here the Pseudo Distributed Hbase cluster uses >> > Linux Filesystem as storage. >> > How can i import data from Distributed Hbase cluster to Pseudo >> Distributed >> > Hbase Cluster. >> > >> > Thanks >> > Arun >> > Cloudwick Technologies >> > >> > >> >> >>
-- Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
|
|