|
|
-
Bulk Loading From Local File
Mehmet Simsek 2012-12-13, 15:53
Hi
I want to bulk load from local file to hbase table. Can I load file rows to hbase table without importing to hdfs. Hbase import tool reads data from hdfs. How can I implement MR job reading local file and writing hbase table?
Now,I'm doing bulk loading in steps
1) load file to hdfs 2) run MR job to load file lines to hbase table
There are two loading processes. Is there a problem in this approach?
M.S
-
Re: Bulk Loading From Local File
Harsh J 2012-12-13, 15:58
HBase bulkloads by moving the files into its region directories, so it is essentially just one "loading process".
On Thu, Dec 13, 2012 at 9:23 PM, Mehmet Simsek <[EMAIL PROTECTED]> wrote: > Hi > > I want to bulk load from local file to hbase table. Can I load file rows to hbase table without importing to hdfs. Hbase import tool reads data from hdfs. How can I implement MR job reading local file and writing hbase table? > > Now,I'm doing bulk loading in steps > > 1) load file to hdfs > 2) run MR job to load file lines to hbase table > > There are two loading processes. Is there a problem in this approach? > > > > M.S
-- Harsh J
-
Re: Bulk Loading From Local File
Anoop John 2012-12-13, 17:46
>Can I load file rows to hbase table without importing to hdfs
Where you want the data to get stored finally..I mean the raw data.. I hope that in HDFS only ( u want) Have a look at ImportTSV tool..
-Anoop- On Thu, Dec 13, 2012 at 9:23 PM, Mehmet Simsek <[EMAIL PROTECTED]>wrote:
> Can I load file rows to hbase table without importing to hdfs
-
Re: Bulk Loading From Local File
Jonathan Bishop 2012-12-13, 19:45
Yes, you can. Use file:///full-path-name. You may not get more than one map job though.
Jon On Thu, Dec 13, 2012 at 7:53 AM, Mehmet Simsek <[EMAIL PROTECTED]>wrote:
> Hi > > I want to bulk load from local file to hbase table. Can I load file rows > to hbase table without importing to hdfs. Hbase import tool reads data from > hdfs. How can I implement MR job reading local file and writing hbase table? > > Now,I'm doing bulk loading in steps > > 1) load file to hdfs > 2) run MR job to load file lines to hbase table > > There are two loading processes. Is there a problem in this approach? > > > > M.S
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext