Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> is there any tool that facilitate the import of data to hbase


Copy link to this message
-
Re: is there any tool that facilitate the import of data to hbase
Got lotsa reading to do tonite :D

On Thu, Feb 3, 2011 at 4:17 PM, Dani Rayan <[EMAIL PROTECTED]> wrote:

> Hey,
>
> Flume: http://archive.cloudera.com/cdh/3/flume/UserGuide.html has a HBase
> sink.
> Flume is similar to Scribe, but has more to it.
>
> Original Jira: https://issues.cloudera.org/browse/FLUME-6
> Branch: https://github.com/cloudera/flume/tree/hbase
>
> -Thanks,
> Dani.
> http://www.cc.gatech.edu/~iar3/
>
> On Thu, Feb 3, 2011 at 5:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]
> >wrote:
>
> > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > About Sqoop, could I import the data specifically into HBase ?
> > >
> >
> > Yes - Sqoop supports direct imports from external databases into HBase.
> > More
> > details can be found in Sqoop documentation available
> > here<
> >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> > >
> > .
> >
> > Arvind
> >
> >
> > > I know I could write a program to read from mysql and use HBase API to
> > > write
> > > to HBase.
> > >
> > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > thank you for the clarification :) I am reading about sqoop now...
> > > >
> > > >
> > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > > >wrote:
> > > >
> > > >> scribe is a tool for log aggregation, at face value, not mysql
> > > >>
> > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > > >> wrote:
> > > >>
> > > >> > Thank you for all the quick response. This really helps me along.
> > How
> > > >> about
> > > >> > facebook's scribe?
> > > >> >
> > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <
> [EMAIL PROTECTED]
> > >
> > > >> > wrote:
> > > >> >
> > > >> > > Overview:
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > > >> > >
> > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]
> >
> > > >> wrote:
> > > >> > >
> > > >> > > > ImportTSV?
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > >> > > >
> > > >> > > > Also writing a job to read from JDBC and write to hbase isnt
> too
> > > bad
> > > >> > > > if your schema isnt too insanely complex.
> > > >> > > >
> > > >> > > > -ryan
> > > >> > > >
> > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> > [EMAIL PROTECTED]
> > > >
> > > >> > > wrote:
> > > >> > > > > Sqoop?
> > > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > >> > > > >
> > > >> > > > > -----Original Message-----
> > > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > >> > > > > To: [EMAIL PROTECTED]
> > > >> > > > > Subject: is there any tool that facilitate the import of
> data
> > to
> > > >> > hbase
> > > >> > > > >
> > > >> > > > > I am looking for tool that allows me to import data from
> mysql
> > > to
> > > >> > > hbase.
> > > >> > > > Any
> > > >> > > > > suggestion?
> > > >> > > > > Thank you :)
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>