Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> is there any tool that facilitate the import of data to hbase


Copy link to this message
-
Re: is there any tool that facilitate the import of data to hbase
Got lotsa reading to do tonite :D

On Thu, Feb 3, 2011 at 4:17 PM, Dani Rayan <[EMAIL PROTECTED]> wrote:

> Hey,
>
> Flume: http://archive.cloudera.com/cdh/3/flume/UserGuide.html has a HBase
> sink.
> Flume is similar to Scribe, but has more to it.
>
> Original Jira: https://issues.cloudera.org/browse/FLUME-6
> Branch: https://github.com/cloudera/flume/tree/hbase
>
> -Thanks,
> Dani.
> http://www.cc.gatech.edu/~iar3/
>
> On Thu, Feb 3, 2011 at 5:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]
> >wrote:
>
> > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > About Sqoop, could I import the data specifically into HBase ?
> > >
> >
> > Yes - Sqoop supports direct imports from external databases into HBase.
> > More
> > details can be found in Sqoop documentation available
> > here<
> >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> > >
> > .
> >
> > Arvind
> >
> >
> > > I know I could write a program to read from mysql and use HBase API to
> > > write
> > > to HBase.
> > >
> > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > thank you for the clarification :) I am reading about sqoop now...
> > > >
> > > >
> > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > > >wrote:
> > > >
> > > >> scribe is a tool for log aggregation, at face value, not mysql
> > > >>
> > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > > >> wrote:
> > > >>
> > > >> > Thank you for all the quick response. This really helps me along.
> > How
> > > >> about
> > > >> > facebook's scribe?
> > > >> >
> > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <
> [EMAIL PROTECTED]
> > >
> > > >> > wrote:
> > > >> >
> > > >> > > Overview:
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > > >> > >
> > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]
> >
> > > >> wrote:
> > > >> > >
> > > >> > > > ImportTSV?
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > >> > > >
> > > >> > > > Also writing a job to read from JDBC and write to hbase isnt
> too
> > > bad
> > > >> > > > if your schema isnt too insanely complex.
> > > >> > > >
> > > >> > > > -ryan
> > > >> > > >
> > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> > [EMAIL PROTECTED]
> > > >
> > > >> > > wrote:
> > > >> > > > > Sqoop?
> > > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > >> > > > >
> > > >> > > > > -----Original Message-----
> > > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > >> > > > > To: [EMAIL PROTECTED]
> > > >> > > > > Subject: is there any tool that facilitate the import of
> data
> > to
> > > >> > hbase
> > > >> > > > >
> > > >> > > > > I am looking for tool that allows me to import data from
> mysql
> > > to
> > > >> > > hbase.
> > > >> > > > Any
> > > >> > > > > suggestion?
> > > >> > > > > Thank you :)
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB