Weishung Chung
2011-02-03, 21:18
Buttler, David
2011-02-03, 21:23
Ryan Rawson
2011-02-03, 21:28
Mark Kerzner
2011-02-03, 21:35
Weishung Chung
2011-02-03, 21:37
Mark Kerzner
2011-02-03, 21:41
Weishung Chung
2011-02-03, 21:49
Weishung Chung
2011-02-03, 21:56
arvind@...)
2011-02-03, 22:11
Weishung Chung
2011-02-03, 22:17
arvind@...)
2011-02-03, 22:44
Weishung Chung
2011-02-04, 14:50
Dani Rayan
2011-02-03, 22:17
Weishung Chung
2011-02-03, 22:27
-
is there any tool that facilitate the import of data to hbaseWeishung Chung 2011-02-03, 21:18
I am looking for tool that allows me to import data from mysql to hbase. Any
suggestion?
Thank you :)
suggestion?
Thank you :)
+
Weishung Chung 2011-02-03, 21:18
-
RE: is there any tool that facilitate the import of data to hbaseButtler, David 2011-02-03, 21:23
Sqoop?
http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
-----Original Message-----
From: Weishung Chung [mailto:[EMAIL PROTECTED]]
Sent: Thursday, February 03, 2011 1:18 PM
To: [EMAIL PROTECTED]
Subject: is there any tool that facilitate the import of data to hbase
I am looking for tool that allows me to import data from mysql to hbase. Any
suggestion?
Thank you :)
http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
-----Original Message-----
From: Weishung Chung [mailto:[EMAIL PROTECTED]]
Sent: Thursday, February 03, 2011 1:18 PM
To: [EMAIL PROTECTED]
Subject: is there any tool that facilitate the import of data to hbase
I am looking for tool that allows me to import data from mysql to hbase. Any
suggestion?
Thank you :)
+
Buttler, David 2011-02-03, 21:23
-
Re: is there any tool that facilitate the import of data to hbaseRyan Rawson 2011-02-03, 21:28
ImportTSV?
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
Also writing a job to read from JDBC and write to hbase isnt too bad
if your schema isnt too insanely complex.
-ryan
On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]> wrote:
> Sqoop?
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
>
> -----Original Message-----
> From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, February 03, 2011 1:18 PM
> To: [EMAIL PROTECTED]
> Subject: is there any tool that facilitate the import of data to hbase
>
> I am looking for tool that allows me to import data from mysql to hbase. Any
> suggestion?
> Thank you :)
>
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
Also writing a job to read from JDBC and write to hbase isnt too bad
if your schema isnt too insanely complex.
-ryan
On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]> wrote:
> Sqoop?
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
>
> -----Original Message-----
> From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, February 03, 2011 1:18 PM
> To: [EMAIL PROTECTED]
> Subject: is there any tool that facilitate the import of data to hbase
>
> I am looking for tool that allows me to import data from mysql to hbase. Any
> suggestion?
> Thank you :)
>
+
Ryan Rawson 2011-02-03, 21:28
-
Re: is there any tool that facilitate the import of data to hbaseMark Kerzner 2011-02-03, 21:35
Overview:
http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]> wrote:
> ImportTSV?
>
>
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
>
> Also writing a job to read from JDBC and write to hbase isnt too bad
> if your schema isnt too insanely complex.
>
> -ryan
>
> On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]> wrote:
> > Sqoop?
> > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> >
> > -----Original Message-----
> > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > Sent: Thursday, February 03, 2011 1:18 PM
> > To: [EMAIL PROTECTED]
> > Subject: is there any tool that facilitate the import of data to hbase
> >
> > I am looking for tool that allows me to import data from mysql to hbase.
> Any
> > suggestion?
> > Thank you :)
> >
>
http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]> wrote:
> ImportTSV?
>
>
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
>
> Also writing a job to read from JDBC and write to hbase isnt too bad
> if your schema isnt too insanely complex.
>
> -ryan
>
> On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]> wrote:
> > Sqoop?
> > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> >
> > -----Original Message-----
> > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > Sent: Thursday, February 03, 2011 1:18 PM
> > To: [EMAIL PROTECTED]
> > Subject: is there any tool that facilitate the import of data to hbase
> >
> > I am looking for tool that allows me to import data from mysql to hbase.
> Any
> > suggestion?
> > Thank you :)
> >
>
+
Mark Kerzner 2011-02-03, 21:35
-
Re: is there any tool that facilitate the import of data to hbaseWeishung Chung 2011-02-03, 21:37
Thank you for all the quick response. This really helps me along. How about
facebook's scribe?
On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]> wrote:
> Overview:
>
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
>
> On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]> wrote:
>
> > ImportTSV?
> >
> >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> >
> > Also writing a job to read from JDBC and write to hbase isnt too bad
> > if your schema isnt too insanely complex.
> >
> > -ryan
> >
> > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]>
> wrote:
> > > Sqoop?
> > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > >
> > > -----Original Message-----
> > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > Sent: Thursday, February 03, 2011 1:18 PM
> > > To: [EMAIL PROTECTED]
> > > Subject: is there any tool that facilitate the import of data to hbase
> > >
> > > I am looking for tool that allows me to import data from mysql to
> hbase.
> > Any
> > > suggestion?
> > > Thank you :)
> > >
> >
>
facebook's scribe?
On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]> wrote:
> Overview:
>
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
>
> On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]> wrote:
>
> > ImportTSV?
> >
> >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> >
> > Also writing a job to read from JDBC and write to hbase isnt too bad
> > if your schema isnt too insanely complex.
> >
> > -ryan
> >
> > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]>
> wrote:
> > > Sqoop?
> > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > >
> > > -----Original Message-----
> > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > Sent: Thursday, February 03, 2011 1:18 PM
> > > To: [EMAIL PROTECTED]
> > > Subject: is there any tool that facilitate the import of data to hbase
> > >
> > > I am looking for tool that allows me to import data from mysql to
> hbase.
> > Any
> > > suggestion?
> > > Thank you :)
> > >
> >
>
+
Weishung Chung 2011-02-03, 21:37
-
Re: is there any tool that facilitate the import of data to hbaseMark Kerzner 2011-02-03, 21:41
scribe is a tool for log aggregation, at face value, not mysql
On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
> Thank you for all the quick response. This really helps me along. How about
> facebook's scribe?
>
> On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]>
> wrote:
>
> > Overview:
> >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> >
> > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]> wrote:
> >
> > > ImportTSV?
> > >
> > >
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > >
> > > Also writing a job to read from JDBC and write to hbase isnt too bad
> > > if your schema isnt too insanely complex.
> > >
> > > -ryan
> > >
> > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]>
> > wrote:
> > > > Sqoop?
> > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > >
> > > > -----Original Message-----
> > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > > To: [EMAIL PROTECTED]
> > > > Subject: is there any tool that facilitate the import of data to
> hbase
> > > >
> > > > I am looking for tool that allows me to import data from mysql to
> > hbase.
> > > Any
> > > > suggestion?
> > > > Thank you :)
> > > >
> > >
> >
>
On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
> Thank you for all the quick response. This really helps me along. How about
> facebook's scribe?
>
> On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]>
> wrote:
>
> > Overview:
> >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> >
> > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]> wrote:
> >
> > > ImportTSV?
> > >
> > >
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > >
> > > Also writing a job to read from JDBC and write to hbase isnt too bad
> > > if your schema isnt too insanely complex.
> > >
> > > -ryan
> > >
> > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]>
> > wrote:
> > > > Sqoop?
> > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > >
> > > > -----Original Message-----
> > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > > To: [EMAIL PROTECTED]
> > > > Subject: is there any tool that facilitate the import of data to
> hbase
> > > >
> > > > I am looking for tool that allows me to import data from mysql to
> > hbase.
> > > Any
> > > > suggestion?
> > > > Thank you :)
> > > >
> > >
> >
>
+
Mark Kerzner 2011-02-03, 21:41
-
Re: is there any tool that facilitate the import of data to hbaseWeishung Chung 2011-02-03, 21:49
thank you for the clarification :) I am reading about sqoop now...
On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]> wrote:
> scribe is a tool for log aggregation, at face value, not mysql
>
> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > Thank you for all the quick response. This really helps me along. How
> about
> > facebook's scribe?
> >
> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]>
> > wrote:
> >
> > > Overview:
> > >
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > >
> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
> wrote:
> > >
> > > > ImportTSV?
> > > >
> > > >
> > > >
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > >
> > > > Also writing a job to read from JDBC and write to hbase isnt too bad
> > > > if your schema isnt too insanely complex.
> > > >
> > > > -ryan
> > > >
> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]>
> > > wrote:
> > > > > Sqoop?
> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > > >
> > > > > -----Original Message-----
> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > > > To: [EMAIL PROTECTED]
> > > > > Subject: is there any tool that facilitate the import of data to
> > hbase
> > > > >
> > > > > I am looking for tool that allows me to import data from mysql to
> > > hbase.
> > > > Any
> > > > > suggestion?
> > > > > Thank you :)
> > > > >
> > > >
> > >
> >
>
On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]> wrote:
> scribe is a tool for log aggregation, at face value, not mysql
>
> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > Thank you for all the quick response. This really helps me along. How
> about
> > facebook's scribe?
> >
> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]>
> > wrote:
> >
> > > Overview:
> > >
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > >
> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
> wrote:
> > >
> > > > ImportTSV?
> > > >
> > > >
> > > >
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > >
> > > > Also writing a job to read from JDBC and write to hbase isnt too bad
> > > > if your schema isnt too insanely complex.
> > > >
> > > > -ryan
> > > >
> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]>
> > > wrote:
> > > > > Sqoop?
> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > > >
> > > > > -----Original Message-----
> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > > > To: [EMAIL PROTECTED]
> > > > > Subject: is there any tool that facilitate the import of data to
> > hbase
> > > > >
> > > > > I am looking for tool that allows me to import data from mysql to
> > > hbase.
> > > > Any
> > > > > suggestion?
> > > > > Thank you :)
> > > > >
> > > >
> > >
> >
>
+
Weishung Chung 2011-02-03, 21:49
-
Re: is there any tool that facilitate the import of data to hbaseWeishung Chung 2011-02-03, 21:56
About Sqoop, could I import the data specifically into HBase ?
I know I could write a program to read from mysql and use HBase API to write
to HBase.
On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
> thank you for the clarification :) I am reading about sqoop now...
>
>
> On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]>wrote:
>
>> scribe is a tool for log aggregation, at face value, not mysql
>>
>> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
>> wrote:
>>
>> > Thank you for all the quick response. This really helps me along. How
>> about
>> > facebook's scribe?
>> >
>> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]>
>> > wrote:
>> >
>> > > Overview:
>> > >
>> > >
>> >
>> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
>> > >
>> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
>> wrote:
>> > >
>> > > > ImportTSV?
>> > > >
>> > > >
>> > > >
>> > >
>> >
>> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
>> > > >
>> > > > Also writing a job to read from JDBC and write to hbase isnt too bad
>> > > > if your schema isnt too insanely complex.
>> > > >
>> > > > -ryan
>> > > >
>> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]>
>> > > wrote:
>> > > > > Sqoop?
>> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
>> > > > >
>> > > > > -----Original Message-----
>> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
>> > > > > Sent: Thursday, February 03, 2011 1:18 PM
>> > > > > To: [EMAIL PROTECTED]
>> > > > > Subject: is there any tool that facilitate the import of data to
>> > hbase
>> > > > >
>> > > > > I am looking for tool that allows me to import data from mysql to
>> > > hbase.
>> > > > Any
>> > > > > suggestion?
>> > > > > Thank you :)
>> > > > >
>> > > >
>> > >
>> >
>>
>
>
I know I could write a program to read from mysql and use HBase API to write
to HBase.
On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
> thank you for the clarification :) I am reading about sqoop now...
>
>
> On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]>wrote:
>
>> scribe is a tool for log aggregation, at face value, not mysql
>>
>> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
>> wrote:
>>
>> > Thank you for all the quick response. This really helps me along. How
>> about
>> > facebook's scribe?
>> >
>> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]>
>> > wrote:
>> >
>> > > Overview:
>> > >
>> > >
>> >
>> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
>> > >
>> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
>> wrote:
>> > >
>> > > > ImportTSV?
>> > > >
>> > > >
>> > > >
>> > >
>> >
>> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
>> > > >
>> > > > Also writing a job to read from JDBC and write to hbase isnt too bad
>> > > > if your schema isnt too insanely complex.
>> > > >
>> > > > -ryan
>> > > >
>> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]>
>> > > wrote:
>> > > > > Sqoop?
>> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
>> > > > >
>> > > > > -----Original Message-----
>> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
>> > > > > Sent: Thursday, February 03, 2011 1:18 PM
>> > > > > To: [EMAIL PROTECTED]
>> > > > > Subject: is there any tool that facilitate the import of data to
>> > hbase
>> > > > >
>> > > > > I am looking for tool that allows me to import data from mysql to
>> > > hbase.
>> > > > Any
>> > > > > suggestion?
>> > > > > Thank you :)
>> > > > >
>> > > >
>> > >
>> >
>>
>
>
+
Weishung Chung 2011-02-03, 21:56
-
Re: is there any tool that facilitate the import of data to hbasearvind@...) 2011-02-03, 22:11
On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
> About Sqoop, could I import the data specifically into HBase ?
>
Yes - Sqoop supports direct imports from external databases into HBase. More
details can be found in Sqoop documentation available
here<http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase>
.
Arvind
> I know I could write a program to read from mysql and use HBase API to
> write
> to HBase.
>
> On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > thank you for the clarification :) I am reading about sqoop now...
> >
> >
> > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> >wrote:
> >
> >> scribe is a tool for log aggregation, at face value, not mysql
> >>
> >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> >> wrote:
> >>
> >> > Thank you for all the quick response. This really helps me along. How
> >> about
> >> > facebook's scribe?
> >> >
> >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]>
> >> > wrote:
> >> >
> >> > > Overview:
> >> > >
> >> > >
> >> >
> >>
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> >> > >
> >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
> >> wrote:
> >> > >
> >> > > > ImportTSV?
> >> > > >
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> >> > > >
> >> > > > Also writing a job to read from JDBC and write to hbase isnt too
> bad
> >> > > > if your schema isnt too insanely complex.
> >> > > >
> >> > > > -ryan
> >> > > >
> >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]
> >
> >> > > wrote:
> >> > > > > Sqoop?
> >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> >> > > > >
> >> > > > > -----Original Message-----
> >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> >> > > > > To: [EMAIL PROTECTED]
> >> > > > > Subject: is there any tool that facilitate the import of data to
> >> > hbase
> >> > > > >
> >> > > > > I am looking for tool that allows me to import data from mysql
> to
> >> > > hbase.
> >> > > > Any
> >> > > > > suggestion?
> >> > > > > Thank you :)
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>
> About Sqoop, could I import the data specifically into HBase ?
>
Yes - Sqoop supports direct imports from external databases into HBase. More
details can be found in Sqoop documentation available
here<http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase>
.
Arvind
> I know I could write a program to read from mysql and use HBase API to
> write
> to HBase.
>
> On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > thank you for the clarification :) I am reading about sqoop now...
> >
> >
> > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> >wrote:
> >
> >> scribe is a tool for log aggregation, at face value, not mysql
> >>
> >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> >> wrote:
> >>
> >> > Thank you for all the quick response. This really helps me along. How
> >> about
> >> > facebook's scribe?
> >> >
> >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]>
> >> > wrote:
> >> >
> >> > > Overview:
> >> > >
> >> > >
> >> >
> >>
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> >> > >
> >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
> >> wrote:
> >> > >
> >> > > > ImportTSV?
> >> > > >
> >> > > >
> >> > > >
> >> > >
> >> >
> >>
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> >> > > >
> >> > > > Also writing a job to read from JDBC and write to hbase isnt too
> bad
> >> > > > if your schema isnt too insanely complex.
> >> > > >
> >> > > > -ryan
> >> > > >
> >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <[EMAIL PROTECTED]
> >
> >> > > wrote:
> >> > > > > Sqoop?
> >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> >> > > > >
> >> > > > > -----Original Message-----
> >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> >> > > > > To: [EMAIL PROTECTED]
> >> > > > > Subject: is there any tool that facilitate the import of data to
> >> > hbase
> >> > > > >
> >> > > > > I am looking for tool that allows me to import data from mysql
> to
> >> > > hbase.
> >> > > > Any
> >> > > > > suggestion?
> >> > > > > Thank you :)
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>
+
arvind@...) 2011-02-03, 22:11
-
Re: is there any tool that facilitate the import of data to hbaseWeishung Chung 2011-02-03, 22:17
that's awesome !!!
could I go from HBase to Mysql too since I might have to maintain
backward compatibility between the two systems in the process of switch over
to HBase?
On Thu, Feb 3, 2011 at 4:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]>wrote:
> On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > About Sqoop, could I import the data specifically into HBase ?
> >
>
> Yes - Sqoop supports direct imports from external databases into HBase.
> More
> details can be found in Sqoop documentation available
> here<
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> >
> .
>
> Arvind
>
>
> > I know I could write a program to read from mysql and use HBase API to
> > write
> > to HBase.
> >
> > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > thank you for the clarification :) I am reading about sqoop now...
> > >
> > >
> > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > >wrote:
> > >
> > >> scribe is a tool for log aggregation, at face value, not mysql
> > >>
> > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > >> wrote:
> > >>
> > >> > Thank you for all the quick response. This really helps me along.
> How
> > >> about
> > >> > facebook's scribe?
> > >> >
> > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]
> >
> > >> > wrote:
> > >> >
> > >> > > Overview:
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > >> > >
> > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
> > >> wrote:
> > >> > >
> > >> > > > ImportTSV?
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > >> > > >
> > >> > > > Also writing a job to read from JDBC and write to hbase isnt too
> > bad
> > >> > > > if your schema isnt too insanely complex.
> > >> > > >
> > >> > > > -ryan
> > >> > > >
> > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> [EMAIL PROTECTED]
> > >
> > >> > > wrote:
> > >> > > > > Sqoop?
> > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > >> > > > >
> > >> > > > > -----Original Message-----
> > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > >> > > > > To: [EMAIL PROTECTED]
> > >> > > > > Subject: is there any tool that facilitate the import of data
> to
> > >> > hbase
> > >> > > > >
> > >> > > > > I am looking for tool that allows me to import data from mysql
> > to
> > >> > > hbase.
> > >> > > > Any
> > >> > > > > suggestion?
> > >> > > > > Thank you :)
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
could I go from HBase to Mysql too since I might have to maintain
backward compatibility between the two systems in the process of switch over
to HBase?
On Thu, Feb 3, 2011 at 4:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]>wrote:
> On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > About Sqoop, could I import the data specifically into HBase ?
> >
>
> Yes - Sqoop supports direct imports from external databases into HBase.
> More
> details can be found in Sqoop documentation available
> here<
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> >
> .
>
> Arvind
>
>
> > I know I could write a program to read from mysql and use HBase API to
> > write
> > to HBase.
> >
> > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > thank you for the clarification :) I am reading about sqoop now...
> > >
> > >
> > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > >wrote:
> > >
> > >> scribe is a tool for log aggregation, at face value, not mysql
> > >>
> > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > >> wrote:
> > >>
> > >> > Thank you for all the quick response. This really helps me along.
> How
> > >> about
> > >> > facebook's scribe?
> > >> >
> > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]
> >
> > >> > wrote:
> > >> >
> > >> > > Overview:
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > >> > >
> > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
> > >> wrote:
> > >> > >
> > >> > > > ImportTSV?
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > >> > > >
> > >> > > > Also writing a job to read from JDBC and write to hbase isnt too
> > bad
> > >> > > > if your schema isnt too insanely complex.
> > >> > > >
> > >> > > > -ryan
> > >> > > >
> > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> [EMAIL PROTECTED]
> > >
> > >> > > wrote:
> > >> > > > > Sqoop?
> > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > >> > > > >
> > >> > > > > -----Original Message-----
> > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > >> > > > > To: [EMAIL PROTECTED]
> > >> > > > > Subject: is there any tool that facilitate the import of data
> to
> > >> > hbase
> > >> > > > >
> > >> > > > > I am looking for tool that allows me to import data from mysql
> > to
> > >> > > hbase.
> > >> > > > Any
> > >> > > > > suggestion?
> > >> > > > > Thank you :)
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
+
Weishung Chung 2011-02-03, 22:17
-
Re: is there any tool that facilitate the import of data to hbasearvind@...) 2011-02-03, 22:44
On Thu, Feb 3, 2011 at 2:17 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
> that's awesome !!!
> could I go from HBase to Mysql too since I might have to maintain
> backward compatibility between the two systems in the process of switch
> over
> to HBase?
>
At this time Sqoop supports importing data from external databases into Hive
and HBase. However, exporting is not directly supported. You could extract
data into HDFS and then move it back to the external system possibly.
We are working on providing export capability from HBase and Hive
to external databases in Sqoop. This will likely be implemented in the next
few releases.
Arvind
>
> On Thu, Feb 3, 2011 at 4:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]
> >wrote:
>
> > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > About Sqoop, could I import the data specifically into HBase ?
> > >
> >
> > Yes - Sqoop supports direct imports from external databases into HBase.
> > More
> > details can be found in Sqoop documentation available
> > here<
> >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> > >
> > .
> >
> > Arvind
> >
> >
> > > I know I could write a program to read from mysql and use HBase API to
> > > write
> > > to HBase.
> > >
> > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > thank you for the clarification :) I am reading about sqoop now...
> > > >
> > > >
> > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > > >wrote:
> > > >
> > > >> scribe is a tool for log aggregation, at face value, not mysql
> > > >>
> > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > > >> wrote:
> > > >>
> > > >> > Thank you for all the quick response. This really helps me along.
> > How
> > > >> about
> > > >> > facebook's scribe?
> > > >> >
> > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <
> [EMAIL PROTECTED]
> > >
> > > >> > wrote:
> > > >> >
> > > >> > > Overview:
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > > >> > >
> > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]
> >
> > > >> wrote:
> > > >> > >
> > > >> > > > ImportTSV?
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > >> > > >
> > > >> > > > Also writing a job to read from JDBC and write to hbase isnt
> too
> > > bad
> > > >> > > > if your schema isnt too insanely complex.
> > > >> > > >
> > > >> > > > -ryan
> > > >> > > >
> > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> > [EMAIL PROTECTED]
> > > >
> > > >> > > wrote:
> > > >> > > > > Sqoop?
> > > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > >> > > > >
> > > >> > > > > -----Original Message-----
> > > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > >> > > > > To: [EMAIL PROTECTED]
> > > >> > > > > Subject: is there any tool that facilitate the import of
> data
> > to
> > > >> > hbase
> > > >> > > > >
> > > >> > > > > I am looking for tool that allows me to import data from
> mysql
> > > to
> > > >> > > hbase.
> > > >> > > > Any
> > > >> > > > > suggestion?
> > > >> > > > > Thank you :)
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
> that's awesome !!!
> could I go from HBase to Mysql too since I might have to maintain
> backward compatibility between the two systems in the process of switch
> over
> to HBase?
>
At this time Sqoop supports importing data from external databases into Hive
and HBase. However, exporting is not directly supported. You could extract
data into HDFS and then move it back to the external system possibly.
We are working on providing export capability from HBase and Hive
to external databases in Sqoop. This will likely be implemented in the next
few releases.
Arvind
>
> On Thu, Feb 3, 2011 at 4:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]
> >wrote:
>
> > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > About Sqoop, could I import the data specifically into HBase ?
> > >
> >
> > Yes - Sqoop supports direct imports from external databases into HBase.
> > More
> > details can be found in Sqoop documentation available
> > here<
> >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> > >
> > .
> >
> > Arvind
> >
> >
> > > I know I could write a program to read from mysql and use HBase API to
> > > write
> > > to HBase.
> > >
> > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > thank you for the clarification :) I am reading about sqoop now...
> > > >
> > > >
> > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > > >wrote:
> > > >
> > > >> scribe is a tool for log aggregation, at face value, not mysql
> > > >>
> > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > > >> wrote:
> > > >>
> > > >> > Thank you for all the quick response. This really helps me along.
> > How
> > > >> about
> > > >> > facebook's scribe?
> > > >> >
> > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <
> [EMAIL PROTECTED]
> > >
> > > >> > wrote:
> > > >> >
> > > >> > > Overview:
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > > >> > >
> > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]
> >
> > > >> wrote:
> > > >> > >
> > > >> > > > ImportTSV?
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > >> > > >
> > > >> > > > Also writing a job to read from JDBC and write to hbase isnt
> too
> > > bad
> > > >> > > > if your schema isnt too insanely complex.
> > > >> > > >
> > > >> > > > -ryan
> > > >> > > >
> > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> > [EMAIL PROTECTED]
> > > >
> > > >> > > wrote:
> > > >> > > > > Sqoop?
> > > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > >> > > > >
> > > >> > > > > -----Original Message-----
> > > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > >> > > > > To: [EMAIL PROTECTED]
> > > >> > > > > Subject: is there any tool that facilitate the import of
> data
> > to
> > > >> > hbase
> > > >> > > > >
> > > >> > > > > I am looking for tool that allows me to import data from
> mysql
> > > to
> > > >> > > hbase.
> > > >> > > > Any
> > > >> > > > > suggestion?
> > > >> > > > > Thank you :)
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
+
arvind@...) 2011-02-03, 22:44
-
Re: is there any tool that facilitate the import of data to hbaseWeishung Chung 2011-02-04, 14:50
I am looking forward to it :)
btw, I found this informative video about Sqoop.
http://www.cloudera.com/blog/2009/12/hadoop-world-sqoop-database-import-for-hadoop/
On Thu, Feb 3, 2011 at 4:44 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]>wrote:
> On Thu, Feb 3, 2011 at 2:17 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > that's awesome !!!
> > could I go from HBase to Mysql too since I might have to maintain
> > backward compatibility between the two systems in the process of switch
> > over
> > to HBase?
> >
>
> At this time Sqoop supports importing data from external databases into
> Hive
> and HBase. However, exporting is not directly supported. You could extract
> data into HDFS and then move it back to the external system possibly.
>
> We are working on providing export capability from HBase and Hive
> to external databases in Sqoop. This will likely be implemented in the next
> few releases.
>
> Arvind
>
>
> >
> > On Thu, Feb 3, 2011 at 4:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]
> > >wrote:
> >
> > > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > About Sqoop, could I import the data specifically into HBase ?
> > > >
> > >
> > > Yes - Sqoop supports direct imports from external databases into HBase.
> > > More
> > > details can be found in Sqoop documentation available
> > > here<
> > >
> >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> > > >
> > > .
> > >
> > > Arvind
> > >
> > >
> > > > I know I could write a program to read from mysql and use HBase API
> to
> > > > write
> > > > to HBase.
> > > >
> > > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> > > wrote:
> > > >
> > > > > thank you for the clarification :) I am reading about sqoop now...
> > > > >
> > > > >
> > > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <
> [EMAIL PROTECTED]
> > > > >wrote:
> > > > >
> > > > >> scribe is a tool for log aggregation, at face value, not mysql
> > > > >>
> > > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <
> [EMAIL PROTECTED]>
> > > > >> wrote:
> > > > >>
> > > > >> > Thank you for all the quick response. This really helps me
> along.
> > > How
> > > > >> about
> > > > >> > facebook's scribe?
> > > > >> >
> > > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <
> > [EMAIL PROTECTED]
> > > >
> > > > >> > wrote:
> > > > >> >
> > > > >> > > Overview:
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > > > >> > >
> > > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <
> [EMAIL PROTECTED]
> > >
> > > > >> wrote:
> > > > >> > >
> > > > >> > > > ImportTSV?
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > > >> > > >
> > > > >> > > > Also writing a job to read from JDBC and write to hbase isnt
> > too
> > > > bad
> > > > >> > > > if your schema isnt too insanely complex.
> > > > >> > > >
> > > > >> > > > -ryan
> > > > >> > > >
> > > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> > > [EMAIL PROTECTED]
> > > > >
> > > > >> > > wrote:
> > > > >> > > > > Sqoop?
> > > > >> > > > >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > > >> > > > >
> > > > >> > > > > -----Original Message-----
> > > > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > > >> > > > > To: [EMAIL PROTECTED]
> > > > >> > > > > Subject: is there any tool that facilitate the import of
> > data
> > > to
> > > > >> > hbase
> > > > >> > > > >
> > > > >> > > > > I am looking for tool that allows me to import data from
> > mysql
> > > > to
> > > > >> > > hbase.
> > > > >> > > > Any
> > > > >> > > > > suggestion?
> > > > >> > > > > Thank you :)
> > > > >> > > > >
btw, I found this informative video about Sqoop.
http://www.cloudera.com/blog/2009/12/hadoop-world-sqoop-database-import-for-hadoop/
On Thu, Feb 3, 2011 at 4:44 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]>wrote:
> On Thu, Feb 3, 2011 at 2:17 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > that's awesome !!!
> > could I go from HBase to Mysql too since I might have to maintain
> > backward compatibility between the two systems in the process of switch
> > over
> > to HBase?
> >
>
> At this time Sqoop supports importing data from external databases into
> Hive
> and HBase. However, exporting is not directly supported. You could extract
> data into HDFS and then move it back to the external system possibly.
>
> We are working on providing export capability from HBase and Hive
> to external databases in Sqoop. This will likely be implemented in the next
> few releases.
>
> Arvind
>
>
> >
> > On Thu, Feb 3, 2011 at 4:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]
> > >wrote:
> >
> > > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > About Sqoop, could I import the data specifically into HBase ?
> > > >
> > >
> > > Yes - Sqoop supports direct imports from external databases into HBase.
> > > More
> > > details can be found in Sqoop documentation available
> > > here<
> > >
> >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> > > >
> > > .
> > >
> > > Arvind
> > >
> > >
> > > > I know I could write a program to read from mysql and use HBase API
> to
> > > > write
> > > > to HBase.
> > > >
> > > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> > > wrote:
> > > >
> > > > > thank you for the clarification :) I am reading about sqoop now...
> > > > >
> > > > >
> > > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <
> [EMAIL PROTECTED]
> > > > >wrote:
> > > > >
> > > > >> scribe is a tool for log aggregation, at face value, not mysql
> > > > >>
> > > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <
> [EMAIL PROTECTED]>
> > > > >> wrote:
> > > > >>
> > > > >> > Thank you for all the quick response. This really helps me
> along.
> > > How
> > > > >> about
> > > > >> > facebook's scribe?
> > > > >> >
> > > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <
> > [EMAIL PROTECTED]
> > > >
> > > > >> > wrote:
> > > > >> >
> > > > >> > > Overview:
> > > > >> > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > > > >> > >
> > > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <
> [EMAIL PROTECTED]
> > >
> > > > >> wrote:
> > > > >> > >
> > > > >> > > > ImportTSV?
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >>
> > > >
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > > >> > > >
> > > > >> > > > Also writing a job to read from JDBC and write to hbase isnt
> > too
> > > > bad
> > > > >> > > > if your schema isnt too insanely complex.
> > > > >> > > >
> > > > >> > > > -ryan
> > > > >> > > >
> > > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> > > [EMAIL PROTECTED]
> > > > >
> > > > >> > > wrote:
> > > > >> > > > > Sqoop?
> > > > >> > > > >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > > >> > > > >
> > > > >> > > > > -----Original Message-----
> > > > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > > >> > > > > To: [EMAIL PROTECTED]
> > > > >> > > > > Subject: is there any tool that facilitate the import of
> > data
> > > to
> > > > >> > hbase
> > > > >> > > > >
> > > > >> > > > > I am looking for tool that allows me to import data from
> > mysql
> > > > to
> > > > >> > > hbase.
> > > > >> > > > Any
> > > > >> > > > > suggestion?
> > > > >> > > > > Thank you :)
> > > > >> > > > >
+
Weishung Chung 2011-02-04, 14:50
-
Re: is there any tool that facilitate the import of data to hbaseDani Rayan 2011-02-03, 22:17
Hey,
Flume: http://archive.cloudera.com/cdh/3/flume/UserGuide.html has a HBase
sink.
Flume is similar to Scribe, but has more to it.
Original Jira: https://issues.cloudera.org/browse/FLUME-6
Branch: https://github.com/cloudera/flume/tree/hbase
-Thanks,
Dani.
http://www.cc.gatech.edu/~iar3/
On Thu, Feb 3, 2011 at 5:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]>wrote:
> On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > About Sqoop, could I import the data specifically into HBase ?
> >
>
> Yes - Sqoop supports direct imports from external databases into HBase.
> More
> details can be found in Sqoop documentation available
> here<
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> >
> .
>
> Arvind
>
>
> > I know I could write a program to read from mysql and use HBase API to
> > write
> > to HBase.
> >
> > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > thank you for the clarification :) I am reading about sqoop now...
> > >
> > >
> > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > >wrote:
> > >
> > >> scribe is a tool for log aggregation, at face value, not mysql
> > >>
> > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > >> wrote:
> > >>
> > >> > Thank you for all the quick response. This really helps me along.
> How
> > >> about
> > >> > facebook's scribe?
> > >> >
> > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]
> >
> > >> > wrote:
> > >> >
> > >> > > Overview:
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > >> > >
> > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
> > >> wrote:
> > >> > >
> > >> > > > ImportTSV?
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > >> > > >
> > >> > > > Also writing a job to read from JDBC and write to hbase isnt too
> > bad
> > >> > > > if your schema isnt too insanely complex.
> > >> > > >
> > >> > > > -ryan
> > >> > > >
> > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> [EMAIL PROTECTED]
> > >
> > >> > > wrote:
> > >> > > > > Sqoop?
> > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > >> > > > >
> > >> > > > > -----Original Message-----
> > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > >> > > > > To: [EMAIL PROTECTED]
> > >> > > > > Subject: is there any tool that facilitate the import of data
> to
> > >> > hbase
> > >> > > > >
> > >> > > > > I am looking for tool that allows me to import data from mysql
> > to
> > >> > > hbase.
> > >> > > > Any
> > >> > > > > suggestion?
> > >> > > > > Thank you :)
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
Flume: http://archive.cloudera.com/cdh/3/flume/UserGuide.html has a HBase
sink.
Flume is similar to Scribe, but has more to it.
Original Jira: https://issues.cloudera.org/browse/FLUME-6
Branch: https://github.com/cloudera/flume/tree/hbase
-Thanks,
Dani.
http://www.cc.gatech.edu/~iar3/
On Thu, Feb 3, 2011 at 5:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]>wrote:
> On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]> wrote:
>
> > About Sqoop, could I import the data specifically into HBase ?
> >
>
> Yes - Sqoop supports direct imports from external databases into HBase.
> More
> details can be found in Sqoop documentation available
> here<
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> >
> .
>
> Arvind
>
>
> > I know I could write a program to read from mysql and use HBase API to
> > write
> > to HBase.
> >
> > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > thank you for the clarification :) I am reading about sqoop now...
> > >
> > >
> > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > >wrote:
> > >
> > >> scribe is a tool for log aggregation, at face value, not mysql
> > >>
> > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > >> wrote:
> > >>
> > >> > Thank you for all the quick response. This really helps me along.
> How
> > >> about
> > >> > facebook's scribe?
> > >> >
> > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <[EMAIL PROTECTED]
> >
> > >> > wrote:
> > >> >
> > >> > > Overview:
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > >> > >
> > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]>
> > >> wrote:
> > >> > >
> > >> > > > ImportTSV?
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > >> > > >
> > >> > > > Also writing a job to read from JDBC and write to hbase isnt too
> > bad
> > >> > > > if your schema isnt too insanely complex.
> > >> > > >
> > >> > > > -ryan
> > >> > > >
> > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> [EMAIL PROTECTED]
> > >
> > >> > > wrote:
> > >> > > > > Sqoop?
> > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > >> > > > >
> > >> > > > > -----Original Message-----
> > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > >> > > > > To: [EMAIL PROTECTED]
> > >> > > > > Subject: is there any tool that facilitate the import of data
> to
> > >> > hbase
> > >> > > > >
> > >> > > > > I am looking for tool that allows me to import data from mysql
> > to
> > >> > > hbase.
> > >> > > > Any
> > >> > > > > suggestion?
> > >> > > > > Thank you :)
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >>
> > >
> > >
> >
>
+
Dani Rayan 2011-02-03, 22:17
-
Re: is there any tool that facilitate the import of data to hbaseWeishung Chung 2011-02-03, 22:27
Got lotsa reading to do tonite :D
On Thu, Feb 3, 2011 at 4:17 PM, Dani Rayan <[EMAIL PROTECTED]> wrote:
> Hey,
>
> Flume: http://archive.cloudera.com/cdh/3/flume/UserGuide.html has a HBase
> sink.
> Flume is similar to Scribe, but has more to it.
>
> Original Jira: https://issues.cloudera.org/browse/FLUME-6
> Branch: https://github.com/cloudera/flume/tree/hbase
>
> -Thanks,
> Dani.
> http://www.cc.gatech.edu/~iar3/
>
> On Thu, Feb 3, 2011 at 5:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]
> >wrote:
>
> > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > About Sqoop, could I import the data specifically into HBase ?
> > >
> >
> > Yes - Sqoop supports direct imports from external databases into HBase.
> > More
> > details can be found in Sqoop documentation available
> > here<
> >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> > >
> > .
> >
> > Arvind
> >
> >
> > > I know I could write a program to read from mysql and use HBase API to
> > > write
> > > to HBase.
> > >
> > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > thank you for the clarification :) I am reading about sqoop now...
> > > >
> > > >
> > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > > >wrote:
> > > >
> > > >> scribe is a tool for log aggregation, at face value, not mysql
> > > >>
> > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > > >> wrote:
> > > >>
> > > >> > Thank you for all the quick response. This really helps me along.
> > How
> > > >> about
> > > >> > facebook's scribe?
> > > >> >
> > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <
> [EMAIL PROTECTED]
> > >
> > > >> > wrote:
> > > >> >
> > > >> > > Overview:
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > > >> > >
> > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]
> >
> > > >> wrote:
> > > >> > >
> > > >> > > > ImportTSV?
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > >> > > >
> > > >> > > > Also writing a job to read from JDBC and write to hbase isnt
> too
> > > bad
> > > >> > > > if your schema isnt too insanely complex.
> > > >> > > >
> > > >> > > > -ryan
> > > >> > > >
> > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> > [EMAIL PROTECTED]
> > > >
> > > >> > > wrote:
> > > >> > > > > Sqoop?
> > > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > >> > > > >
> > > >> > > > > -----Original Message-----
> > > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > >> > > > > To: [EMAIL PROTECTED]
> > > >> > > > > Subject: is there any tool that facilitate the import of
> data
> > to
> > > >> > hbase
> > > >> > > > >
> > > >> > > > > I am looking for tool that allows me to import data from
> mysql
> > > to
> > > >> > > hbase.
> > > >> > > > Any
> > > >> > > > > suggestion?
> > > >> > > > > Thank you :)
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
On Thu, Feb 3, 2011 at 4:17 PM, Dani Rayan <[EMAIL PROTECTED]> wrote:
> Hey,
>
> Flume: http://archive.cloudera.com/cdh/3/flume/UserGuide.html has a HBase
> sink.
> Flume is similar to Scribe, but has more to it.
>
> Original Jira: https://issues.cloudera.org/browse/FLUME-6
> Branch: https://github.com/cloudera/flume/tree/hbase
>
> -Thanks,
> Dani.
> http://www.cc.gatech.edu/~iar3/
>
> On Thu, Feb 3, 2011 at 5:11 PM, [EMAIL PROTECTED] <[EMAIL PROTECTED]
> >wrote:
>
> > On Thu, Feb 3, 2011 at 1:56 PM, Weishung Chung <[EMAIL PROTECTED]>
> wrote:
> >
> > > About Sqoop, could I import the data specifically into HBase ?
> > >
> >
> > Yes - Sqoop supports direct imports from external databases into HBase.
> > More
> > details can be found in Sqoop documentation available
> > here<
> >
> http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html#_importing_data_into_hbase
> > >
> > .
> >
> > Arvind
> >
> >
> > > I know I could write a program to read from mysql and use HBase API to
> > > write
> > > to HBase.
> > >
> > > On Thu, Feb 3, 2011 at 3:49 PM, Weishung Chung <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > thank you for the clarification :) I am reading about sqoop now...
> > > >
> > > >
> > > > On Thu, Feb 3, 2011 at 3:41 PM, Mark Kerzner <[EMAIL PROTECTED]
> > > >wrote:
> > > >
> > > >> scribe is a tool for log aggregation, at face value, not mysql
> > > >>
> > > >> On Thu, Feb 3, 2011 at 3:37 PM, Weishung Chung <[EMAIL PROTECTED]>
> > > >> wrote:
> > > >>
> > > >> > Thank you for all the quick response. This really helps me along.
> > How
> > > >> about
> > > >> > facebook's scribe?
> > > >> >
> > > >> > On Thu, Feb 3, 2011 at 3:35 PM, Mark Kerzner <
> [EMAIL PROTECTED]
> > >
> > > >> > wrote:
> > > >> >
> > > >> > > Overview:
> > > >> > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hadoopinpractice.blogspot.com/2011/01/loading-data-from-mysql-to-hadoop.html
> > > >> > >
> > > >> > > On Thu, Feb 3, 2011 at 3:28 PM, Ryan Rawson <[EMAIL PROTECTED]
> >
> > > >> wrote:
> > > >> > >
> > > >> > > > ImportTSV?
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/ImportTsv.html
> > > >> > > >
> > > >> > > > Also writing a job to read from JDBC and write to hbase isnt
> too
> > > bad
> > > >> > > > if your schema isnt too insanely complex.
> > > >> > > >
> > > >> > > > -ryan
> > > >> > > >
> > > >> > > > On Thu, Feb 3, 2011 at 1:23 PM, Buttler, David <
> > [EMAIL PROTECTED]
> > > >
> > > >> > > wrote:
> > > >> > > > > Sqoop?
> > > >> > > > > http://archive.cloudera.com/cdh/3/sqoop/SqoopUserGuide.html
> > > >> > > > >
> > > >> > > > > -----Original Message-----
> > > >> > > > > From: Weishung Chung [mailto:[EMAIL PROTECTED]]
> > > >> > > > > Sent: Thursday, February 03, 2011 1:18 PM
> > > >> > > > > To: [EMAIL PROTECTED]
> > > >> > > > > Subject: is there any tool that facilitate the import of
> data
> > to
> > > >> > hbase
> > > >> > > > >
> > > >> > > > > I am looking for tool that allows me to import data from
> mysql
> > > to
> > > >> > > hbase.
> > > >> > > > Any
> > > >> > > > > suggestion?
> > > >> > > > > Thank you :)
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>
+
Weishung Chung 2011-02-03, 22:27
