|
|
Stan Rosenberg 2012-01-24, 22:10
Hi,
Quick question: is anyone aware of a DBLoad UDF, preferably based on hadoop's DBInputFormat? I am aware that there are other better solutions, e.g., sqoop. I can see DBStorage in piggybank, but not DBLoad.
Thanks,
stan
Ashutosh Chauhan 2012-01-24, 22:14
DBStorage can be used for both load and store.
Hope it helps, Ashutosh
On Tue, Jan 24, 2012 at 14:10, Stan Rosenberg < [EMAIL PROTECTED]> wrote:
> Hi, > > Quick question: is anyone aware of a DBLoad UDF, preferably based on > hadoop's DBInputFormat? I am aware that there are other better > solutions, e.g., sqoop. > I can see DBStorage in piggybank, but not DBLoad. > > Thanks, > > stan >
Stan Rosenberg 2012-01-24, 22:17
My bad; I should have looked at the code. Thanks Ashutosh!
stan
On Tue, Jan 24, 2012 at 5:14 PM, Ashutosh Chauhan <[EMAIL PROTECTED]> wrote: > DBStorage can be used for both load and store. > > Hope it helps, > Ashutosh > > On Tue, Jan 24, 2012 at 14:10, Stan Rosenberg < > [EMAIL PROTECTED]> wrote: > >> Hi, >> >> Quick question: is anyone aware of a DBLoad UDF, preferably based on >> hadoop's DBInputFormat? I am aware that there are other better >> solutions, e.g., sqoop. >> I can see DBStorage in piggybank, but not DBLoad. >> >> Thanks, >> >> stan >>
Stan Rosenberg 2012-01-24, 22:23
Actually, I don't see the loading capability. Unless I am looking at the wrong code, org.apache.pig.piggybank.storage.DBStorage extends StoreFunc; it does not implement 'getNext'.
stan On Tue, Jan 24, 2012 at 5:17 PM, Stan Rosenberg <[EMAIL PROTECTED]> wrote: > My bad; I should have looked at the code. Thanks Ashutosh! > > stan > > On Tue, Jan 24, 2012 at 5:14 PM, Ashutosh Chauhan <[EMAIL PROTECTED]> wrote: >> DBStorage can be used for both load and store. >> >> Hope it helps, >> Ashutosh >> >> On Tue, Jan 24, 2012 at 14:10, Stan Rosenberg < >> [EMAIL PROTECTED]> wrote: >> >>> Hi, >>> >>> Quick question: is anyone aware of a DBLoad UDF, preferably based on >>> hadoop's DBInputFormat? I am aware that there are other better >>> solutions, e.g., sqoop. >>> I can see DBStorage in piggybank, but not DBLoad. >>> >>> Thanks, >>> >>> stan >>>
Ashutosh Chauhan 2012-01-25, 18:59
My bad; You are correct, its only for store not for load. I don't know of any readymade DBStorer for Pig. Looks like you will need to write one.
Ashutosh On Tue, Jan 24, 2012 at 14:23, Stan Rosenberg < [EMAIL PROTECTED]> wrote:
> Actually, I don't see the loading capability. Unless I am looking at > the wrong code, org.apache.pig.piggybank.storage.DBStorage extends > StoreFunc; it does not implement 'getNext'. > > stan > > > On Tue, Jan 24, 2012 at 5:17 PM, Stan Rosenberg > <[EMAIL PROTECTED]> wrote: > > My bad; I should have looked at the code. Thanks Ashutosh! > > > > stan > > > > On Tue, Jan 24, 2012 at 5:14 PM, Ashutosh Chauhan <[EMAIL PROTECTED]> > wrote: > >> DBStorage can be used for both load and store. > >> > >> Hope it helps, > >> Ashutosh > >> > >> On Tue, Jan 24, 2012 at 14:10, Stan Rosenberg < > >> [EMAIL PROTECTED]> wrote: > >> > >>> Hi, > >>> > >>> Quick question: is anyone aware of a DBLoad UDF, preferably based on > >>> hadoop's DBInputFormat? I am aware that there are other better > >>> solutions, e.g., sqoop. > >>> I can see DBStorage in piggybank, but not DBLoad. > >>> > >>> Thanks, > >>> > >>> stan > >>> >
|
|