Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - RDBMS and Pig


Copy link to this message
-
Re: RDBMS and Pig
Jacob Perkins 2011-07-26, 13:11
You might also take a look at

http://pig.apache.org/docs/r0.8.1/api/index.html?org/apache/pig/piggybank/storage/DBStorage.html

which is going to require that you 'register' the piggybank jar. I'm not
entirely sure that's what you're looking for either though.

I'm curious, in the same java doc I see no reference to SQLLOADER, where
did you find that?

--jacob
@thedatachef

On Tue, 2011-07-26 at 10:00 -0300, Juan Martin Pampliega wrote:
> From what I read, data from a RDBMS is read by the command:
> LOAD 'sql://mytable' USING SQLLOADER();
>
> I couldn't find any info on how the connection parameters to the database
> are passed and which databases are supported.
>
> On Tue, Jul 26, 2011 at 7:40 AM, Mance Rylan <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > I have googled a lot about if I can have Pig interact with an RDBMS.
> > Is there any way to have Pig load data from an rdbms? perform some
> > operations and then store data on Hadoop?
> >
> > Thanks,
> > Mance
> >