Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> RDBMS and Pig


+
Mance Rylan 2011-07-26, 10:40
+
Juan Martin Pampliega 2011-07-26, 13:00
Copy link to this message
-
Re: RDBMS and Pig
You might also take a look at

http://pig.apache.org/docs/r0.8.1/api/index.html?org/apache/pig/piggybank/storage/DBStorage.html

which is going to require that you 'register' the piggybank jar. I'm not
entirely sure that's what you're looking for either though.

I'm curious, in the same java doc I see no reference to SQLLOADER, where
did you find that?

--jacob
@thedatachef

On Tue, 2011-07-26 at 10:00 -0300, Juan Martin Pampliega wrote:
> From what I read, data from a RDBMS is read by the command:
> LOAD 'sql://mytable' USING SQLLOADER();
>
> I couldn't find any info on how the connection parameters to the database
> are passed and which databases are supported.
>
> On Tue, Jul 26, 2011 at 7:40 AM, Mance Rylan <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > I have googled a lot about if I can have Pig interact with an RDBMS.
> > Is there any way to have Pig load data from an rdbms? perform some
> > operations and then store data on Hadoop?
> >
> > Thanks,
> > Mance
> >
+
Juan Martin Pampliega 2011-07-26, 14:21
+
Dmitriy Ryaboy 2011-07-26, 16:59
+
Mance Rylan 2011-07-27, 07:57
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB