Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> DBStorage to LOAD data via a SQL query?

Copy link to this message
Re: DBStorage to LOAD data via a SQL query?

Looking at source code for DBStorage, seems like it does exactly that. Can
you try it out?

public DBStorage(String driver, String jdbcURL, String user, String pass,
      String insertQuery, String batchSize)


On Sat, Apr 28, 2012 at 12:22 AM, Russell Jurney

> Is it possible to use DBStorage to load data from MySQL by running a
> suppled SQL query? Something like:
> mydata = LOAD 'jdbc://localhost/enron' USING DBStorage('SELECT foo.value1,
> bar.value2 FROM foo JOIN bar on foo.bar_id = bar.id');
> Even if I have to LOAD AS and specify a schema, that would be great.
> It is problematic that there are no docs for DBStorage. If someone clues me
> in, I'll write it up :)
> --
> Russell Jurney twitter.com/rjurney [EMAIL PROTECTED]
> datasyndrome.com