Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Run a job async


Copy link to this message
-
Re: Run a job async
Thousands of requests, or thousands of Pig jobs? Or both?
2013/1/23 Prashant Kommireddi <[EMAIL PROTECTED]>

> Did not want to have several threads launched for this. We might have
> thousands of requests coming in, and the app is doing a lot more than only
> Pig.
>
> On Wed, Jan 23, 2013 at 5:44 PM, Jonathan Coveney <[EMAIL PROTECTED]
> >wrote:
>
> > start a separate Process which runs Pig?
> >
> >
> > 2013/1/23 Prashant Kommireddi <[EMAIL PROTECTED]>
> >
> > > Hey guys,
> > >
> > > I am trying to do the following:
> > >
> > >    1. Launch a pig job asynchronously via Java program
> > >    2. Get a notification once the job is complete (something similar to
> > >    Hadoop callback with a servlet)
> > >
> > > I looked at PigServer.executeBatch() and it seems to be waiting until
> job
> > > completes.This is not what I would like my app to do.
> > >
> > > Any ideas?
> > >
> > > Thanks,
> > >
> >
>