Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Run a job async


Copy link to this message
-
Re: Run a job async
Thousands of requests, or thousands of Pig jobs? Or both?
2013/1/23 Prashant Kommireddi <[EMAIL PROTECTED]>

> Did not want to have several threads launched for this. We might have
> thousands of requests coming in, and the app is doing a lot more than only
> Pig.
>
> On Wed, Jan 23, 2013 at 5:44 PM, Jonathan Coveney <[EMAIL PROTECTED]
> >wrote:
>
> > start a separate Process which runs Pig?
> >
> >
> > 2013/1/23 Prashant Kommireddi <[EMAIL PROTECTED]>
> >
> > > Hey guys,
> > >
> > > I am trying to do the following:
> > >
> > >    1. Launch a pig job asynchronously via Java program
> > >    2. Get a notification once the job is complete (something similar to
> > >    Hadoop callback with a servlet)
> > >
> > > I looked at PigServer.executeBatch() and it seems to be waiting until
> job
> > > completes.This is not what I would like my app to do.
> > >
> > > Any ideas?
> > >
> > > Thanks,
> > >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB