Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Async job submission via PigServer


Copy link to this message
-
Re: Async job submission via PigServer
There is no asynchronous API for Pig. However, Pig does have a
notification mechanism (See PigRunner.run), you can create a separate
thread to simulate the asynchronous call.

Daniel

On Fri, Feb 3, 2012 at 12:34 AM, Michael Lok <[EMAIL PROTECTED]> wrote:
> Hi folks,
>
> I was wondering if it's possible to submit register and run a script
> using PigServer in MAPREDUCE mode in an asynchronous manner; compared
> to how a script is executed right now whereby the program is made to
> wait till the job is finished.  Although the task is still executed in
> the server, I can't programmatically retrieve the job id for future
> reference.
>
>
> Any help is greatly appreciated.
>
>
> Thanks.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB