Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Sequence of Streaming Jobs


Copy link to this message
-
Re: Sequence of Streaming Jobs
Sharad Agarwal 2009-05-04, 06:08

see http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/mapred/jobcontrol/JobControl.html
- Sharad

Dan Milstein wrote:
>
> If I've got a sequence of streaming jobs, each of which depends on the
> output of the previous one, is there a good way to launch that
> sequence?  Meaning, I want step B to only start once step A has
> finished.
>
>  From within Java JobClient code, I can do submitJob/runJob, but is
> there any sort of clean way to do this for a sequence of streaming jobs?
>
> Thanks,
> -Dan Milstein