Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Sequence of Streaming Jobs


Copy link to this message
-
Re: Sequence of Streaming Jobs

see http://hadoop.apache.org/core/docs/current/api/org/apache/hadoop/mapred/jobcontrol/JobControl.html
- Sharad

Dan Milstein wrote:
>
> If I've got a sequence of streaming jobs, each of which depends on the
> output of the previous one, is there a good way to launch that
> sequence?  Meaning, I want step B to only start once step A has
> finished.
>
>  From within Java JobClient code, I can do submitJob/runJob, but is
> there any sort of clean way to do this for a sequence of streaming jobs?
>
> Thanks,
> -Dan Milstein

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB