Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Cleanup after a Job


+
kasi subrahmanyam 2012-04-26, 11:14
Copy link to this message
-
Re: Cleanup after a Job
Use OutputCommitter.(abortJob, commitJob):
http://hadoop.apache.org/common/docs/r1.0.2/api/org/apache/hadoop/mapred/OutputCommitter.html

Arun

On Apr 26, 2012, at 4:44 PM, kasi subrahmanyam wrote:

> Hi
>
> I have few jobs added to a Job controller .
> I need a afterJob() to be executed after the completion of s Job.
> For example
>
> Here i am actually overriding the Job of JobControl.
> I have Job2 depending on the output of Job1.This input for Job2is obtained after doing some File System operations on the output of the Job1.This operation should happen in a afterJob( ) method while is available for each Job.How do i make sure that afterJob () method is called for each Job added to the controller before running the jobs that are depending on it.
>
>
> Thanks

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
+
kasi subrahmanyam 2012-05-01, 13:32
+
Robert Evans 2012-05-01, 14:06
+
kasi subrahmanyam 2012-05-01, 14:17
+
Robert Evans 2012-05-01, 15:06
+
Harsh J 2012-04-29, 12:12
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB