Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> When is configure and close run


Copy link to this message
-
When is configure and close run
Hello,
In a mapreduce job, a given map JVM will run N map tasks. Are the
configure and close methods executed for every one of these N tasks?
Or is configure executed once when the JVM starts and the close method
executed once when all N have been completed?

I have the same question for the reduce task. Will it be run before
for every reduce task? And close is run when all the values for a
given key have been processed?

We can assume there isn't a combiner.

Regards
Saptarshi
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB