Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - When is configure and close run


Copy link to this message
-
When is configure and close run
Saptarshi Guha 2009-06-22, 16:23
Hello,
In a mapreduce job, a given map JVM will run N map tasks. Are the
configure and close methods executed for every one of these N tasks?
Or is configure executed once when the JVM starts and the close method
executed once when all N have been completed?

I have the same question for the reduce task. Will it be run before
for every reduce task? And close is run when all the values for a
given key have been processed?

We can assume there isn't a combiner.

Regards
Saptarshi