Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - A unique number for every task (map/reduce)


Copy link to this message
-
A unique number for every task (map/reduce)
Saptarshi Guha 2010-02-12, 17:07
Hello,
The name of a map task attempt is

attempt_201002092101_0063_m_N_X (N=1,.... # of map tasks)

and that of a reduce is

attempt_201002092101_0063_r_M_X where X is maybe 0,1,2 ..
(M =1 .... # o reduce tasks)

Thus during the map stage, the unique number is given by N or M.

Is there configuration variable so that I can get the name of this task file?
Then i can arrive at the components: date. job-number, task-#, task atempt #

Thank you
Saptarshi