Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> A unique number for every task (map/reduce)


Copy link to this message
-
A unique number for every task (map/reduce)
Hello,
The name of a map task attempt is

attempt_201002092101_0063_m_N_X (N=1,.... # of map tasks)

and that of a reduce is

attempt_201002092101_0063_r_M_X where X is maybe 0,1,2 ..
(M =1 .... # o reduce tasks)

Thus during the map stage, the unique number is given by N or M.

Is there configuration variable so that I can get the name of this task file?
Then i can arrive at the components: date. job-number, task-#, task atempt #

Thank you
Saptarshi
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB