Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # dev >> Straggler map tasks

Samaneh Shokuhi 2012-11-25, 22:18
Copy link to this message
Re: Straggler map tasks

Yes, you should look at JobInProgress class, and search for 'speculative'. JobTracker already has logic to launch speculative copies for tasks which are progressing at a degraded rate relative to other tasks.

+Vinod Kumar Vavilapalli
Hortonworks Inc.

On Nov 25, 2012, at 2:18 PM, Samaneh Shokuhi wrote:

> Hi ,
> I need to detect the straggler map tasks specifically the last one to do
> some experiments .As i undestood job tracker is aware of all map tasks ,so
> is there any way to know the current  running map task is the
> last(straggler)  one  ?
> Samaneh