Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Questions with regard to scheduling of map and reduce tasks


+
Vasco Visser 2012-08-30, 17:41
+
Vinod Kumar Vavilapalli 2012-08-30, 18:19
+
Vasco Visser 2012-08-30, 23:38
+
祝美祺 2012-08-31, 02:07
+
Vinod Kumar Vavilapalli 2012-08-31, 03:51
+
Vasco Visser 2012-08-31, 11:17
+
Vinod Kumar Vavilapalli 2012-08-31, 22:59
Copy link to this message
-
Re: Questions with regard to scheduling of map and reduce tasks
Vasco Visser 2012-09-02, 16:41
I am now running 2.1.0 branch where the fifo starvation is solved. FYI
the behavior of task scheduling in this branch is as follows. It
begins with all containers scheduled to mappers. Pretty quickly
reducers are starting to be scheduled. From time to time more
containers are given to reducers, until about 50% of available
containers are reducers. It stays 50-50 until all mappers are
scheduled. Only then the proportion of containers allocated to
reducers is increased to > 50%.