Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Force the number of map tasks in MR?

Copy link to this message
Force the number of map tasks in MR?

Is there a way to force the number of map tasks in a MR?

I have a 25 regions table splitted over 6 nodes. But the MR is running
the tasks only 2 by 2.

Is there a way to force it to run one task on each regionserver
serving at least one region? Why is the MR waiting for 2 taskes to
complete before sending to the other tasks?

I'm starting the MR with a caching of 100.

I tried mapred.map.tasks and speculative=false with no success.

Any idea how I can increase it this number of tasks?


Kevin Odell 2012-10-11, 20:23
Jean-Marc Spaggiari 2012-10-11, 20:25
Kevin Odell 2012-10-11, 20:36
Jean-Marc Spaggiari 2012-10-11, 20:44
Jonathan Bishop 2012-10-11, 20:50
Bryan Beaudreault 2012-10-12, 01:10
Jean-Marc Spaggiari 2012-10-12, 01:45
Kevin Odell 2012-10-11, 20:48