Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Selecting a task for the tasktracker


Copy link to this message
-
Selecting a task for the tasktracker
Yaron Gonen 2012-12-27, 10:40
Hi,
If I understand correctly, the job scheduler (why is the class called
TaskScheduler?) is responsible for assigning the task whose split is as
close as possible to the tasktacker.
Meaning that the job scheduler is responsible to two things:

   1. Selecting a job.
   2. Once a job is selected, assign the closest task to the tasktracker
   that send the heartbeat.

Is this correct?

I want to write my own job scheduler to change the logic above, but it says The
type TaskScheduler is not visible.
How can I write my own scheduler?

thanks