I am trying to change the mapping of partitions to workers in
int maxWorkers) defined
The first argument to this method is the list of available workers and each
worker has a task id associated with it.
When I am specifying the number of workers as 40, the task id are 1 to 40.
I have removed one node from the yarn-cluster by following this answerhttps://stackoverflow.com/questions/41820759/how-to-separately-specify-a-set-of-nodes-for-hdfs-and-others-for-mapreduce-jobs
After this change, the task ids assigned to the workers are no longer
consecutive (e.g. for 40 workers the range of task id is 1- 43). Some
task-ids are excluded.
Is there any way to get these task ids strictly consecutive?