Can I get my gearboxes (copy phase) to start only when all the cartographers are finished

Question

I have work with a team with a rather long phase, and I want other short tasks to be performed in priority order. To do this, I set the priority of my long work using job_id-priority job_id LOW.

The problem is that for my long work the phase of copying gearboxes begins, even if only 30% of my tasks on the map are completed.

My grid is then clouded, as all the lower slots are taken on LOW priority. Other small jobs can carry out their card phases, but they will never get any gear until my long work is completed.

Any idea? Thank you J.

Answer 1

I found the answer to my question: there is a conf conf parameter of the task that performs the task:

mapred.reduce.slowstart.completed.maps = 0.90

reduction tasks begin only after completion of 90% of the cards. The default value is 0.05.