Switch tasks from run state to queue and back

Question

We observe this strange behavior with some jobs on the pbs and maui torque: some jobs switch between (R) unning and (Q) ueued. I tried to walk around and did not find any hints. What could be the reason? It should be noted that jobs are different in nature: some use TensorFlow and python, others use C ++ executables.

Answer 1

Not enough here to say, but I would suggest that they do not work. The pbs_mom and syslogs logs should give hints.