Avoid indefinite blocking when tasks executed via ansible hang. about ovn-heater HOT 2 OPEN

CC: @igsilya

from ovn-heater.

It happened again. What I ca see is that we have a zombie process in the container and conmon doesn't reap it. While stopping the container we hit the Error: cannot remove container d9f655ac066b5af3f4c2df875e897207d027e5a5db2c900d958fdf176b4ec4cf as it could not be stopped: given PIDs did not die within timeout. This is likely triggering SIGKILL that kills parents and they have no chance to wait for a child, causing a PID 1 problem essentially.

# pstree -t -l
systemd(1)-+-...
           |-conmon(2611836)-+-bash(2611847)
           |                 `-{conmon}(2611838)


# ps -aux | grep 2611847
root     2611847  0.4  0.0      0     0 ?        Zs   11:59   0:30 [bash] <defunct>

Not sure what is triggering the timeout in the first place, since 10 seconds (default) should be enough in general.

from ovn-heater.