The running ansible process received a shutdown signal. about awx HOT 4 OPEN

Random crashes with message The running ansible process received a shutdown signal.

where are u seeing this? please provide some context

currently we do not have enough information to understand what is happening here.

from awx.

AWX Template fails with that message. Time is random, mostly between 7-12mins of job running, I can see it happens with a jobs what are doing changes on multiple hosts (patching, VM customization etc.).

Unfortunately awx-task logs do not show anything helpful, just a message job/workflow failed.
Workflow job 18542 failed due to reason: No error handling path for workflow job node(s) [(26156,failed)]. Workflow job node(s) missing unified job template and error handling path [].

Cluster is running on k8s with setup of 2 Control planes and 4 worker nodes, where maximum CPU and Memory usage based on command kubectl top node is around 20%/80% (CPU/MEM) and all nodes have at least 40% free disk space.

AWX database is running on external Postgres server.

from awx.

Attaching logs from automation pod what failed in the middle. Absolutely no info what is happening, not from awx-task, awx-web nor automation pod. Any suggestion what to look for?
task3.log

AWX is really needed for us, we are using it for managing, deploying, patching etc. on daily basis, it is running at least 50 templates a day and I cannot be permanently connected on it to check if it's still working.
We have another instance on production environment, where we still run 23.3.1 what is running properly, but unfortunately downgrade is not working anymore, it cannot use upgraded database.

from awx.

Another update, issue is not version related, I was able to downgrade AWX with to version 23.8.1 (what should not have such problems).
Issue is not even with database, where I used both actual and older postgres from before migration.
Sometimes it fails in 5min, sometimes job run for almost 1h.

from awx.