The task was stuck, but when marking it as successful, it continues to run the remaining part of the job. about airflow HOT 2 CLOSED

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

from airflow.

Likely you need to implement proper on_kill implementation that will perform cleanup. It's speciic to the operator you are running, if you are implementing in task flow , I do not think there is a way to create on_kill for such decorated task so that would be a new feature to add. Simple workaround to it is to write your own custom operator and use it instead of task flow decorated method (and implement on_kill there). I convert this one into discussion if needed. But those are basically two ways to address it:

• add PR proposing how to add on_kill to decorated task (new feature)
• or convert your task to classic operator and implement on_kill

from airflow.