Cluster policies on mapped tasks cause broken DAGs #37013
Labels
affected_version:2.8
Issues Reported for 2.8
area:core
area:dynamic-task-mapping
AIP-42
kind:bug
This is a clearly a bug
Apache Airflow version
2.8.1
What happened?
Defining a task policy that affects an operator in a mapped task causes a DAG Import Error.
How to reproduce
Consider the following Airflow Task Policy which changes the
execution_timeout
forBashOperators
to 30 seconds.If we then create the following DAG and run it, we can see that the task does indeed get killed after 30 seconds according to the policy.
However, if we introduce a dynamically mapped BashOperator task, then we are presented with the following error.
Operating System
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)" NAME="Debian GNU/Linux" VERSION_ID="11" VERSION="11 (bullseye)" VERSION_CODENAME=bullseye ID=debian HOME_URL="https://www.debian.org/" SUPPORT_URL="https://www.debian.org/support" BUG_REPORT_URL="https://bugs.debian.org/"
Deployment
Astronomer
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: