When executing PythonOperators using our in-house StreamedOperator in a multi threaded way we discovered we have sometimes random failures due to "AttributeError: '_thread._local' object has no attribute 'callers' in ExecutorSafeguard" errors. This MR fixes this issue., unfortunately I couldn't write a test to reproduce it as this is a concurrency issue.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.
When executing PythonOperators using our in-house StreamedOperator in a multi threaded way we discovered we have sometimes random failures due to "AttributeError: '_thread._local' object has no attribute 'callers' in ExecutorSafeguard" errors. This MR fixes this issue., unfortunately I couldn't write a test to reproduce it as this is a concurrency issue.
^ Add meaningful description above Read the Pull Request Guidelines for more information. In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed. In case of a new dependency, check compliance with the ASF 3rd Party License Policy. In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in newsfragments.