snjypl / airflow-provider-grafana-loki

Airflow Provider plugin for writing and reading task logs to and from Grafana Loki
Apache License 2.0
24 stars 4 forks source link

fix memory leak in case of connection problems #15

Open alekseikuzetsov opened 10 months ago

alekseikuzetsov commented 10 months ago

I encountered memory leak as can be seen on this screenshot https://stackoverflow.com/questions/67620177/airflow-2-0-issues-too-many-airflow-supervisor-tasks. It turned out that in case of connection problems, if the log cant be pushed, the task hangs silently. Catching exception fixes the problem.