mozilla / opmon

Operational Monitoring (OpMon) đŸ“ˆ
Mozilla Public License 2.0
7 stars 5 forks source link

operational_monitoring Airflow task should have probe_scraper.lookml_generator as downstream dependency #154

Open scholtzan opened 1 year ago

scholtzan commented 1 year ago

Looker dashboards should get generated after opmon has run in Airflow. Currently, there is no explicit downstream dependency, so in some cases lookml_generator runs before opmon has finished. It probably makes sense to make the downstream dependency explicit. However, we don't want to block lookml_generator on opmon failures, so we need to configure the dependency so that also upstream failures will trigger downstream runs.

┆Issue is synchronized with this Jira Task