astronomer / astro-provider-databricks

Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows
Apache License 2.0
20 stars 10 forks source link

Update Databricks workflows in Airflow features comparison against Databricks UI features #81

Closed pankajkoti closed 1 month ago

pankajkoti commented 1 month ago

It appears that Databricks UI now supports retrying/repairing a single task from the UI. I verified this by trying to repair a single task for a job using the Databricks UI, and observed that this option is now available and working.

Additionally, they also have rolled out now (May 15, 2024) source control for workflows. https://docs.databricks.com/en/workflows/jobs/how-to/use-repos.html

This PR updates our documentation to update the same.

closes: https://github.com/astronomer/issues-airflow/issues/773