Closed tatiana closed 1 year ago
Patch coverage: 74.07
% and project coverage change: +0.14
:tada:
Comparison is base (
5eefd91
) 78.32% compared to head (401ed6a
) 78.47%.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.
Allow the argument
notebook_params
of theDatabricksNotebookOperator
to be templated using Jinja. Rendered the attribute before sending it to the Databricks API.Improve logging and sharing the Databricks API job Xcom across jobs.
Limitation: templating may not work as expected in Airflow 2.3, but it works on Airflow 2.2.5, Airflow 2.4 and Airflow 2.5.
Example of how a Databricks workflow generated using the DAG
example_databricks_workflow
looks like in their interface (the parameter "ds", passed to the notebook, and "ts", passed to the task group, are resolved to the current datetime timestamp):Closes: #32