Open asears opened 3 years ago
In order to support later features such as Databricks Delta, and be compatible with long term support, the cluster should be upgraded. Upgrade the new job cluster script or provide an option to select cluster version as part of the execution?
https://github.com/microsoft/azdo-databricks/blob/master/tasks/ExecuteNotebook/ExecuteNotebookV1/job-configuration/new-cluster.json
https://docs.databricks.com/release-notes/runtime/releases.html
6.4 should have Delta features.
In order to support later features such as Databricks Delta, and be compatible with long term support, the cluster should be upgraded. Upgrade the new job cluster script or provide an option to select cluster version as part of the execution?
https://github.com/microsoft/azdo-databricks/blob/master/tasks/ExecuteNotebook/ExecuteNotebookV1/job-configuration/new-cluster.json
https://docs.databricks.com/release-notes/runtime/releases.html
6.4 should have Delta features.