Describe the bug
When I try to run the demo, it fails during Databricks configuration. I've read the script and it seems to run the init script from dbfs, that is no longer supported in new environments.
To Reproduce
Steps to reproduce the behavior:
Run the demo in a new resource group.
Expected behavior
The demo should finis without problems.
Logs
2024-03-27 15:48:39 [INFO] begin databricks demo cluster creation
{"error_code":"FEATURE_DISABLED","message":"Init scripts cannot be loaded from DBFS. Review the init script documentation for more details on configuring init scripts.","details":[{"@type":"type.googleapis.com/google.rpc.ErrorInfo","reason":"CM_API_ERROR_SOURCE_CALLER_ERROR","domain":""}]}
Screenshots
Desktop (please complete the following information):
Describe the bug When I try to run the demo, it fails during Databricks configuration. I've read the script and it seems to run the init script from dbfs, that is no longer supported in new environments.
To Reproduce Steps to reproduce the behavior:
Expected behavior The demo should finis without problems.
Logs 2024-03-27 15:48:39 [INFO] begin databricks demo cluster creation {"error_code":"FEATURE_DISABLED","message":"Init scripts cannot be loaded from DBFS. Review the init script documentation for more details on configuring init scripts.","details":[{"@type":"type.googleapis.com/google.rpc.ErrorInfo","reason":"CM_API_ERROR_SOURCE_CALLER_ERROR","domain":""}]}
Screenshots![image](https://github.com/microsoft/Purview-ADB-Lineage-Solution-Accelerator/assets/10107118/75942405-ee74-45dc-89ea-549c6b9da309)
Desktop (please complete the following information):
Additional context Databricks documentation