Azure / data-landing-zone

Template to deploy a single Data Landing Zone of the Data Management & Analytics Scenario (former Enterprise-Scale Analytics). The Data Landing Zone is a logical construct and a unit of scale in the architecture that enables data retention and execution of data workloads for generating insights and value with data.
MIT License
164 stars 66 forks source link

Databricks automation #14

Open marvinbuss opened 3 years ago

marvinbuss commented 3 years ago

Automate the end to end setup process of a Databricks workspace on Azure with:

  1. Application logging,
  2. Cluster policies,
  3. Hive metastore setup,
  4. SCIM Enterprise Application setup
marvinbuss commented 3 years ago

This issue is blocked:

  1. Automation with Key Vault is currently blocked because of the following issue: https://github.com/databricks/databricks-cli/issues/338.
  2. Th SCIM setup is blocked because not all APIs can used with a registered Application.
marvinbuss commented 3 years ago

SCIM is now unblocked. Automation for this is still pending.