search

databricks / cli

Databricks CLI
Other
148 stars 56 forks source link

Fixed variable override in target with full variable syntax #1749

Closed andrewnester closed 2 months ago

andrewnester commented 2 months ago

Changes

This PR makes sure that both of this override syntax for variables work correctly

targets:
  dev:
    variables:
      cluster1:
        spark_version: "14.2.x-scala2.11"
        node_type_id: "Standard_DS3_v2"
        num_workers: 4
        spark_conf:
          spark.speculation: false
          spark.databricks.delta.retentionDurationCheck.enabled: false
      cluster2:
        default:
          spark_version: "14.2.x-scala2.11"
          node_type_id: "Standard_DS3_v2"
          num_workers: 4
          spark_conf:
            spark.speculation: false
            spark.databricks.delta.retentionDurationCheck.enabled: false

Tests

Added regression test