adding compute field to the Config

[alexkh-db]

Changes

We are currently adding serverless support to Databricks Connect client. Serverless can be enabled in the client using DatabricksSession.builder.serverless(). We also want to add support for serverless in the databricks config.

• We propose adding a new compute attribute in the config that will be new unifying field that can contain values "serverless" or "cluster:<cluster_id>". cluster_id will be deprecated but still supported after this change. We could add support for warehouse_id in the compute field as well if necessary.
• compute and cluster_id should be mutually exclusive, if both are specified as kwargs, env variables or fields in .databrickscfg, an error will be thrown.
• get_compute method returns a Compute object that parses .compute and .cluster_id fields and provides convinient is_empty(), is_serverless(), and get_cluster_id() methods.

Tests

• [x] make test run locally
• [x] make fmt applied
• [ ] relevant integration tests applied

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 48.71795% with 20 lines in your changes are missing coverage. Please review.

Project coverage is 57.66%. Comparing base (a714146) to head (b95d3c4).

Files	Patch %	Lines
databricks/sdk/config.py	48.71%	20 Missing :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #666 +/- ## ========================================== - Coverage 57.67% 57.66% -0.02% ========================================== Files 48 48 Lines 32979 33018 +39 ========================================== + Hits 19020 19039 +19 - Misses 13959 13979 +20 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.