Remove the Databricks profiles from dbt-spark integration tests.
Acceptance Criteria
[ ] Profiles for databricks_sql_endpoint, databricks_sql_endpoint and databricks_http_cluster are removed from codebase
[ ] All decorators are updated to reflect the removal of above profiles
[ ] All tests that should be removed are fully removed
Details
This is a bit complex since tests are tagged to be skipped, not to be run. The tests that need to be fully removed are the ones that have the following decorator:
High Level Task
Remove the Databricks profiles from
dbt-spark
integration tests.Acceptance Criteria
databricks_sql_endpoint
,databricks_sql_endpoint
anddatabricks_http_cluster
are removed from codebaseDetails
This is a bit complex since tests are tagged to be skipped, not to be run. The tests that need to be fully removed are the ones that have the following decorator:
If the decorator contains
databricks_sql_endpoint
,databricks_sql_endpoint
ordatabricks_http_cluster
the decorator just need to be modified.conftest.py also needs to be modified to remove the databricks profiles.
Additional Notes
Since we will be removing the Databricks profiles in the GitHub Action, this will be dead code but the tests will continue to work.