Merging 1.9.latest to main (Since 1.9.0 will be out in a couple of weeks).

[benc-db]

Description

Merges all changes from the 1.9.latest branch (i.e. 1.9.0b1) to main, in prep for 1.9 becoming main development version.

Checklist

• [x] I have run this code in development and it appears to resolve the stated issue
• [x] This PR includes tests, or tests are not required/relevant for this PR
• [ ] I have updated the CHANGELOG.md and added information about my change to the "dbt-databricks next" section.