fix spark cluster start mechanism and add extra dev requirements

dbt-labs / dbt-spark

dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks

https://getdbt.com

Apache License 2.0

395 stars 221 forks source link

fix spark cluster start mechanism and add extra dev requirements #986

Closed colin-rogers-dbt closed 7 months ago

colin-rogers-dbt commented 7 months ago

resolves # docs dbt-labs/docs.getdbt.com/#

Problem

Solution

Checklist

[ ] I have read the contributing guide and understand what's expected of me
[ ] I have run this code in development and it appears to resolve the stated issue
[ ] This PR includes tests, or tests are not required/relevant for this PR
[ ] This PR has no interface changes (e.g. macros, cli, logs, json artifacts, config files, adapter interface, etc) or this PR has already received feedback and approval from Product or DX

github-actions[bot] commented 7 months ago

Thank you for your pull request! We could not find a changelog entry for this change. For details on how to document a change, see the dbt-spark contributing guide.

mikealfare commented 7 months ago

Since we're on GHA with this now, should we remove the CircleCI Pipeline check?

colin-rogers-dbt commented 7 months ago

Since we're on GHA with this now, should we remove the CircleCI Pipeline check?

I thought we had but it seems to keep coming back