dbt-labs / dbt-spark

dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
https://getdbt.com
Apache License 2.0
405 stars 227 forks source link

add tests for enforcing contracts for incremental materializations #685

Closed emmyoop closed 1 year ago

emmyoop commented 1 year ago

resolves https://github.com/dbt-labs/dbt-core/issues/7154

Description

Modifies tests to test incremental materializations

Checklist

gshank commented 1 year ago

There's an error in a logging event: [AdapterEventDebug]: Unable to parse dict {'name': 'Spark', 'base_msg': 'Getting table schema for relation {}', 'args': [], 'node_info': {}} because that "SparkRelation" argument can't be parsed.

gshank commented 1 year ago

Looks like this line in dbt/adapters/spark/impl.py: logger.debug("Getting table schema for relation {}", relation)

That "relation" should be stringified.