brooklyn-data / dbt_artifacts

A dbt package for modelling dbt metadata. https://brooklyn-data.github.io/dbt_artifacts
Apache License 2.0
320 stars 118 forks source link

[Bug]: Object of type date is not JSON serializable (Databricks) #442

Open alvawinsa opened 3 weeks ago

alvawinsa commented 3 weeks ago

Overview

The on run end we are running to upload dbt_artifacts in all our jobs are failing on the upload sources command with the error "Object of type date is not JSON serializable". This is causing all our jobs to fail.

How to reproduce

We are using dbt cloud with

Running on the Databricks connection.

  1. In our dbt_project file we have the following:

on-run-end:

In our jobs we then have a --vars '{"run_post_hook": "on"}' in the command. This has been working fine for 6+ months. The failures started four days ago (with no code changes made by us).

Expected behaviour

I expect this:

0:02:04 Uploading model executions 00:02:04 Uploading seed executions 00:02:04 Uploading test executions 00:02:04 Uploading snapshot executions 00:02:08 Uploading exposures 00:02:10 Uploading seeds 00:02:13 Uploading snapshots 00:02:15 Uploading invocations dbt command failed00:02:18 Uploading sources 00:02:20 Uploading tests 00:02:20 Database error while running on-run-end

To also Upload source successfully.

Screenshots

Nothing that can contribute anything else.

Environment

Results of running dbt --version: versionless

# Add the results here

Please paste the contents of your packages.yml file here:

packages:

alvawinsa commented 1 week ago

Upgraded to latest version 2.6.4 did not solve this issue