search

ScalefreeCOM / datavault4dbt

Scalefree's dbt package for a Data Vault 2.0 implementation congruent to the original Data Vault 2.0 definition by Dan Linstedt including the Staging Area, DV2.0 main entities, PITs and Snapshot Tables.
https://www.scalefree.com/
Apache License 2.0
143 stars 27 forks source link

improve handling of the various timestamp formats in snowflake ghost records #279

Closed tkiehn closed 3 weeks ago

tkiehn commented 4 weeks ago

Description

improve handling of the various timestamp formats in snowflake ghost records also improve numeric data type handling for ghost records

remoteworkflow[bot] commented 4 weeks ago

Link to workflow summary: https://github.com/ScalefreeCOM/datavault4dbt-ci-cd/actions/runs/11515494813

RESULTS for Synapse: :white_check_mark: dbt-tests
:white_check_mark: dbt-macro-tests

RESULTS for Postgres: :white_check_mark: dbt-tests :white_check_mark: dbt-macro-tests

RESULTS for BigQuery: :white_check_mark: dbt-tests :white_check_mark: dbt-macro-tests

RESULTS for Redshift: :white_check_mark: dbt-tests :white_check_mark: dbt-macro-tests

RESULTS for Snowflake: :white_check_mark: dbt-tests :white_check_mark: dbt-macro-tests

RESULTS for Exasol: :x: dbt-tests :white_check_mark: dbt-macro-tests

RESULTS for Fabric: :white_check_mark: dbt-tests :white_check_mark: dbt-macro-tests

RESULTS for Oracle: :white_check_mark: dbt-tests :white_check_mark: dbt-macro-tests

RESULTS for Databricks: :white_check_mark: dbt-tests :white_check_mark: dbt-macro-tests

tkiehn commented 3 weeks ago

@JPLangner just notified me that after the clocks were set one hour behind this weekend there are 2 rows for ghostrecords with different offsets.

We have to figure out how to handle this nicely, if at all

tkirschke commented 3 weeks ago

@JPLangner just notified me that after the clocks were set one hour behind this weekend there are 2 rows for ghostrecords with different offsets.

We have to figure out how to handle this nicely, if at all

Please create new Issue for that