ScalefreeCOM / datavault4dbt

Scalefree's dbt package for a Data Vault 2.0 implementation congruent to the original Data Vault 2.0 definition by Dan Linstedt including the Staging Area, DV2.0 main entities, PITs and Snapshot Tables.
https://www.scalefree.com/
Apache License 2.0
141 stars 27 forks source link

Staging correct data type with precision in Redshift #227

Closed MatheHostel closed 2 months ago

MatheHostel commented 3 months ago

Putting data_type from column into ghost record macro, which returns the precision in Redshift for example (NUMERIC(38,2)) Smallint and -1 / 0 unioned will deliver INT4 (INTEGER) which then creates datatype mismatches in satellites

Please check the modified ghost records in row "NUMERIC" and "INT" and for "GEOMETRY" also edited the "CHAR" line which combines all possible "CHAR* Datatypes as VARCHAR / CHARACTER VARYING / etc

thoffmann-sf commented 3 months ago

Hey MatheHostel, thanks for your input I've just added this changes to the redshift-patch branche. https://github.com/ScalefreeCOM/datavault4dbt/tree/redshift-patch. Appreciate your active contribution :)

Tim

MatheHostel commented 3 months ago

Modified the Geometry Ghost Record. The "SRID" modification is not usable to all users so we decided to remove it and put in the single point to northpole. That should work for all redshift-users

MatheHostel commented 2 months ago

Is already part from Dev