Datavault-UK / automate-dv

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
https://www.automate-dv.com
Apache License 2.0
478 stars 114 forks source link

[FEATURE] MS Fabric support #226

Open jx1226 opened 4 months ago

jx1226 commented 4 months ago

Hello greetings,

I would like to evaluate dbtvault in MS Fabric environment. I was wondering if you already have a some idea of what is necessary to get dbtvault to run on MS Fabric or maybe already started working on this.

Depending on the effort, glad be able to help reach the support of Ms Fabric.

Best regards

AB#5347

rudolf-sauer-mw commented 4 months ago

One idea could be to simply copy the dispatch logic from "sqlserver" and call it "fabric" and your good to go.

Here is one example "type_timestamp.sql"

{%- macro type_timestamp() -%} {{- return(adapter.dispatch('type_timestamp', 'automate_dv')()) -}} {%- endmacro -%}

{%- macro default__type_timestamp() -%} TIMESTAMP_NTZ {%- endmacro -%}

{%- macro sqlserver__type_timestamp() -%} DATETIME2 {%- endmacro -%}

{%- macro fabric__type_timestamp() -%} DATETIME2 {%- endmacro -%}

If you use this approach everything works fine - except the dbt model versions ( https://docs.getdbt.com/reference/resource-properties/versions )

mattiasthalen commented 2 months ago

This is what I'm doing

One idea could be to simply copy the dispatch logic from "sqlserver" and call it "fabric" and your good to go.

Here is one example "type_timestamp.sql"

{%- macro type_timestamp() -%} {{- return(adapter.dispatch('type_timestamp', 'automate_dv')()) -}} {%- endmacro -%}

{%- macro default__type_timestamp() -%} TIMESTAMP_NTZ {%- endmacro -%}

{%- macro sqlserver__type_timestamp() -%} DATETIME2 {%- endmacro -%}

{%- macro fabric__type_timestamp() -%} DATETIME2 {%- endmacro -%}

If you use this approach everything works fine - except the dbt model versions ( https://docs.getdbt.com/reference/resource-properties/versions )

That's how I do it

Edit: I went ahead and made a pull request: Add Fabric Support

DVAlexHiggs commented 1 month ago

Thank you for this request and sorry for the delayed response. MS Fabric and AWS Redshift are next on the roadmap for support.