Support for Microsoft SQL server as database

MarquezProject / marquez

Collect, aggregate, and visualize a data ecosystem's metadata

https://marquezproject.ai

Apache License 2.0

1.72k stars 305 forks source link

Support for Microsoft SQL server as database #2390

Open avinashpancham opened 1 year ago

avinashpancham commented 1 year ago

For a project I would like to deploy Marquez with a Microsoft SQL Server backend database instead of the PostgreSQL backend database. Would this be possible without me editing the source code?

The requirements mention to use at least PostgreSQL 12.1 and based on https://github.com/MarquezProject/marquez/issues/2075 it looks like the queries rely on PostgreSQL specific features (which are not in T-SQL). So I am afraid that it is not possible, but I am open to any feedback on this that says otherwise!

Thanks!

boring-cyborg[bot] commented 1 year ago

Thanks for opening your first issue in the Marquez project! Please be sure to follow the issue template!

pawel-big-lebowski commented 1 year ago

Hi @avinashpancham, does Microsoft SQL Server support ON CONFLICT DO UPDATE clause? I know it did not some time ago (https://michaeljswart.com/2017/07/sql-server-upsert-patterns-and-antipatterns/) but not sure how is it now?

Marquez uses ON CONFLICT DO UPDATE a lot (for most insert into tables I think) and replacing this with anything else may be a tedious task.