search

Datavault-UK / automate-dv

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)
https://www.automate-dv.com
Apache License 2.0
511 stars 131 forks source link

[FEATURE] Redshift Support #86

Open iklose opened 2 years ago

iklose commented 2 years ago

Hello,

I would like to evaluate dbtvault in a AWS Redshift environment. Since Redshift support is part of the roadmap, I was wondering if you already have a some idea of what is necessary to get dbtvault to run on Redshift or maybe already started working on this.

Depending on the effort, we might be able to help reach the support of AWS Redshift.

Best regards, Ingo

AB#5377

DVAlexHiggs commented 2 years ago

Hi Ingo. Our next official platform support candidates are Big Query and SQLServer, and these are both in active development. We haven't yet investigated Redshift support. As far as I am aware Postgres and Redshift are very similar and we are planning to develop Redshift and Postgres side-by-side, but this will be Q2 2022.

In terms of contributing, we do not yet have a clear/easy contribution guideline for our community, which we are working on solving. This is because we have a large and comprehensive test suite with entirely custom execution requirements and it will require some setup and learning from the contributors side. We're looking to really nail down and simplify the process so that contributing is as straightforward as possible.

We will likely be trialling a contribution approach early next year once we have completed internal discussions on the subject and you would be a great candidate for this. Let me know if you are interested. Thanks so much for your interest!

kal1f commented 2 years ago

Hi there

Any updates about Redshift support?

DVAlexHiggs commented 2 years ago

Redshift, Postgres and Databricks are next on our list of platforms to support. No ETA just yet.

vanducng commented 2 years ago

Hope the team start looking at it soon.

kristofmartens commented 2 years ago

Hi there, very interested in this as well. Willing to help to speed up the development if needed.

mrcool4 commented 2 years ago

Hi, We would like to use dbtvault with Redshift. Any update on the ETA?

mrcool4 commented 2 years ago

@DVAlexHiggs - Any update on this feature would be highly appreciated. Thanks.

mrcool4 commented 1 year ago

Hello team, I appreciate the excellent work you have been doing. Could you kindly provide us with an update on the status of this particular feature? If Redshift is not being considered as an option, please inform us so that we can explore other alternatives. Thank you.

DVAlexHiggs commented 1 year ago

Hi! We appreciate there is a lot of interest in this. Redshift support is still on the roadmap!

At the moment the priority is bug fixes for the platforms we currently support. We are a small team and also a consultancy ourselves, so we do have to distribute our time carefully.

Any contributions from the community are welcome and we are happy to collaborate on getting it integrated with our test suite.

husanpy commented 1 year ago

Hi! Any updates on Redshift?

How can I help and contribute to accelerate the project?

DVJocelynShannon commented 1 year ago

Hi, we now have a team actively working on Redshift support so we will get an ETA as soon as we can!

Thank you for your patience!

anischakow commented 1 year ago

Hi, at the moment we are thinking about introducing dbt in our company. Since we are currently using Amazon Redshift, possible support from automateDV for Redshift would not be an insignificant decision factor. Is there possibly a first concrete release timeframe?

misteliy commented 1 year ago

Any updates?

AJB4 commented 11 months ago

Is there a revised ETA on a release that will support redshift?

DVAlexHiggs commented 11 months ago

Hi! First of all, apologies for the lack of updates - that's on us. It's been a busy few months! We are currently collaborating with an external organisation to bring Redshift support to AutomateDV and we're making steady progress. A rough estimate looks like the latter half of Q1 2024 or early Q2.

Thank you for your patience! We are very aware how eager the community is for Redshift and we are doing what we can to get it to you all as soon as we can 😄

misteliy commented 7 months ago

any updates?

DVAlexHiggs commented 5 months ago

any updates?

Unfortunately we have had to pause development on this, however we will be restarting again soon. I'm sorry it's not better news. We are highly aware this is something the community wants and it has been a long time coming. We are still committed to getting it to you as soon as we can.

Thanks for your patience.

misteliy commented 3 months ago

Can you give some rough estimates?