search

quantile-development / dagster-meltano

A Dagster plugin that allows you to run Meltano in Dagster
MIT License
42 stars 17 forks source link

added a meltano elt solid and unit tests #4

Closed jlloyd-widen closed 2 years ago

jlloyd-widen commented 2 years ago

Added a solid for Meltano ELT runs. This better fits the use case where you don't know the elt command (or the env vars) at the time of code compilation. This is how I typically use meltano in my dagster environment. The configuration of my env variables var depending on the execution so I have to pass them in from upstream solids. I also added some unit tests for this and refactored naming conventions in order to provide clarity. But this can all be debated. I'm not strongly tied to my naming conventions.

jlloyd-widen commented 2 years ago

Better method was discovered