search

Factual / drake

Data workflow tool, like a "Make for data"
Other
1.48k stars 110 forks source link

I love(d) Drake, but it's not really maintained anymore are there other good alternatives? #233

Open jtzemp opened 4 years ago

jtzemp commented 4 years ago

I used Drake several years ago and really liked it. I loved the paradigm, using the CLI, the readability of the drakefile, etc. I didn't need it for a while, but came back to it recently and see that it hasn't been updated in several years. It won't compile on my machine with a recent Java. I can totally work around the issue, but it made me wonder what y'all are using if not Drake.

Is there a different tool that's similar that is being maintained (whether open source or commercial)?

mpettis commented 4 years ago

Here's a link with a collected, curated list of them: https://github.com/pditommaso/awesome-pipeline

I'm using the R package {drake} (ironically unrelated to this drake, which I used when it was active), but there are tons of choices in the language of your preference, probably. Good luck!

nfultz commented 4 years ago

For small projects (eg that don't need hadoop) I've just been using make. airflow is pretty commonly used now but is a lot heavier than drake was :(

epogrebnyak commented 1 year ago

Maybe https://www.prefect.io/ ?

nfultz commented 1 year ago

dbt is also getting pretty popular, but it is too YAMLy for my tastes.

epogrebnyak commented 1 year ago

YAMLy is my word of the month now ) great term!

nihilee commented 7 months ago

awesome library ... I loved Drake's cljfrontend ...