search

man-group / mdf

Data-flow programming toolkit for Python
MIT License
169 stars 53 forks source link

still used/best choice #24

Open FalseProtagonist opened 7 years ago

FalseProtagonist commented 7 years ago

Just raising an issue to ask if this is still in use and still makes sense to use, sorry to bother

timkpaine commented 4 years ago

@FalseProtagonist if you're exploring other options, take a look at tributary. Both libraries work with the same ideas in mind (and probably the same underlying proprietary libraries as inspiration!). You can do some pretty cool things.

gesta81 commented 4 years ago

I have used dask custom graphs in combination with dask distributed dataframe transforms in recent projects. Limited DAG functionality, but you can easily scale and use same framework for distributed dataframes (if you need them) as well as your custom DAG...