Package still maintained? Alternatives?

uber / fiber

Distributed Computing for AI Made Simple

https://uber.github.io/fiber/

Apache License 2.0

1.04k stars 110 forks source link

Package still maintained? Alternatives? #62

Open ynouri opened 2 years ago

ynouri commented 2 years ago

Hi Uber / Fiber team,

We really like your minimalist approach to distribute Python workloads using K8s / Multiprocessing API. However the package's last commit is from 2021. I assume fiber is not maintained / used in production anymore?

Curious if anybody in the community is still using this and if not, what alternatives they found.

Thank you!

sakmalh commented 1 year ago

Heyy ynourl. Did you find any alternatives or implement Fiber? Please let me know. Thanks

ynouri commented 1 year ago

We haven't implemented Fiber or any alternatives.

I liked the lighweight approach of Fiber. But if you have resources to run a Dask or Ray cluster on top of K8s, you might have viable Python first alternatives there.

For example Ray supports the multiprocessing API too: https://docs.ray.io/en/latest/ray-more-libs/multiprocessing.html