is it possible to run fiber on Yarn?

uber / fiber

Distributed Computing for AI Made Simple

https://uber.github.io/fiber/

Apache License 2.0

1.04k stars 110 forks source link

is it possible to run fiber on Yarn? #31

Open floodsung opened 4 years ago

floodsung commented 4 years ago

I have a cluster based on YARN other then K8s， how to use Fiber on Yarn? thx

floodsung commented 4 years ago

it is very simple for ray to run on yarn

calio commented 4 years ago

Hi @floodsung, thanks for your question. Currently YARN is not supported yet. To make Fiber run on yarn, one can create a new backend for YARN which is very simple to do. Only a handful of functions needs to be implemented to get it working. One example is K8s backend. Would you be interested in contributing to this feature?