Distributed ML Model Training (Horizontal Scaling)

odahu / odahu-flow

Apache License 2.0

12 stars 2 forks source link

Open mcdoker18 opened 4 years ago

mcdoker18 commented 4 years ago

For now, we can only scale resources for model training vertically. We have to do research and determine how we can improve it. Sub tasks:

Create a list of frameworks which provide a way to distributed training:
1. Horovod
2. ...
Can we use the frameworks above with Mlflow?
Describe new training API or extent current API.
Develop the MVP with distributed training.

alinaignatiuk commented 2 years ago

WPM request: Implement flexible horizontal auto-scaling based on CPU/memory, not only on count of requests

Right now we have fixed min/max number for CPU/memory for certain machine