Open anovv opened 6 months ago
On-demand feature requests need to be properly distributed between workers.
We can utilize architecture similar to what Ray Serve uses: https://docs.ray.io/en/latest/serve/architecture.html
On-demand feature requests need to be properly distributed between workers.
We can utilize architecture similar to what Ray Serve uses: https://docs.ray.io/en/latest/serve/architecture.html