search

eth-easl / orion

An interference-aware scheduler for fine-grained GPU sharing
MIT License
78 stars 12 forks source link

Support for Orion to support 2+ clients (especially for inference workloads) #25

Closed aravindhank11 closed 4 months ago

aravindhank11 commented 5 months ago

As discussed in https://github.com/eth-easl/orion/issues/24, opening this issue to track Orion's ability to handle multiple clients.

fotstrt commented 4 months ago

@aravindhank11 I am closing this issue after merging some fixes for multi-client setups. The mult-client configuration files are structured similarly to the 2-client ones (i.e. the high-priority job is the last one in the configuration file). I added an example here.

aravindhank11 commented 4 months ago

Thank you!