eth-easl / orion

An interference-aware scheduler for fine-grained GPU sharing
MIT License
79 stars 12 forks source link

MPS setup and a series of improvements #8

Closed XianzheMa closed 1 year ago

XianzheMa commented 1 year ago

This PR includes the setup for MPS and a series of improvements to facilitate evaluation on temporal sharing and tick-tock.

Due to the large PR size, I recommend first taking look at the changes of the last commit, which really relate to MPS setup. All other changes are made during evaluation on temporal sharing and tick-tock to facilitate benchmarking.