search

run-ai / genv

GPU environment and cluster management with LLM support
https://www.genv.dev
GNU Affero General Public License v3.0
445 stars 19 forks source link

[feature request] Split computing power? #64

Open incomingflyingbrick opened 1 month ago

incomingflyingbrick commented 1 month ago

Hello genv dev team, Is it possible to add a function to split the gpu utilization as well? For example if I share my GPU to my friend, and I would like to limit his GPU utilization to 50%, so there is some GPU utilization left for myself.

razrotenberg commented 1 month ago

hi @incomingflyingbrick . so unfortunately this is not possible with Genv.

Genv is as an environment management and as such, it can manipulate the shell, control environment variables, install shims, etc. these capabilities, however, are not enough to do what you asked for as this requires more cooperation with the NVIDIA driver.