Multi-model session cpu and gpu support?

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application

4 stars 3 forks source link

Multi-model session cpu and gpu support? #41

Open shaunaa126 opened 3 months ago

shaunaa126 commented 3 months ago

Right now multi-model sessions are limited to only support full GPU offload. Any plans for supporting CPU offload so that we are able to run multiple models that uses VRAM across CPU and GPU?