search

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
2 stars 2 forks source link

GPU Offload is inactive in version 0.2.25, but I can select it in 0.2.24 #40

Closed rsvr88 closed 4 days ago

rsvr88 commented 1 week ago

GPU Offload is inactive in version 0.2.25, but I can select it in 0.2.24 vicuna-13b-v1.5.Q5_K_M AMD RX 6600 XT

YorkieDev commented 1 week ago

Hi @rsvr88 due to OpenCL being deprecated in the version of llama.cpp uses in LM Studio, you have to manually add OpenCL support by following the instructions here:

https://github.com/lmstudio-ai/configs/blob/main/Extension-Pack-Instructions.md

rsvr88 commented 4 days ago

Hi @YorkieDev Now I can select GPU Offload, thank you!