Closed rothnic closed 3 months ago
Will take a look at this tmr.
Will take a look at this tmr.
Thanks! IMO, it might be worth mentioning in the tooltips any default behavior. In this case, you might not know that by not setting the value (i assume on a non-mac), then you enable all layers to use the gpu. I just imagine it would be confusing for most people to see a toogle option called "Use GPU" and not want to enable it, because it sounds like it toggles gpu use on.
It is a poorly named option from the ollama side of things, so another thought would be to change the option label in the Dify UI to "GPU Layers" and maybe have the tooltip reference the official parameter name.
Self Checks
Dify version
0.6.8
Cloud or Self Hosted
Self Hosted (Docker)
Steps to reproduce
Setup:
Issue:
num_gpu
, which seemed to suggest that setting to 1 would mean use the gpu or to control how many gpus are used✔️ Expected Behavior
❌ Actual Behavior