The Vulkan GPU on my AMD rx470 has no slider for the threads, so I assume its using cpu number of threads or the default of 4 or all (but I doubt that performance wise), but, this is not 2000 threads/shaders from what I can tell. Aside from that, if im running fallout 4 / mantella / Lm studio, on same card, I will need to manage threads. So the vulkan implementation is effectively the same as cpu for me currently, and 0.2.24 with its OpenCl is possibly the better version to use for AMD. In short need slider for gpu threads for vulkan/gpu.
I have a GT 730 and RX 470 (8GB), I have to turn off compute on the 730, or it will try to load models to the gt 730 1GB, then fail, because it is the first card in the list. Whats worse is on the new beta 0.3.0 it didnt even matter if I disable compute, it will try to load to the gt 730 every time. Then I installed 0.2.31 back again, and now that seems to be ignoring the compute flag too, and loading to the gt 730 and failing the same. Possibly doing clean install would help, or its some other supporting file that isnt downgrading with the main package. again I could use 0.2.24 because it doesnt use vulkan. In short, need to check the compute flags in 0.3.0, and/or introduce toggle on/off for each gpu.
The Vulkan GPU on my AMD rx470 has no slider for the threads, so I assume its using cpu number of threads or the default of 4 or all (but I doubt that performance wise), but, this is not 2000 threads/shaders from what I can tell. Aside from that, if im running fallout 4 / mantella / Lm studio, on same card, I will need to manage threads. So the vulkan implementation is effectively the same as cpu for me currently, and 0.2.24 with its OpenCl is possibly the better version to use for AMD. In short need slider for gpu threads for vulkan/gpu.
I have a GT 730 and RX 470 (8GB), I have to turn off compute on the 730, or it will try to load models to the gt 730 1GB, then fail, because it is the first card in the list. Whats worse is on the new beta 0.3.0 it didnt even matter if I disable compute, it will try to load to the gt 730 every time. Then I installed 0.2.31 back again, and now that seems to be ignoring the compute flag too, and loading to the gt 730 and failing the same. Possibly doing clean install would help, or its some other supporting file that isnt downgrading with the main package. again I could use 0.2.24 because it doesnt use vulkan. In short, need to check the compute flags in 0.3.0, and/or introduce toggle on/off for each gpu.