OS is win11, I notice koboldcpp 1.64.1 has vulkan driver support, so I make a nice try with my AMD 6800U, 32GB ram, 3GB vram with GPU shared memory. Its total vram could be boosted to 17GB. It has vulkan driver showing in AMD software (Vulkan version 2.0.299, vulkan API 1.3.277 ) . This time, I try Loyal-Toppy-Bruins-Maid-7B-DARE-Q8_0-imatrix.gguf, which works in --useclblast 0 0.
I suspect vulkan driver didn't support shared memory, task manager didn't show system load the model in shared memory, I still choose to report this, just in case if it comes from bugs or something.
I have the same cpu as you but my bios only allows 512MB dedicated vram. So I can confirm vulkan has shared memory. Versions 1.62 to 1.64.1 are known to have vulkan bugs though try again with 1.65.
OS is win11, I notice koboldcpp 1.64.1 has vulkan driver support, so I make a nice try with my AMD 6800U, 32GB ram, 3GB vram with GPU shared memory. Its total vram could be boosted to 17GB. It has vulkan driver showing in AMD software (Vulkan version 2.0.299, vulkan API 1.3.277 ) . This time, I try Loyal-Toppy-Bruins-Maid-7B-DARE-Q8_0-imatrix.gguf, which works in --useclblast 0 0.
I suspect vulkan driver didn't support shared memory, task manager didn't show system load the model in shared memory, I still choose to report this, just in case if it comes from bugs or something.