Crash upon more than character inserted into `Prefix` field

[Succubyss]

I'm using Llama_Chat_gguf_VK_vulkan_mini.exe (which I believe is what most NVIDIA GPU users should be using?) and on completely default settings, I'll go into "Text Settings" and type into this field:

But upon inserting more than 1 character, the program crashes.

P.S. Please make Shift+Enter always insert a newline irrespective of the toggle status of Send messages by Enter (should probably be changed to "with Enter").

[MaggotHATE]

Hi! Thanks for the report, seems like Prefix is broken again, I'll look into it. Haven't used prefix for a long time.

As for Shift+Enter, I'm not sure it's possible in ImgUI (should be?), but it would be handy indeed.

[MaggotHATE]

Oh, and btw:

which I believe is what most NVIDIA GPU users should be using?

Both Clblast and Vulkan versions are compatible with Nvidia GPUs, just be aware that Clblast doesn't work with MoE models.

[Succubyss]

Oh, and btw:

which I believe is what most NVIDIA GPU users should be using?

Both Clblast and Vulkan versions are compatible with Nvidia GPUs, just be aware that Clblast doesn't work with MoE models.

Which do you think would be faster? Pascal architecture if that makes a difference.

[MaggotHATE]

Pascal architecture if that makes a difference.

I see not much difference on my 1060 3GB (Vulkan is slightly faster, but each layer takes more VRAM), but that amount of VRAM is not enough to test that properly. However, Vulkan takes additional time to compile shaders on each launch, so it's a bit less convenient - and I don't use MoE models for now.

I've fixed the problem you've reported, please check. Shift + Enter should also work.