UI limits context size to 2048 tokens

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

4.81k stars 343 forks source link

Closed Angela-BC closed 1 year ago

Angela-BC commented 1 year ago

When started with the --contextsize 8192 the model is loaded with the 8192 context size. The UI however still limits the context at 2048.

Running koboldcpp.exe on Windows 11

LostRuins commented 1 year ago

You can manually increase the context by clicking on the number. It is an editable text box.

Angela-BC commented 1 year ago

oh, I never noticed. Thank you.

Fr0d0Beutl1n commented 1 year ago

I wouldn't consider this resolved, as it is not intuitive. Most users will not know that the box is editable. Please reopen.