If you have specific workers selected on purpose, the settings for context and generation tokens should be set to match the workers limits automatically... or some other solution to the annoyance of having to set the limits manually.
Also the token slider is locked to certain increments which makes selecting a value like 500 impossible when that is a fairly standard limit from koboldcpp I think.
If you have specific workers selected on purpose, the settings for context and generation tokens should be set to match the workers limits automatically... or some other solution to the annoyance of having to set the limits manually.
Also the token slider is locked to certain increments which makes selecting a value like 500 impossible when that is a fairly standard limit from koboldcpp I think.