[Minor bug] Repetition range hard capped at 0≤RpRng≤8192

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

4.66k stars 334 forks source link

Closed bucketcat closed 5 months ago

bucketcat commented 6 months ago

RpRng locked at 8192 or lower. Allow it to scale to at least the size of the context for sampler compatibility. I.e. 0≤RpRng≤Ctx

Edit: In lite UI, v1.58.

LostRuins commented 5 months ago

Hi, this should now be fixed. Please check the latest version!

bucketcat commented 5 months ago

Hi, this should now be fixed. Please check the latest version!

Fixed