LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.66k stars 334 forks source link

Add option to randomise/change order of World Info #701

Open Freddo3000 opened 6 months ago

Freddo3000 commented 6 months ago

Currently it seems like World Info entries are stored in order of entry, with the last added one displayed closest. It would be nice to have the option to randomise the order, so that older entries may gain stronger binding to what is being currently generated. In a similar vein, it would be nice if you could change the order of World Info entries. Perhaps add a "weight" attribute to help determine the order?

LostRuins commented 6 months ago

That would not be a good idea as it would break context shifting even more.

Freddo3000 commented 6 months ago

That would not be a good idea as it would break context shifting even more.

Couldn't that be explained using a tooltip? And I only think that would apply to randomised order, I'd still like to be able to change order instead of having to cut/paste as it is now.