Perplexity evaluation GUI

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

5.5k stars 369 forks source link

Perplexity evaluation GUI #872

Open NovNovikov opened 6 months ago

NovNovikov commented 6 months ago

Hi, can you please include perplexity evaluation from llama.cpp to koboldcpp? There is a separate script for that called perplexity in llama.cpp. Currently looks like this script is not present completely in koboldcpp.

LostRuins commented 6 months ago

Kobold doesnt need perplexity. Why not run it directly from llama.cpp?