Perplexity evaluation GUI

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

4.35k stars 312 forks source link

Perplexity evaluation GUI #872

Open NovNovikov opened 1 month ago

NovNovikov commented 1 month ago

Hi, can you please include perplexity evaluation from llama.cpp to koboldcpp? There is a separate script for that called perplexity in llama.cpp. Currently looks like this script is not present completely in koboldcpp.

LostRuins commented 1 month ago

Kobold doesnt need perplexity. Why not run it directly from llama.cpp?