search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.34k stars 310 forks source link

Augmented benchmark stats #929

Closed Nexesenex closed 2 weeks ago

Nexesenex commented 2 weeks ago

Improves the benchmark by adding some missing info.

2024-06-17 18_29_04-koboldorig_benchmarks_PR csv — LibreOffice Calc

LostRuins commented 2 weeks ago

How about we regroup all launcher flags onto a single line? most of the time people benchmark for performance, the launch flags will kind of add clutter to the data they want. I think they should be kept apart.

image

Nexesenex commented 2 weeks ago

Eh, that's great also. As long as we (mostly you) can get these data mentioned in the benchmark of users when there is a regression, so can be identified quickly the parameters used by the user to bench, it's fine to have the most relevant packed in a single field. On my side, I like to be able to sort data in a spreadsheet and make filters if need be, so the distinct columns are important for me, but for debugging, that's not necessary. Can you correct my PR accordingly to what suits best your views?