search

lmg-anon / mikupad

LLM Frontend in a single html file
https://lmg-anon.github.io/mikupad/mikupad.html
Creative Commons Zero v1.0 Universal
170 stars 24 forks source link

[Feature Request] - Koboldcpp probability #1

Open kalomaze opened 8 months ago

kalomaze commented 8 months ago

Being able to see probability on the kobold API backend would be a nice addition

lmg-anon commented 8 months ago

This depends on https://github.com/LostRuins/koboldcpp/issues/469. Implementing that on koboldcpp should be relatively straightforward, as it's a fork of llama.cpp. I'll likely attempt this later.

jojorne commented 4 months ago

I agree, I wrote my 2 cents there. 😅