Pass the currently loaded model name to Kobold API

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

5.14k stars 353 forks source link

Pass the currently loaded model name to Kobold API #343

Closed Jacoby1218 closed 1 year ago

Jacoby1218 commented 1 year ago

Currently, the model name loaded is always reported as concedo/koboldcpp regardless of what model is actually loaded. Is there any way this could be synced to show the model that is currently loaded (if not in hf format, maybe just local/model_name?)

gustrd commented 1 year ago

There is a horde config parameter, check at --help.

Jacoby1218 commented 1 year ago

i didn't know that was there. closing