Tureti
commented
2 weeks ago Looks like setting a random api-key fixes it, definitely not a koboldcpp problem.
Closed Tureti closed 2 weeks ago
Tureti
commented
2 weeks ago Looks like setting a random api-key fixes it, definitely not a koboldcpp problem.
For some reason https://github.com/open-webui/open-webui can't detect the model from http://localhost:5001/v1/models.
Not sure if this is a problem from them or from here but this is the text from v1/models: {"object": "list", "data": [{"id": "koboldcpp/Meta-Llama-3-8B-Instruct-Q6_K", "object": "model", "created": 1, "owned_by": "koboldcpp", "permission": [], "root": "koboldcpp"}]}