Closed MKwareContributions closed 1 year ago
It should. Try to send POST request to /api/latest/generate
Ah i see what is happening, somehow this fork of TavernAI is requesting from a new endpoint that I did not implement. It will be added in the next release of KoboldCpp.
This is also bad design on the fork's part, they should never request /latest/ in case we change things up. They should target a version we specifically defined for future compatibility.
This should be fixed in the latest version, currently v1.3 at time of writing. https://github.com/LostRuins/koboldcpp/releases/latest
Closing issue as it seems to be resolved. Please open a new one if there are other problems
When I try to access API endpoint (like with TavernAI) it throws this:
And on Tavern logs this:
Same thing when trying to access ![browser](https://i.imgur.com/rcZTzDT.png)
localhost:5001/api
with browser:Does that mean that there's no API endpoint to connect from other programs? Using noavx2 build, just in case.