Closed henk717 closed 11 months ago
In the different implementations you missed KoboldAI's API. Its interactive documentation can be found on our sample instance : https://koboldai-koboldcpp-tiefighter.hf.space/api
Python based example can be found here : https://github.com/henk717/KoboldAI/blob/united/api_example.py
Thank you, I'll add soon!
Hi, me and @PatrickLearn implemented this. It uses just the streaming endpoint in extras, and allows you to set the url root for kobold.
In the different implementations you missed KoboldAI's API. Its interactive documentation can be found on our sample instance : https://koboldai-koboldcpp-tiefighter.hf.space/api
Python based example can be found here : https://github.com/henk717/KoboldAI/blob/united/api_example.py