Open QuinnPiers opened 4 months ago
Looks like fastchat has an openai interface, and sillytavern takes an openai interface... so it should work that way.
so in {fastChat,serve.controller}/docs I see that the endpoint isn't /v1/models its "/list_models" which makes me wonder if FastChat is openai compatible?
Hi, sorry I'm a big newb at this.
I love that fastchat uses multi gpus and I've gotten the webservice/worker setup, but I don't know how to config SillyTavern to use fastchat and its not listed as one of the API connections options... https://docs.sillytavern.app/usage/api-connections/
but I wonder if Fastchat is the same as like Oobabooga? or 1 of the other options? https://docs.sillytavern.app/usage/api-connections/