Mantella is a Skyrim and Fallout 4 mod which allows you to naturally speak to NPCs using Whisper (speech-to-text), LLMs (text generation), and Piper / xVASynth / XTTS (text-to-speech).
Is there a way to remove the hardcoded endpoint which is /chat/completions , because i want to use Cohere instead and the endpoints for me would be : [LanguageModel.Advanced]
llm_api = https://api.cohere.com/v2
llm_custom_endpoint = /generate
Can someone tell me which file i need to edit and then i could recompile with this removed, i dont want to use OpenAI or any other llm than this one because the other they are pretty bad compare to Cohere tbh.
Even with this line here: llm_custom_endpoint = /generate
I cant force the endpoint because it is hardcoded. :S
I have even try to do APi redirect with a DNS redirection but i still have a forced endpoint in my console so.
21:04:24.267 INFO: Text passed to NPC: Hello Trashcan Carla.
21:04:24.562 INFO: Getting LLM response...
21:04:26.950 INFO: Retrying request to /chat/completions in 0.841385 seconds
21:04:30.020 INFO: Retrying request to /chat/completions in 1.770518 seconds
21:04:34.013 ERROR: LLM API Error: Connection error.
Full response saved (0 tokens):
21:04:34.014 INFO: End of sentences
This is while trying to use a custom DNS with redirection to the good Cohere endpoint.
Is there a way to remove the hardcoded endpoint which is /chat/completions , because i want to use Cohere instead and the endpoints for me would be : [LanguageModel.Advanced] llm_api = https://api.cohere.com/v2 llm_custom_endpoint = /generate
Can someone tell me which file i need to edit and then i could recompile with this removed, i dont want to use OpenAI or any other llm than this one because the other they are pretty bad compare to Cohere tbh.
Even with this line here: llm_custom_endpoint = /generate I cant force the endpoint because it is hardcoded. :S
I have even try to do APi redirect with a DNS redirection but i still have a forced endpoint in my console so.
21:04:24.267 INFO: Text passed to NPC: Hello Trashcan Carla. 21:04:24.562 INFO: Getting LLM response... 21:04:26.950 INFO: Retrying request to /chat/completions in 0.841385 seconds 21:04:30.020 INFO: Retrying request to /chat/completions in 1.770518 seconds 21:04:34.013 ERROR: LLM API Error: Connection error. Full response saved (0 tokens): 21:04:34.014 INFO: End of sentences
This is while trying to use a custom DNS with redirection to the good Cohere endpoint.