Add local LLM support

[0Hate]

Hi, I am using this open source tool to run local LLM and it has build in api available using same format as the openai api.

Will this work out of the box with the extension?

https://github.com/oobabooga/text-generation-webui/wiki/12-%E2%80%90-OpenAI-API

If not, I would like to implement this to the extension, is that OK?

[jeffdapaz]

Maybe can work out of the box.

Give a try. On extension options, you'll find there the Base Address parameter.

If you set with your local LLM address maybe works.

Tell me something later the result.

[jeffdapaz]

Hi @0Hate, I will close this issue, but if necessary you can reopen.

[redthista]

Looks like its calling /v1/v1 when requesting rather than just v1 [2024-02-03 13:15:37.244] [ERROR] Unexpected endpoint or method. (POST /v1/v1/chat/completions). Returning 200 anyway