Allow fallback providers who use OpenAIChat API format

n4ze3m / page-assist

Use your locally running AI models to assist you in your web browsing

https://chromewebstore.google.com/detail/page-assist-a-web-ui-for/jfgfiigpkhlkbnfnbobbkinehhfdhndo

MIT License

1.56k stars 148 forks source link

Allow fallback providers who use OpenAIChat API format #203

Closed aiseei closed 1 month ago

aiseei commented 1 month ago

Really enjoy using your extension - keeping it lightweight is a great strategy. I think it might be super beneficial to leverage the OPENAI Chat API format to allow users to maintain a fallback of api end points/models to leverage off self hosted llama.cpp or even Groq api etc.

Let me know your thoughts.

Thanks!

n4ze3m commented 1 month ago

Yes, it is already in progress and will hopefully be released this month. In #197, you can easily configure any OpenAI API format provider and use it