[app] add support for custom openai provider url

mediar-ai / screenpipe

rewind.ai x cursor.com = AI powered by your 24/7 screen & voice local recording.

https://screenpi.pe

MIT License

8.74k stars 497 forks source link

Closed louis030195 closed 1 month ago

louis030195 commented 2 months ago

atm we only support openai or ollama

add support for custom openai url

definition of done:

[ ] i can drop my url (say llamacpp or github models, or openrouter, or anthropic maybe?) and chat and it works (tool call etc.) on all messages in the empty screen, can still embed videos, etc. (does not fail at tool call)
[ ] consistent UI
[ ] still uses vercel/ai lib (figure out how)

eladrave commented 1 month ago

You can just add a "BASE_URL" in the settings, and use litellm. This will enable you to run any model. Either remote, or local, or both @louis030195

louis030195 commented 1 month ago

done