lifan0127 / ai-research-assistant

Aria is Your AI Research Assistant Powered by GPT Large Language Models
GNU Affero General Public License v3.0
794 stars 33 forks source link

Allow change OpenAI base url #54

Open ProgramFan opened 11 months ago

ProgramFan commented 11 months ago

Thus it is possible to use Azure models and API proxies.

alibama commented 9 months ago

great idea...

i'm curious if something like localai is actually a drop-in replacement or not? depending on how the code is organized there may be some challenges to other parts of the UI? it could also open up some opportunities to use the open source summarize tools... https://github.com/lifan0127/ai-research-assistant/issues/17 seems to reference back to some ideas around this as well..

lifan0127 commented 7 months ago

@ProgramFan It is now possible to customize the OpenAI base URL. Please give it a try.

https://github.com/lifan0127/ai-research-assistant/releases/tag/0.6.4

FetchFast commented 7 months ago

I think it would work if we could also specify the base model to our Azure model name. (this is a custom settable string)

lifan0127 commented 7 months ago

Currently I don't have access to Azure GPT-4 to develop this feature. If someone is willing to share their access, I am happy to add the support. My contact info is available on my website: https://apex974.com

ProgramFan commented 7 months ago

@ProgramFan It is now possible to customize the OpenAI base URL. Please give it a try.

https://github.com/lifan0127/ai-research-assistant/releases/tag/0.6.4

It works great. For anyone wants to access OpenAI API but does not want to setup a server himself, he can create an OpenAI endpoint at CloudFlare AI endpoints, for free.