search

Librum-Reader / Librum-Server

The Librum server
https://librumreader.com
GNU Affero General Public License v3.0
301 stars 22 forks source link

Self-Hosted AI Server support #32

Open aditya-shri opened 9 months ago

aditya-shri commented 9 months ago

Added support for using self hosted AI models. The self-hosted AI models should support OpenAI API calls.

ilkersigirci commented 7 months ago

Most selfhosted api servers need model parameter in their requests, which differs from Openai model names. Hence, with current architecture, I cannot use any selfhosted server. One possible solution is to pass model parameter as an environment variables.