search

rashadphz / farfalle

🔍 AI search engine - self-host with local or cloud LLMs
https://www.farfalle.dev/
Apache License 2.0
2.64k stars 234 forks source link

How do I change the OpenAI base url? #57

Closed DavidVeevt closed 3 months ago

DavidVeevt commented 3 months ago

How do I change the OpenAI base url?

anzestrela commented 3 months ago

I have had some success by modifying the line 43 of "src/backend/llm/base.py" to: self.llm = LiteLLM(model=model, api_base="http://192.168.73.78:5000/v1") where "http://192.168.73.78:5000/v1" is the IP of your server.

Doing this, it will generate a response and then error saying that the API key is invalid.

I inform you if I manage to fix this.

DavidVeevt commented 3 months ago

Thank you it worked!