Raudaschl / rag-fusion

772 stars 88 forks source link

Can i change openai to llama or open LLM? #6

Open cristianohello opened 9 months ago

noodlehaus commented 7 months ago

You could look into the LiteLLM adapter -- https://github.com/BerriAI/litellm

Also, if you're using llama.cpp, if you run its server, you should be able to specify it as your base_url when you initialize your OpenAI object.