Open cristianohello opened 9 months ago
You could look into the LiteLLM adapter -- https://github.com/BerriAI/litellm
Also, if you're using llama.cpp, if you run its server, you should be able to specify it as your base_url when you initialize your OpenAI object.
You could look into the LiteLLM adapter -- https://github.com/BerriAI/litellm
Also, if you're using llama.cpp, if you run its server, you should be able to specify it as your base_url when you initialize your OpenAI object.