Maybe out of scope, but it would be great to have a choice of LLMs if users want to rely on open source models - for instance by offering access to https://www.together.ai/?
There are some packages (under development) that model the OpenAI API for various backends - but I don't know them for Python if you want to keep the LLM calls there ...
Maybe out of scope, but it would be great to have a choice of LLMs if users want to rely on open source models - for instance by offering access to https://www.together.ai/?
There are some packages (under development) that model the OpenAI API for various backends - but I don't know them for Python if you want to keep the LLM calls there ...