Open flefevre opened 4 weeks ago
Is your demo compatible with Litellm proxy https://github.com/BerriAI/litellm ? which api is fully compatible with open ai. it will be very nice to be able to test against our own LLM.
Then it should work out of the box, if you configure it as a LLM model, as we support openai compatible APIs
Please try and let us know.
Is your demo compatible with Litellm proxy https://github.com/BerriAI/litellm ? which api is fully compatible with open ai. it will be very nice to be able to test against our own LLM.