Closed TashaSkyUp closed 1 month ago
Having litellm be the provider for this would be stellar! Support for basically all llm providers and local as well.
Since litellm has an openAI API you should just be able to provide litellm credentials instead of OpenAI credentials and it should work. Just make sure that it also has an embedding model configured.
Having litellm be the provider for this would be stellar! Support for basically all llm providers and local as well.