search

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
https://docs.litellm.ai/docs/
Other
13.88k stars 1.64k forks source link

New provider: KoboldAI #130

Closed johnd0e closed 1 year ago

johnd0e commented 1 year ago

Their API is rich, but for the purposes of this project similar simple implementation should be enough (I suppose) https://github.com/Josh-XT/AGiXT/blob/main/agixt/providers/kobold.py

Here is more detailed implementation: https://github.com/langchain-ai/langchain/blob/master/libs/langchain/langchain/llms/koboldai.py

ishaan-jaff commented 1 year ago

thanks for making this issue - closing as this is not a top priority right now