Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
Saw you expanded support to Cohere, Anthropic and HF - and wanted to see how to add support for other LLM providers. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and was wondering if we could be helpful.
Added support for Llama2 (via Replicate) and PaLM by creating a new LiteLLM class. The code is pretty similar to the OpenAI class - as litellm follows the same pattern as the openai-python sdk.
Hi @monk1337,
Saw you expanded support to Cohere, Anthropic and HF - and wanted to see how to add support for other LLM providers. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and was wondering if we could be helpful.
Added support for Llama2 (via Replicate) and PaLM by creating a new LiteLLM class. The code is pretty similar to the OpenAI class - as litellm follows the same pattern as the openai-python sdk.
Would love to know if this helps.