BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
https://docs.litellm.ai/docs/
Other
12.47k stars 1.45k forks source link

[Feature]: Request for Support: Integration of Chat GLM Model #5919

Open whyihaveyou opened 11 hours ago

whyihaveyou commented 11 hours ago

The Feature

I hope you are doing well. I'm just contacting you to ask for the addition of support for a recently released Chinese language model known as Chat GLM. This model has been gaining significant attention in the AI community due to its impressive capabilities.

Motivation, pitch

It is reported that the top-tier version of Chat GLM is capable of performance nearing that of GPT-4o. But it is cheaper.

Twitter / LinkedIn details

No response

krrishdholakia commented 10 hours ago

is there an LLM provider that you need us to integrate with for this? @whyihaveyou

If the provider is openai-compatible you can do it like this - https://docs.litellm.ai/docs/providers/openai_compatible