infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
https://ragflow.io
Apache License 2.0
12.22k stars 1.18k forks source link

[Feature Request]: Support GLM-4 #1085

Closed mobguang closed 1 day ago

mobguang commented 1 month ago

Is there an existing issue for the same feature request?

Is your feature request related to a problem?

No response

Describe the feature you'd like

We hope ragflow support run GLM-4 LLM locally.

https://github.com/THUDM/GLM-4

Describe implementation you've considered

No response

Documentation, adoption, use case

No response

Additional information

No response

aopstudio commented 3 weeks ago

If you can deploy GLM-4 locally by Xinference or any other backend which can offer OpenAI style's API, then you can integrate it into RAGFlow.