search

infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
https://ragflow.io
Apache License 2.0
18.18k stars 1.84k forks source link

[Question]: Why ragflow need to use a model named "qwen2-instruct-1-0" when the Chunk Method is "Knowledge Graph"？ #2486

Open wuxiweili opened 1 week ago

wuxiweili commented 1 week ago

Describe your problem

QQ20240919-110315

My default model is named "qwen2-instruct" in System. Why ragflow need to use a model named "qwen2-instruct-1-0" when the Chunk Method is "Knowledge Graph"？

Error: xinference.api.restful_api 2829 ERROR [address=0.0.0.0:43828, pid=2863] Model not found, uid: qwen2-instruct-1-0

SummerDream233 commented 1 week ago

I find you have implement RAGFlow in your computer. Therefore, you need to write GPT API in your system setting. In the version of online demo, each user will obtain some free tokens from GPT. When it comes to local version, you must prepare API key to run the RAGFlow

KevinHuSh commented 1 week ago

The error message is from xinference. Maybe the model in xinference is named 'qwen2-instruct-1-0'. RAGFlow will not rename the model.