infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
https://ragflow.io
Apache License 2.0
20.32k stars 2.01k forks source link

[Bug]: InfiniFlow RagFlow Issue with Ollama 0.3.12 in GraphRag Using Qwen2.5 Model #2765

Open gzmud opened 2 weeks ago

gzmud commented 2 weeks ago

Is there an existing issue for the same bug?

Branch name

dev

Commit ID

dev (image ID: 6ee854751c7e)

Other environment information

一、问题描述 (Issue Description)

在使用InfiniFlow RagFlow的dev版本(镜像ID: 6ee854751c7e)和Ollama版本0.3.12时,调用Qwen2.5模型进行GraphRag操作时,发现无法正确提取关系。以下是详细描述:

When using the InfiniFlow RagFlow dev version (image ID: 6ee854751c7e) and Ollama version 0.3.12, the relationship extraction fails to work correctly with the Qwen2.5 model during GraphRag operations. Details are as follows:

环境配置 (Environment Setup)
InfiniFlow RagFlow版本:dev (image ID: 6ee854751c7e)
Ollama版本:0.3.12

Actual behavior

实际结果 (Actual Result) 实际操作中,GraphRag未能正确提取关系,输出结果与预期不符。

Expected behavior

期望结果 (Expected Result) 使用GraphRag功能时,期望能够从输入文本中正确提取出关系。

Steps to reproduce

拉取InfiniFlow RagFlow的dev版本镜像。
启动容器并安装所有依赖。
加载Ollama的Qwen2.5模型。
执行GraphRag功能,传入相应的输入数据。
观察GraphRag的输出,发现没有提取关系。

Additional information

that‘s all

KevinHuSh commented 1 week ago

If you can chat with that LLM deployed by Ollama, then it goes to the NLP capability of the LLM. Go to the larger model.

gzmud commented 1 week ago

Is there a way to record the complete communication between Ragflow and ollama for debugging purposes?