search

infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
https://ragflow.io
Apache License 2.0
19.83k stars 1.98k forks source link

[Question]: response error #1490

Closed adzhua closed 1 month ago

adzhua commented 3 months ago

Describe your problem

QQ截图20240712165144 what is the reason?

KevinHuSh commented 3 months ago

It's caused by Ollama. I think you need to google the error. I guess it's related to the CUDA toolkit.

adzhua commented 3 months ago

It's caused by Ollama. I think you need to google the error. I guess it's related to the CUDA toolkit.

But I can get the correct results when I use curl to request. curl http://localhost:11434/api/chat -d '{ "model": "glm4", "messages": [ { "role": "user", "content": "hi" } ] }'