search

infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
https://ragflow.io
Apache License 2.0
10.07k stars 974 forks source link

Port could not be cast to integer value as ' 11434' #1192

Open yangboz opened 1 week ago

yangboz commented 1 week ago

Describe your problem

try to have a try ollama model integration, but don't known how, maybe it needs more document. related to #

can't wait to use ollama in local.

KevinHuSh commented 1 week ago

RAGFlow has already supported ollama. Configure it in settings >> model providers

yangboz commented 1 week ago

RAGFlow has already supported ollama. Configure it in settings >> model providers please give a live example picture better than hundreds of words.

Screenshot 2024-06-18 at 09 39 54
yangboz commented 1 week ago

in mac , after running ollama, even checked it with curl localhost:11434 it returns "ollama is running".

KevinHuSh commented 1 week ago

I don't think localhost is the right IP since it is not reachable in docker container. So, try to use the real machine IP.

yangboz commented 1 week ago

I don't think localhost is the right IP since it is not reachable in docker container. So, try to use the real machine IP.

I don't think so , becuz I installed the ollama with dmg, also curled "curl localhost:11434" got "ollama is running" response, if localhost not working, how to integrate it in rag flow model configure window ? or only xinference works?

yangboz commented 5 days ago

I don't think localhost is the right IP since it is not reachable in docker container. So, try to use the real machine IP.

after export OLLAMA_HOST=0.0.0.0:11434 , ollama serve, still got `Fail to access model(qwen).**ERROR**: [Errno 111] Connection refused