langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
https://dify.ai
Other
52.37k stars 7.64k forks source link

add Ollama rerank model #10917

Open shenhai-ran opened 1 day ago

shenhai-ran commented 1 day ago

Self Checks

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Hi, I am trying to use Ollama only with Dify, and I am missing rerank models in the usecase of RAG. Could you please add rerank models for Ollama, besides LLM and text embedding.

2. Additional context or comments

No response

3. Can you help us with this feature?

crazywoola commented 1 day ago

I do not see rerank type here https://www.ollama.com/search.

shenhai-ran commented 1 day ago

@crazywoola yes, you are absolutely right. But now Ollama supports models from Huggingface, as in this blog https://huggingface.co/docs/hub/en/ollama, and there are rerank model of GGUF format on Huggingface, such as https://huggingface.co/gpustack/bge-reranker-v2-m3-GGUF.

Do you think Dify can support that?