win4r / GraphRAG4OpenWebUI

GraphRAG4OpenWebUI integrates Microsoft's GraphRAG technology into Open WebUI, providing a versatile information retrieval API. It combines local, global, and web searches for advanced Q&A systems and search engines. This tool simplifies graph-based retrieval integration in open web environments.
https://www.youtube.com/@AIsuperdomain
Apache License 2.0
362 stars 84 forks source link

embedding模型能用ollama部署的吗?试了试没成功 #5

Closed martinzhang777 closed 4 months ago

martinzhang777 commented 4 months ago

尝试修改这个为ollama部署的embedding模型,报错

设置嵌入API基础URL(默认为OpenAI的API)

export API_BASE_EMBEDDING="http://localhost:11434/v1"

设置嵌入模型(默认为"text-embedding-3-small")

export GRAPHRAG_EMBEDDING_MODEL="znbang/bge:large-zh-v1.5-f32"

MrCui commented 4 months ago

GraphRAG框架的问题, 他们 Issues 里有人报这个问题, 用LLama,cpp 吧. MS昨天应该修复这个问题了. 可能源还没更新吧.

martinzhang777 commented 4 months ago

GraphRAG框架的问题, 他们 Issues 里有人报这个问题, 用LLama,cpp 吧. MS昨天应该修复这个问题了. 可能源还没更新吧.

好的,感谢