The score of all results retrieved from the knowledge base is null

[Bulua]

Self Checks

• [X] This is only for bug report, if you would like to ask a question, please head to Discussions.
• [X] I have searched for existing issues search for existing issues, including closed ones.
• [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• [X] Please do not modify this template :) and fill in all the required fields.

Dify version

0.7.1

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

[dosubot[bot]]

@Bulua Hello there! I'm here to assist you with bug fixes, questions, and contributions while waiting for a human maintainer. Let's tackle this together!

The score of all results retrieved from the knowledge base is null in version 0.7.1 of the self-hosted (Docker) Dify because the retrieval mode might not be properly configured. Specifically, if the knowledge base is using the "Economical" index mode, it does not support the "Weight Score" configuration and requires enabling the Rerank model to ensure content retrieval quality.

To resolve this issue, you should switch the knowledge base to the "High Quality" index mode or enable the Rerank model in the "Model Provider" settings ^[1].

To enable the Rerank model in the "Model Provider" settings, follow these steps:

1. Navigate to the "Model Providers -> Cohere" page.
2. Enter the API Key for the Rerank model (such as Cohere, Jina, etc.) ^[2].

To continue talking to Dosu, mention @dosu.

[Bulua]

This is the setting of my knowledge base, and the score in the search results is still null

[dosubot[bot]]

The score in the search results might still be null despite configuring the knowledge base with the "bge-large-zh-v1.5" embedding model and "bge-reranker-large" rerank model because the embedding models used in the multiple referenced knowledge bases might be inconsistent. This inconsistency can prompt a notification to avoid conflicts in retrieval content. It is advisable to set and enable the Rerank model in the "Model Provider" or unify the retrieval settings of the knowledge bases ^[1][2].

Additionally, ensure that the retrieval settings are correctly configured. In high-quality indexing mode, Dify offers three retrieval options: Vector Search, Full-Text Search, and Hybrid Search. Each of these methods has specific configurations such as TopK, Score Threshold, and Rerank Model settings that need to be properly set up. Incorrect configurations could result in null scores in the search results ^[1].

To continue talking to Dosu, mention @dosu.

[crazywoola]

Are you referring to the knowledge API?

[leoterry-ulrica]

Are you referring to the knowledge API?

I’m also experiencing the same issue, and the text blocks with score=null are being sorted to the front.