search

netease-youdao / BCEmbedding

Netease Youdao's open-source embedding and reranker models for RAG products.
Apache License 2.0
1.3k stars 85 forks source link

提问：如何 benchmark bce reranker （bce-reranker-base_v1） 在对日语的reranker能力 #44

Closed jiangying000 closed 4 months ago

jiangying000 commented 4 months ago

比较重要的是这几个指标

请问有没有这种测试数据集、测试方案或者测试结果

shenlei1020 commented 4 months ago

not yet, you can do this test in your scenarios.

shenlei1020 commented 4 months ago

As for the test workflow, you can check "https://github.com/netease-youdao/BCEmbedding/blob/master/BCEmbedding/tools/eval_rag/eval_llamaindex_multiple_domains.py" or LlamaIndex blog "https://blog.llamaindex.ai/boosting-rag-picking-the-best-embedding-reranker-models-42d079022e83"

jiangying000 commented 4 months ago

thanks

As for the test workflow, you can check "https://github.com/netease-youdao/BCEmbedding/blob/master/BCEmbedding/tools/eval_rag/eval_llamaindex_multiple_domains.py" or LlamaIndex blog "https://blog.llamaindex.ai/boosting-rag-picking-the-best-embedding-reranker-models-42d079022e83"