-
执行完python summarize_results.py --results_dir /home/advantech/zhytesttest/FlagEmbedding/C_MTEB/zh_results/bge-large-zh-v1.5 --lang zh，查看zh_results.md没有值，是我哪里弄错了？
`
Now when I try to run m…
-
From https://github.com/embeddings-benchmark/mteb/pull/1329:
Currently, MIEB results are en results-mieb (which is nice for development). However, it would be ideal to move it to a separate repo.
-
Thank you for all your hard work.
I've noticed that in your implementation of classifiers in `ClassificationEvaluator`, it seems that classifiers like `LogisticRegression` and `kNN` are [trained o…
-
From https://github.com/embeddings-benchmark/mteb/pull/1329:
Figure out what to do with folder structure. Should we create a folder like evaluation/evaluators/{modality}, or do we want to do it in an…
-
The CDE model is incredibly powerful, as it naturally integrates "context tokens" into the embedding process. As of October 1st, 2024, the cde-small-v1 stands as the top-performing small model (under …
-
@x-tabdeveloping is working on the new leaderboard [here](https://github.com/embeddings-benchmark/mteb/pull/1235) with awesome progress towards making it customizable (e.g. "select your own benchmark"…
-
运行
import mteb
from sentence_transformers import SentenceTransformer
model_name = "BAAI/bge-reranker-base"
model = SentenceTransformer(model_name)
tasks = mteb.get_tasks(tasks=["SciDocsRR"…
-
`CrossEncoder` objects currently do not have the `model_card_data` attribute, but `SentenceTransformer` objects do.
```python
from sentence_transformers import SentenceTransformer, CrossEncoder
…
-
We currently support custom biencoder models but not yet custom rerankers. Could be good to have imo! See https://github.com/embeddings-benchmark/mteb/issues/1230#issuecomment-2371998543 for context.