-
Hello, may I ask why after running your reproduced code, the effect of ndcg as an evaluation indicator is much worse than the original paper, is there any problem somewhere?
-
Regarding the bge-m3 mldr score for lang zh , I am currently using
```python
python FlagEmbedding/C_MTEB/MLDR/mteb_dense_eval/eval_MLDR.py --encoder /data/models/bge-m3 --languages zh --results_…
-
When I used the pre-trained model 'raphaelsty/neural-cherche-sparse-embed' to evaluate the dataset, specifically, the arguana dataset, with a retrieval k value of 100, the result was very poor
{'map'…
-
Problem: call of a method `eval_metrics` of `CatBoostRanker` class returns a dict with keys that are different from keys in the argument `metrics` of the method.
catboost version: 1.2.5
Operating…
-
Hello @benfred. I think there might be an issue with the computation of NDCG in ranking_metrics_at_k. I believe NDCG should be calculated by first sorting the recommended ids by the recommendation sco…
-
Hi there! In the function corresponding to NDCG calculation I noticed that `ignore_rank_of_non_annotated_urls` flag is present.
https://github.com/github/CodeSearchNet/blob/76a006fda591591f196fd0aef1…
-
Hello,
Could you give me directions on the Propensity scored nDCG loss function implementation?
-
-
**Is your feature request related to a problem? Please describe.**
In some extremely challenging scenarios for information retrieval, items relevant to a query follow a long tail distribution. Thus, …
-
Hello, can you provide matlab code for HR and NDCG? thank you very much!