-
I ran MIND 5 times on amazon, and the end result is not ideal.
my running cmd is `python3 -u ./src/train.py --model_type MIND 2>&1 | tee MIND`
The summary of the running results is as follows
```
…
-
rectools.metrics.calc_metrics method does not work when trying to run it i got empty result.
code that i tried to run :
from rectools import Columns
from rectools.metrics import Accuracy, NDCG
…
-
I noticed that the NDCG@10 for Touche-2020 on the BEIR leaderboard is around 0.60 for elastic bm25.
Is it correct to assume that Touche-2020 is represented by the dataset named "webis-touche2020"?…
-
I am getting NDCG as nan while simulating for ratings, But no issue while simulating for exposure. Could you please suggest a solution for this?
-
Hello,
I am trying to implement the LambdaRank objective in python so that I could later change the metric NDCG to one that I want.
I started by implementing it with NDCG, so that I can compare with…
-
Hola!
En las primeras instrucciones del enunciado piden que comparemos todos los modelos con nDCG@10, 20, 30 y mAP@10, 20, 30. No obstante, en esta actividad (3) y la siguiente nos indican que debe…
-
Hi! Thanks a lot for the quick release of 1.7.2 to hotfix #8491, now SparkXGBRanker can work more properly. Based on 1.7.2, I also have encountered 2 issues of SparkXGBRanker regarding evaluation metr…
-
Hey all,
First of all thank you for this interesting work (I enjoyed reading the paper a lot)! After cloning and executing the project `run_monot5.py` we obtained the following results from the cac…
-
I am writing to express my appreciation for your paper titled "Alleviating Spurious Correlations in Knowledge-aware Recommendations through Counterfactual Generator". I found your paper interesting an…
-
Thanks for the great work.
When I run the Quick Example, I got a TypeError:
```
Traceback (most recent call last):
File "demo.py", line 34, in
ndcg, _map, recall, precision = retriever…