-
Hello, may I ask why after running your reproduced code, the effect of ndcg as an evaluation indicator is much worse than the original paper, is there any problem somewhere?
-
executing run_pairwise_ranker.py【trainer.train_ranker(mode=args.mode)】 --> when I executed metrics.evaluate_and_aggregate() in the network_trainer.py file,I noticed that the variable results['model'][…
-
Problem: Don't know how to set mode for YetiRank loss function.
Screenshot from [documentation](https://catboost.ai/en/docs/concepts/loss-functions-ranking#YetiRank):
![image](https://github.com/…
-
### Describe the bug
In `sklearn.metrics._ndcg_sample_scores`, there is a counterintuitive handling of the case where all true relevances are equal to zero for some samples. In this case, DCG = 0, ID…
-
Hello, dear sir or madam.
I'm running the code you suggested.
`python data/data_preprocessing.py `
`python model/MAGCL.py`
But I got a confusing result😢
> Epoch 1, Digital HR is 0.6253, MRR …
-
### Description
Hello!
I encountered an issue while evaluating the BPR (Bayesian Personalized Ranking) model with basically the same code provided in the example on a different dataset. Specifical…
-
```python
import json
import os
import numpy as np
from tqdm import tqdm
from tabulate import tabulate
def load_jsonl(file_path):
with open(file_path, 'r') as file:
return [json.…
-
Hello @benfred. I think there might be an issue with the computation of NDCG in ranking_metrics_at_k. I believe NDCG should be calculated by first sorting the recommended ids by the recommendation sco…
-
Thank you for your interesting work. I believe the idea of aligning LLM and RecSys knowledge via textual IDs is very promising and innovative.
While examining your code, I noticed a data leakage is…
-
Hi there! In the function corresponding to NDCG calculation I noticed that `ignore_rank_of_non_annotated_urls` flag is present.
https://github.com/github/CodeSearchNet/blob/76a006fda591591f196fd0aef1…