-
Hi there, really enjoy the library and have been using it a ton for my research!
I had a question regarding the NDCG calculation in the InformationRetrieval evaluator: https://github.com/UKPLab/sen…
-
Hi,
I am playing around with the vae_cf implementation and I tried to my dataset, instead of the ML-20M. It has the same structure (userid, itemid, ratings) and I made sure data type are the same.
I…
-
在LightGCN原始论文中也有关于gowalla数据集的在卷积层数为2的情况下的recall@20和ndcg@20,在卷积层数为2的情况下,为什么在你们的论文中的LightGCN展示的实验结果与LightGCN原始论文中的差距那么大呢?
-
my result:
hit@1:0.2399, ndcg@5:0.393, hit@5:0.536, ndcg@10:0.4379=, hit@10:0.6718, ap:0.3794
result from paper:
hit@1:0.3440 , ndcg@5:0.4967, hit@5:0.6323, ndcg@10:0.5340, hit@10:0.7473, ap:0.…
-
作者您好,再次麻烦您,能否补全您的P@K和nDCG@K的函数定义文件吗?在aapd数据集上,我复现您的代码,使用的是我自己定义的P@K函数发现P@1、P@3和P@5都是85.5,这个如何解决?
-
你好,很欣赏您的作品,我在复现的时候,结果不是很好,对model-2进行test时,结果很不好,这种结果是正常的吗?Test {'R@1': 0.0005108556832694764, 'R@10': 0.008173690932311623, 'R@100': 0.04559386973180077, 'MRR@10': 0.0020607553366174054, 'MRR@100': 0.…
-
Although I followed the exact settings outlined in the reproducibility file, my experiments consistently yield inferior results compared to those reported in the paper. Any suggestions, recommendation…
-
You[![image](https://github.com/user-attachments/assets/19bb197f-918d-4347-b8a4-2a7876fe832d)]()
-
What if I am predicting a ranked list with the same document ID multiple times in different positions. How can I evaluate nDCG for this using pytrec_eval, given that scores are represented as dictiona…
-
I'm wondering how to calcuate nDCG paper? :confused:
**Question:** The nDCG calculation needs the link predictions of all unobserved items, but It is not tractable(because of sparse density). What…