-
您好,作者。我很感谢您的框架为我的科研工作带来的方便。我今天测试CL4Rec模型进行对比学习时,数据选的是ml-100K,我的结果如下:其他参数均为默认参数,没有对比学习是指计算loss时
把原本的“return loss + self.lmd * nce_loss, alignment, uniformity”改为 “return loss, alignment, uniformity”,删除…
-
大佬好呀~!
我看到论文中写了两个评价指标,hr 和 ndcg。我查了一些资料,但是没有查到 hr(hit ratio)的被广泛接受的定义。我想问一下,hr 和 recall 也就是召回率是否一样?hr@20 是不是等价于 recall@20?
感谢大佬,祝科研顺利!❤
-
The hitratio and ndcg will be influenced by neg sample numbers. I think the calculation method for these two metrics might be wrong in some way.
The example is when neg sample is 1, the ndcg will lar…
-
I wanted test speed in python.
I tried to replicate gpu(L40) and cpu(28cores) experiment with higgs. The following are the experimental results.
num_iterations(500): cuda(28s) version was slower t…
-
I am using
```
evaluator = pytrec_eval.RelevanceEvaluator(qrels, {map_string, ndcg_string, recall_string, precision_string})
scores = evaluator.evaluate(results)
```
Now result…
-
Tue 28 Nov 2023 23:22:47 INFO best valid : OrderedDict([('recall@10', 0.0544), ('recall@20', 0.08), ('recall@50', 0.1273), ('ndcg@10', 0.0297), ('ndcg@20', 0.0362), ('ndcg@50', 0.0456)])
Tue 28 Nov …
-
Hi,
I would like to run some commands in "2.2.1. First run" - Manual.pdf, for example:
**time . fast_run_RR.sh**
However, I got the following result:
---
calculate MAE: python /home/tien/TranscRa…
-
Create a usage example on how these ranking metrics can be used:
```
+------------------------------------------------------------+-----------------------------------------------------------------…
-
Greetings to the team!
Your code is beautiful, but I'm lost in the implementation of it.
I have the last version of PyTorch: https://pytorch.org/get-started/locally/ & Python
- Stable (1.8.1)
- …
-
Dear MTEB Team,
I noticed that there are some incompatible task names between [github repo](https://github.com/embeddings-benchmark/mteb/tree/main/mteb/tasks) and [leaderboard config](https://githu…