-
Hi,
I was wondering if the NIST Labels from the previous years are available?
/ Is it still possible to evaluate models on those labels?
Also I was wondering what those labels are? (Are they m…
-
Thanks a lot for sharing this work and I have successfully reproduced the MRR@10 metrics on the MS Marco Passage ranking task using your published checkpoint. I'm wondering if you are planning on sha…
-
I opened this feature-request on the basis of this [slack thread](https://vespatalk.slack.com/archives/C01QNBPPNT1/p1630055029072900) and @jobergum 's [comment](https://vespatalk.slack.com/archives/C0…
-
Special Mission 3에서 언급된 `SparseRetrieval`와 `DenseRetrieval` 객체를 추상화시켜서 확장성있는 코드로 개발.
제공된 retrieval.py에는 boilerplate가 너무 많습니다.
이를 추상화시켜서 나중에 새로운 Retrieval를 추가해도 동작하도록 개발합니다.
+ End2End도 고민!
-
Hi, jingtao
the link from warmup model of ANCE is invalid?
-
I am working on a large data set where there are around 1M unique experiments and each have repeated more than 20 times even up to 10K. I would like to inform such a structure to catboost. I thought I…
-
For TREC passage full-rank task, i use the prebuilt index **_msmarco-passage-expanded_**, set_bm25 with k1=float(0.82), b=float(0.68), no rm3, the Top1000 file reranked by monoT5-3B finally got R@100…
-
Hi, I am doing the "Experiments on MS MARCO Passage Retrieval - Dev Subset - with GPU"，I want to get the original dev Subset in a tsv file(containing 105 queries)，just like 《 Passage Re-ranking with …
-
Hi,
Thanks for releasing the code!
I am trying to replicate the MSMARCO DEV passage ranking results using the **quantization** branch but unable to do so.
Here's the set of commands I use to in…
-
Hi, I'm replicating [transformer-kernel-ranking](https://github.com/sebastian-hofstaetter/transformer-kernel-ranking) which is a SOTA model in information retrieval task. And when I read README.md of …