-
`(SeeTopic) PS D:\SeeTopic> sh ./seetopic.sh
===Get PLM Embeddings===
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████…
-
Hi! Trying to run SciDocs on my own model. I produce the three files of embeddings and then run the evaluation suite:
```python
from scidocs import get_scidocs_metrics
from scidocs.paths import D…
-
Hello,
had a look at the results of comparing gpt-3, google and sentence transformer embedding models against each other on a few benchmarks from BEIR (https://docs.google.com/spreadsheets/d/1cbkJAin…
-
Hello Niklas,
I have a question regarding reproducing SGPT's result. On the [mteb leaderboard](https://huggingface.co/spaces/mteb/leaderboard), the 125M-weightedmean-msmarco-specb-bitfit model achiev…
-
Dear Akari,
Thank you for the great work and the detailed documentation on TART.
I want to reproduce the cross-task cross-domain results. You said you have uploaded all the passages embeddings on […
-
**Dataset Information:**
[Beir](https://github.com/UKPLab/beir/blob/main/README.md) is a suite of benchmarks, intended to be used for testing zero-shot transfer.
These would help extend the tool…
-
Hi,
thank you for sharing and maintaining this repo! I am willing to generate the SPLADE representations both for documents and queries for all the datasets in BEIR, similarly to what it is possible…
-
Can you check the installation instructions? I know there are a lot of dependencies on other people's code, but it would be nice to do what we can to make sure the install is as easy as possible.
…
-
# BEIR
Beir is a benchmark of information retrieval. It was used for benchmarking Azure AI Search at Microsoft tech community - [Azure AI Search: Outperforming vector search with hybrid retrieval and…
-
Hi there! Great work - this is a very interesting line of research!
I was hoping to replicate your results on BEIR but seem to be having some trouble. For example, in both InPars v1 and v2 papers y…