-
Hi,I have a running question to consult you.When I do the command" python3 run.py --dataset cmu --mode sparse_to_dense",there is an error to arise.
Traceback (most recent call last):
File "run.p…
-
Use a BEIR dataset (smallest ones) to set up an end to end evaluation.
Tools
- primeqa
Experiments
- sparse-bm25 retrieval (https://github.com/primeqa/primeqa/tree/main/notebooks/ir/sparse)
…
-
-
Here is the Google Colab link I used for fine-tuning :
[https://colab.research.google.com/drive/1kiALBR1UarPobiftZmiHfwFyk7hTCDnV?usp=sharing](url)
When I fine-tune the LLM-embed for tool retriev…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
Using llama-index-vector-stores-elasticsearch, with index, how to enable hybrid search?
…
-
Build a model for ranking clarifying questions given an instruction.
See [What to ask](https://www.aicrowd.com/challenges/neurips-2022-iglu-challenge/problems/neurips-2022-iglu-challenge-nlp-task#eva…
-
想问下,我在用evaluate的过程中,先执行的对bge-m3的dense retrieval的评估,然后pooling_method不管选mean还是cls,recall20 100的分数都是0.0,非常奇怪,参数没有修改,但是用了自己的qa数据集
1. Generate Corpus Embedding
python step0-generate_embedding.py --enco…
-
作者你好,最近在复现你们的工作“Making Large Language Models A Better Foundation For Dense Retrieval”,但是在模型训练过程中发现了模型塌缩,loss降了5个点后就不降了,同时对所有句子编码后的embedding,计算相似度几乎为1。想问一下在处理ebar和ebae两个任务的label的时候是否进行了一些特殊处理呢?我的理解是句子中…
-
I'm trying to run beir/examples/retrieval/evaluation/dense/evaluate_sbert_multi_gpu.py. Doing do I end up with the below error.
Traceback (most recent call last):
File "evaluate_sbert_multi_gpu.…
-
em chào các anh ạ, em có đọc code của các anh về bài toán retrieval Văn bản pháp luật của zalo 2021, em thấy các anh sử dụng Contrastive Loss ạ. Em có một số câu hỏi mong được chỉ giáo về kinh nghiệm…