-
I see the folder `high_confidence_ir_eval_using_genai` only has a `README.md` and it is missing the code referred to in the paper:
https://arxiv.org/abs/2407.02464
Could you please upload the code…
-
Each year the [Music Information Retrieval Evaluation Exchange](http://www.music-ir.org/mirex/wiki/MIREX_HOME) (MIREX) sponsors a number of noteworthy competitions for problems like chord, key change,…
-
Hi, nice work! Congratulations on the Outstanding Paper award!
I am a beginner in the field of information retrieval. During the process of reading the code, I found that RankGPT only provided eval…
-
This issue isn't a problem to be fixed, rather it is a record to keep track of undergraduate student's work on TREC 2024. In a series of comments, contributors can write about their work (at a high le…
-
We need to figure out what metrics we can/should use to evaluate our models, and what data is needed to evaluate them.
Here we probably will make some distinction between evaluations during prototypi…
-
**Context:** I am calling the evaluate function to calculate faithfulness and answer correctness. The dataset, which contains answer, context, question, and ground_truth, is passed as input. The evalu…
-
[X] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
what is unclear to you? What would you like to know?
…
-
Hi, thanks again for this cool work!
Where can I locate the random 1k (image, long text) pairs separated from ShareGPT4V for long-caption image-text retrieval evaluation? Can you release this data …
-
### Feature Type
- [ ] Adding new functionality to valor
- [ ] Changing existing functionality in valor
- [ ] Removing existing functionality in valor
### Problem Description
We should have supp…
-
Issue to track chunking-related research for RAG.