-
Hi @LarFii ,
Thank you for releasing this interesting work.
Maybe I have missed something, but I am confused about the experimental results in the preprint manuscript.
For example, in Table 1,…
-
### Describe the issue
First of all, thanks for your great work on building SWE Bench!
I am currently doing survey on some projects related to RAG.
About the RAG baselines stated [here](https://g…
dlibk updated
2 weeks ago
-
> Please provide us with the following information:
> ---------------------------------------------------------------
### This issue is for a: (mark with an `x`)
```
- [ ] bug report -> please…
-
Hi there,
I encountered this problem but I do not really know how to fix that. I just built up my evaluate.py which is under ragnews folder. Same code as Mike did in class.
```
'''
This file…
-
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
what is unclear to you? What would you like to know?
…
-
According to the section 3.3 of ARES paper:
"Ranking RAG Systems with Confidence Intervals
Once we have prepared our LLM judges, we need to use them to score and rank the competing RAG systems. …
-
[X] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I have a locally hosted LLM which I am intending to use as a jud…
-
Issue is to track Re-Ranker evaluation + information relating to them.
Uhhh.... seems like this is a no-brainer... https://pypi.org/project/FlashRank/
Code:
- https://github.com/answerdotai/rer…
-
This story is part of epic #4
## User Story
As a **engineer**, I would like **2,000 qa_pairs** so that **I can benchmark the rag system and improve its performance as I run experiments**.
## Detail…
-
Paper title: Active Retrieval Augmented Generation ([link to paper](https://arxiv.org/abs/2305.06983))
Estimated time to complete the review: by 08/28/23
If you are new to Manifold, here are some he…