-
I am currently using the code provided in this [Colab notebook](https://colab.research.google.com/github/truera/trulens/blob/main/trulens_eval/examples/quickstart/quickstart.ipynb#scrollTo=-HyRuVA2qR7…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
when I creating test data using below code, answer column is …
-
这个issue打算放一些我个人觉得不错的工具和教程,做一个备份。
## 2024/07
- [Zapier ChatGPT Integrationsの紹介](https://speakerdeck.com/os1ma/zapier-chatgpt-integrationsnoshao-jie)
- [AWSのノーコード・ローコードLLMアプリ開発](https://s…
-
Goal:
Showcase the Haystack evaluation metrics on an example that is close to what our users are trying to do, i.e. to improve a retriever in a RAG app.
The tutorial should:
- use a dataset from …
-
### Issue you'd like to raise.
I followed Langsmith's [documentation](https://docs.smith.langchain.com/cookbook/testing-examples/using-fixed-sources#1-create-a-dataset) to create this RAG evaluation,…
-
### Feature Description
Hi, thanks for this awesome library.
I found a few (for me) inconsistencies in the evaluation across modules.
The `RetrievalEvaluator `only supports Hit Rate and MRR (an…
-
User stories:
- I would like to get a single summary score for my RAG pipeline so I can compare several pipeline configurations.
- I am not sure what evaluation metrics work best for my RAG pipeline, …
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
As titled. I'm trying to use llamaIndex for python and C++ RAG and curious if anyone has…
-
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Context**
I will use my own retrieval and rerank model, such fine-tune…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
Hello all, we are facing an issue to classify the jira tickets as FP,Owner reassignments…