-
There's a nice summary of common metrics for IR here: https://www.pinecone.io/learn/offline-evaluation/
Although we have many of these as part of `trec_eval`, it could make sense to have separate m…
-
We need to figure out what metrics we can/should use to evaluate our models, and what data is needed to evaluate them.
Here we probably will make some distinction between evaluations during prototypi…
-
Allocator Compliance Report: https://compliance.allocator.tech/report/f03012911/1724112525/report.md
Example 1: https://github.com/Marshall-btc/Marshall-Fil-Data-Pathway/issues/1
KYC shared in c…
-
[X] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
what is unclear to you? What would you like to know?
…
-
### Feature Type
- [ ] Adding new functionality to valor
- [ ] Changing existing functionality in valor
- [ ] Removing existing functionality in valor
### Problem Description
We should have supp…
-
I am trying to download the *time series* of an author's publication count and H-index.
On [this question](https://stackoverflow.com/questions/68963469/download-h-index-time-series-from-scopus-or-o…
-
### Is your feature request related to a problem?
There isn't a workload for semantic search that has vector data and text fields. Such workload would be beneficial for hybrid query use cases because…
-
# Purpose
The information retrieval metrics require access to a `qrels` file downloaded as part of the caller scenario (discussed in #473). This value is currently hard coded since there doesn't seem…
-
Name:
Joshua Muse
State/Affiliation:
Vermont Department of Libraries
Description of Change:
Delete data element #620 Total Number of Asynchronous Program Presentations and #630 Total Plays of…
-
[x] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
How can we use RAGAS within a CI/CD model for a RAG pi…