-
**Your Question**
I am using the following code for the evaluation of my dataset. I upgraded recently from 0.1.13 to 0.1.18 to use the new metrics ( noise_sensitivity_relevant, noise_sensitiv…
-
This issue tracks https://github.com/lief-project/LIEF/issues/1110, which is currently the main blocker for switching completely to LIEF as our executable parsing abstraction layer. This would replace…
jhhcs updated
1 month ago
-
- need to support getVersion
- need to support some sample RPC calls with different params, need to document which getBlock getTransaction we support
```
pub fn faithful() {
let faithful_rpc…
-
**Your Question**
Synthetic Test Data generation doesn't output columns ['answer'] as in this [Example](https://docs.ragas.io/en/latest/concepts/testset_generation.html#example)
**Code Example…
-
# Steps to reproduce
Create a file `a.cpp` with the following content:
```cpp
#include
int main()
{
char buffer[1024];
size_t rc;
while ((rc = fread(buffer, 1, 1024, stdin)) …
-
[X ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am trying to follow [this](https://docs.ragas.io/en/stable…
-
**Describe the bug**
I want to use local llms to evaluate my rag app, I have tried Ollama and HuggingFace models but neither of them is working.
Ragas version: 0.1.11
Python version: 3.11.3
**…
-
Hi, wondering about the Mesos support in the current master HEAD.
Built with -Dspark-1.6 and configured zeppelin-env.sh as follows:
MASTER as the mesos/zk quorum
SPARK_HOME as an unpacked spark-1.6.…
-
(I'm not sure how faithful we want to be wrt to those details - so feel free to close if you think this is overkill)
DemoPassword: on entering the value "H" into the field "Password", the `KeyPress…
-
## Issue encountered
It would be good to have a system for evaluating both the relevance of the RAG and its use by the LLM in producing the response. My first intuition would be a multi-stage system …