-
Hi,
Thanks for your great work! I'm trying to evaluate Octo, a vision-language-action model on LIBERO, and I have several specific questions that I hope you can help with to make sure I'm evaluati…
-
### Describe the bug
The script is overriding the default option to incorrect value
### Steps to reproduce
I have specified the phone_prefix as "+1" but it uses a random value "+243" to populate th…
-
[x ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
I checked and tested the integration of `ragas` with `Langfuse` as demonst…
-
I have tried to deploy an embedding model in AWS Sagemaker endpoint using the provided guide that uses inference.py to deploy custom code. the endpoint is created and starts but when I query the end-p…
-
If the llama3 from ollama is running on http://8.140.18.**:28275, the following code from 60th example runs fine.
```
from txtai.pipeline import LLM
llm = LLM("ollama/llama3", method="litellm", a…
-
Thanks for the great work! Would you mind share the system requirement to run inference? Can I run it on free google colab T4 gpu with 15G GPU RAM?
-
**Describe the bug**
I've defined a custom `Step` which seems to cause the `Pipeline` to get stuck in loading in Google Colab as discussed with @gabrielmbmb . Apperantly @frascuchon had the same i…
-
In my understanding, VQA is similar with the ability of zero-shot image-to-text generation mentioned in the BLIP2 paper. They all give the answer about prompt(question / natural language instructions)…
-
提问时请尽可能提供如下信息:
### 基本信息
- 你使用的**操作系统**: linux
- 你使用的**Python**版本: 3.7
- 你使用的**Tensorflow**版本: 1.14.0
- 你使用的**Keras**版本: 2.3.1
- 你使用的**bert4keras**版本: 0.10.4
- 你使用纯**keras**还是**tf.keras**: tf.…
-
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
How does RAGAS generate ground_truth in TestSetGenerat…