-
### System Info
linux
### Who can help?
_No response_
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
- [X] An officially supported task in the codeba…
-
**Describe the bug**
Following the instructions in https://github.com/microsoft/Olive/tree/main/examples/whisper, I carried out the following steps for model optimization:
1)
```
python3 prepare…
-
[x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I have a code using the package ragas that works in a noteboo…
-
[ yes] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
LLMContextPrecisionWithoutReference not working as mention…
-
## input:
```
from ragas.metrics import LLMContextRecall, Faithfulness, FactualCorrectness
from langchain_openai.chat_models import ChatOpenAI
from ragas.llms import LangchainLLMWrapper
from raga…
-
**Describe the feature**
Typically OpenAI API's are protected with some API_KEY, so to run requests to such API's it is necessary to specify API_KEY in a call.
Is it planned to add such functionalit…
vlsav updated
3 months ago
-
**Describe the bug**
1. Summarization scores change depending on:
- the type of assessment questions being asked
- the number of assessment questions provided
- whether a developer provides the …
-
### Question
Hi, thanks for the great work! I have been trying to evaluate llava image captioning on Flickr30k, but I am not able to reproduce the results. While the original llava paper does not hav…
-
- [ ] Metadata extraction - HM
- [ ] Answering introductory questions - GK
- [x] Answering Open Chat questions - moved to genai-apps/aggrag#36
-
**Following the readme.md, I tried to run RAP for gsm8k using exllama, with the recommended instruction:**
`CUDA_VISIBLE_DEVICES=0,1 python examples/RAP/gsm8k/inference.py --base_lm exllama --exlla…