-
- [x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I run evaluation, sometimes it works sometimes it fails wit…
-
I am currently using Ragas to evaluate my RAG application, which is built using llama index . I've encountered a few issues in the generated results:
1- When generating queries using `TestsetGenera…
-
Example:
> Q: "What do you know about ThruThink Deal Score?"
> A: "ThruThink Deal Score is a proprietary feature1.1 that evaluates multiple factors1.1 involving historical information, the transacti…
-
I run the official code example in `intro.ipynb`：
```python
import dspy
lm = dspy.LM(model='openai/default', api_key=" ", api_base=" ",temperature=0.9, max_tokens=3000,)
colbertv2_wiki17_abstrac…
-
@cyrus- are you still okay making the equality operator polymorphic? I've done this on the LLM branch for convenience, so I'll copy-paste some code here to accelerate someone doing it for real.
1. …
-
### Describe the problem
Hi all, I'm working on a project to evaluate LLM performance using Minecraft. While trying to export the saved structure, no matter how hard I try, I cannot seem to find th…
-
- [ ] [RepoHyper/README.md at main · FSoft-AI4Code/RepoHyper](https://github.com/FSoft-AI4Code/RepoHyper/blob/main/README.md?plain=1)
# RepoHyper/README.md at main · FSoft-AI4Code/RepoHyper
# Repo…
-
Hi, this is a really good and useful codebase. I tried to reproduce the results reported in the paper but failed. I used the code in `README_ESE.md`:
```
WANDB_MODE=disabled CUDA_VISIBLE_DEVICES=0…
-
Is there a way or tutorial on how to configure ollama litellm to work with skyvern? How can skyvern work with a local llm?
-
Hi,
Im studying CrewAI, i tried to create a crew to make docs about some code, when i try to use the new feature for train i got this error :
Traceback (most recent call last):
File "/home/well…