-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I am using this guide https://docs.llamaindex.ai/en/stable/examples/evaluation/QuestionG…
-
- Config and test
https://devblogs.microsoft.com/visualstudio/github-copilot-chat-for-visual-studio-2022/
problem virtual env between Visual Studio Code and Visual Studio Code insider
In the note…
-
### Issue you'd like to raise.
I cannot see the scores of my evaluations in LangSmith experiments dashboard
Below is the code,
```python
# Grade prompt
from langsmith import EvaluationResult…
-
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
How to calculate total tokens consumption for evaluati…
-
Sorry if I missed some logic to process the instructions.
Shouldn't `/to/path` in the instructions read `Desktop/helloExtension` instead?
-
If you've created a Wiki page, please perform a QA check on it using ChatGPT by Friday at 10 pm (11/1).
Use this prompt (or something similar) to guide your QA process:
"Conduct a QA review of …
-
Think about an automatic mechanism in which we can use the feedback we get from the users back in our evaluation dataset.
Use it as part of our dataset ground truth (good or bad )
Tasks
- [ ] D…
-
Dear AI Engineer, how can I calculate evaluation metrics such as Dice, IOU, and HD? Could you provide me with some code? I found some code online regarding this topic, but I encountered some issues wh…
-
> Please provide us with the following information:
> ---------------------------------------------------------------
### This issue is for a: (mark with an `x`)
```
- [x] bug report -> please…
-
Many evaluation tools have frameworks to allow summarising and visualising results. An example is [zeno](https://zenoml.com/docs/integrations/eleuther) for [lm-eval-harness](https://github.com/Eleuthe…