-
- Deepeval: https://github.com/confident-ai/deepeval
- RAGAS: https://docs.ragas.io/en/stable/
- Figure out the best way to run this: a) in front-end using Pyodide or b) run it as back-end Flask API…
-
Hi all!
I tried applying the Evaluator to my nested list entities, but it only returns "results" and "results_by_tag".
`evaluator = Evaluator(true, predicted, tags=['FAUNA', 'FLORA'], loader="…
-
---
Author Name: **Hank** (Hank)
Original Redmine Issue: 107156, https://vlab.noaa.gov/redmine/issues/107156
Original Date: 2022-08-04
---
Example job: 2632595358329622061. I'll share the declar…
-
* **What is the current behavior?**
The current problem format does not support simulators and surrogates.
* **Describe the solution you'd like**
The problem format should be updated to support s…
-
Estoy intentando correr el programa con los datos de prueba pero no genera nada, aquí lo que sale en consola:
Selected grids: ['ISIMIP-CHELSA']
Selected variable: temperature
Exception in Tkinter…
-
error:
![image](https://github.com/user-attachments/assets/246d91f3-1d2f-4e45-b604-a47c904ad8f5)
```
File "d:\Develop\conda\envs\mkb\lib\site-packages\ragchecker\evaluator.py", line 200, in eva…
-
### User story
As a challenge manager, in order to have the submissions of my challenge reviewed and scored by evaluators, I would like evaluators to be available within the system for assignment to …
-
I'm trying to combine scenarios with google sheets for the test cases. Is this supported? If so, is there something wrong with my syntax? The below causes the following error:
```yaml
scenarios:
…
-
While executing the file in folder `Olive/examples/llama2` i got the error of
TypeError: LlamaForCausalLM.forward() got an unexpected keyword argument 'past_key_values.0.key'
while executing :
`py…
-
I suggest to implement a unit test code for this module.
`src/parser/content-evaluator-module.ts`