Implement RAGAS and Deepeval libraries into Aggrag as separate "Evaluator" nodes

genai-apps / aggrag

Other

7 stars 13 forks source link

Open kangkan-fractal opened 1 month ago

kangkan-fractal commented 1 month ago

Deepeval: https://github.com/confident-ai/deepeval
RAGAS: https://docs.ragas.io/en/stable/
Figure out the best way to run this: a) in front-end using Pyodide or b) run it as back-end Flask API code

ramyaFractal commented 4 weeks ago

LlamaIndex has dependencies that may not be fully supported in Pyodide.
LlamaIndex and related AI models might be too resource-intensive to run efficiently in a browser-based environment like Pyodide.

https://github.com/pyodide/pyodide/issues/4729 - This is a ticket to pyodide library to add llama-index support.