defenseunicorns / leapfrogai

Production-ready Generative AI for local, cloud native, airgap, and edge deployments.
https://leapfrog.ai
Apache License 2.0
258 stars 29 forks source link

EPIC: RAG Evaluations MVP #723

Closed jalling97 closed 1 month ago

jalling97 commented 4 months ago

RAG Evaluations MVP

Description

LFAI needs a framework for evaluations in order to:

The MVP for this evaluations framework will be limited in scope to the following evaluation scenarios:

This framework can be expanded upon as LFAI develops, but this epic covers an MVP that accomplishes the above goals.

Completion Criteria

jalling97 commented 1 month ago

RAG Evals MVP Epic is now finished