Add tonic validate metric with local model.

Marker-Inc-Korea / AutoRAG

AutoML tool for RAG

https://auto-rag.com/

Apache License 2.0

1.67k stars 145 forks source link

Open vkehfdl1 opened 5 months ago

vkehfdl1 commented 5 months ago

no_gt retrieval metrics needs large amount of LLM processing. So, use local LLM model to compute it.

ragas context precision need so much LLM calls. So, try to use tonic validate instead.

vkehfdl1 commented 5 months ago

Do this on 'aragog' branch. No plan to integrate this to a main branch.