microsoft / kernel-memory

RAG architecture: index and query any data using LLM and natural language, track sources, show citations, asynchronous memory patterns.
https://microsoft.github.io/kernel-memory
MIT License
1.52k stars 293 forks source link

Add evaluation core functions #515

Closed kbeaugrand closed 4 months ago

kbeaugrand commented 4 months ago

Motivation and Context (Why the change? What's the scenario?)

First code commit for evaluation of KM memory by using RAGAS methodology.

High level description (Approach, Design)

Add Test set generation with SK, by using KM index for existing data. Add Test set evaluation of KM by using SK.