Build a filter extraction evaluation pipeline

openml-labs / ai_search

RAG pipeline and summary for openml

https://openml-labs.github.io/ai_search/

1 stars 0 forks source link

Build a filter extraction evaluation pipeline #14

Open PGijsbers opened 4 months ago

PGijsbers commented 4 months ago

Build a pipeline which can evaluate the model used to extract filters (#13).

For this we also need to:

[ ] #15
[ ] Decide on metrics to evaluate the models with
[ ] Automatically report on those metrics for a given model

SubhadityaMukherjee commented 2 months ago

I believe we have partly completed this. It has not been done as a comparison with Elastic search, although most of the code to do that exists already.