latitude-dev / latitude-llm

Work in progress

37 stars 3 forks source link

Connect evaluation with dataset #162

Closed andresgutgon closed 4 days ago

andresgutgon commented 1 week ago

What?

We want to assign a dataset to a document and evaluation

TODO

[x] Delete evaluation link from document > evaluations
[x] Parse document to fetch parameters (readMetadata)
[x] Do mapping UI between dataset headers and evaluation(s) parameters
[x] 🔥 To steps for connect + Batch
[x] Undo connect modal. Move to their own modal
[x] Move all batch modal inside evaluation detail. So evaluationId is there.
[x] Make only one evaluation selectable <FancyRadioInput />
[x] 🐛 Fix search in connect modal
[x] 🐛 Fix jumpy selectable template/evaluations list items
[x] 🐛 When loading first time evaluations and templates are not loaded
[x] 🐛 When going back selected evaluations/templates are missing visually
[x] Make work batch modal
[x] QA logs from dataset are created

Next

[ ] Investigate why Evaluation job fails. But this is not related with creating the dataset logs. That works according to my QA