search

lmnr-ai / lmnr

Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.
https://www.lmnr.ai
Apache License 2.0
1.19k stars 60 forks source link

Fix/online-evals #164

Closed skull8888888 closed 3 weeks ago

skull8888888 commented 3 weeks ago

[!IMPORTANT] This pull request refines label value handling by using HashMap<String, f64> for precise mapping, updates backend and frontend components for better evaluator management, and enhances UI with error handling and tooltips.

  • Backend Changes:
    • Change update_span_label function in labels.rs to require value: f64 instead of Option<f64>.
    • Modify run_evaluator in evaluators.rs to use HashMap<String, f64> for label_values_map.
    • Remove setting label_job_status to RUNNING before evaluator execution in evaluators.rs.
  • Frontend Changes:
    • Update route.ts to order label classes by createdAt.
    • Add error handling for invalid label values in add-label-popover.tsx.
    • Update evaluator-editor.tsx to display expected output values from labelClass.valueMap.
    • Modify add-label.tsx to prevent duplicate label values and names.
    • Add tooltips and UI enhancements for evaluator management in add-label.tsx and add-label-popover.tsx.

This description was created by Ellipsis for 4fcb4754e5d64c8c6d8f031708597be4db934718. It will automatically update as commits are pushed.