lmnr-ai / lmnr

Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.
https://www.lmnr.ai
Apache License 2.0
1.19k stars 60 forks source link

Labeling queues #165

Closed dinmukhamedm closed 3 weeks ago

dinmukhamedm commented 3 weeks ago

[!IMPORTANT] Introduces labeling queues feature with database schema updates, API routes, and frontend components, along with improvements to image processing and online evaluations.

  • Labeling Queues:
    • Introduced labeling_queues and labeling_queue_items tables in schema.ts.
    • Added API routes for creating, moving, and removing items in labeling queues.
    • Implemented Labels and Queue components for managing labeling queues in the frontend.
  • Database Changes:
    • Updated spans table to include project_id in schema.ts.
    • Modified datapoints to allow target to be nullable.
    • Added migrations for new tables and schema changes.
  • API and Backend:
    • Added datapoints_to_labeling_queues function in utils.rs for queue conversion.
    • Updated create_evaluation in evaluations.rs to handle labeling queues.
    • Removed storage parameter from several functions in traces module.
  • Frontend:
    • Updated datasets and evaluations API routes to use new schema paths.
    • Added CreateQueueDialog and Queues components for managing queues.
    • Enhanced AddLabel component to support evaluator and label value pairs.
  • Miscellaneous:
    • Improved image processing by removing storage feature checks.
    • Updated paginatedGet function in utils.ts to simplify query logic.

This description was created by Ellipsis for 6e4cc4e6d31adca38eeb481a949d17e32336edca. It will automatically update as commits are pushed.