search

lmnr-ai / lmnr

Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.
https://www.lmnr.ai
Apache License 2.0
1.17k stars 58 forks source link

allow indexing datasets, expose semantic search as API #240

Closed dinmukhamedm closed 2 days ago

dinmukhamedm commented 2 days ago

[!IMPORTANT] Introduce semantic search API and dataset indexing logic, with frontend updates for UUID copying and dataset management.

  • Backend:
    • Add semantic_search module in app-server/src/api/v1/mod.rs and implement semantic_search API in app-server/src/api/v1/semantic_search.rs.
    • Revive dataset indexing logic in app-server/src/datasets/utils.rs and app-server/src/routes/datasets.rs.
    • Modify Datapoint structure in app-server/src/datasets/datapoints.rs to support UUIDs from raw data.
  • Frontend:
    • Add MonoWithCopy component in frontend/components/ui/mono-with-copy.tsx for copying UUIDs.
    • Update dataset management in frontend/components/dataset/dataset.tsx and frontend/components/dataset/dataset-panel.tsx to support new indexing logic.
    • Enhance semantic search node in frontend/components/pipeline/nodes/semantic-search-node.tsx to only show indexed datasets.
  • Configuration:
    • Add SEMANTIC_SEARCH_URL to frontend/.env.local.example for semantic search service configuration.
  • Miscellaneous:
    • Update ESLint configuration in frontend/.eslintrc.json to ignore generated semantic search files.

This description was created by Ellipsis for d62c6fb18a1318a8d924186065051edf2c028528. It will automatically update as commits are pushed.