Closed mtbarta closed 1 month ago
As a user, I want to store document data, not just the id, so that it can be retrieved and used downstream.
results = index.search(...) # [{id: 123, score: .98, document: {title: "the fox jumped over..", content: "the fox jumped over..."}...]
Consider what a document's schema might look like: Here's some docs from milvus. https://milvus.io/docs/multi-vector-search.md
We could support fields within the document, and iteratively add more fields to support.
We should also consider that flexible documents with dynamic schemas will be harder to optimize.
This interactions with #9 . A field could be indexed, stored, or both.
As a user, I want to store document data, not just the id, so that it can be retrieved and used downstream.
Acceptance Criteria
Documents can be flexible structures.
Consider what a document's schema might look like: Here's some docs from milvus. https://milvus.io/docs/multi-vector-search.md
We could support fields within the document, and iteratively add more fields to support.
We should also consider that flexible documents with dynamic schemas will be harder to optimize.
Document fields could be filters
This interactions with #9 . A field could be indexed, stored, or both.