DeployQL / LintDB

Vector Database with support for late interaction and token level embeddings.
https://www.lintdb.com/
Apache License 2.0
40 stars 0 forks source link

Create a Retriever abstraction #14

Closed mtbarta closed 2 months ago

mtbarta commented 2 months ago

This PR introduces the Retriever interface. Once we know what documents to score, the retriever scores them.

Now that we can swap out retrievers, we're able to implement new ways to score. This could the improvements mentioned in EMVB, or even a binary retriever.

Do note that the interface is not perfect. It feels like there is some overlap with what a query engine might need, and that work might help us figure out the best interface for retrieval.