search

datasette / datasette-embeddings

Store and query embedding vectors in Datasette tables
Apache License 2.0
4 stars 0 forks source link

Ability to run semantic search against a table with an embedding column #2

Closed simonw closed 7 months ago

simonw commented 7 months ago

I'll do this as a table action. The user will submit a query over POST (because it needs to be embedded at a cost), which will then redirect to a SQL query that returns results.

simonw commented 7 months ago

The prototype won't work for anyone else because it's using that vector.dylib extension shown in: https://github.com/datasette/datasette-embeddings/issues/1#issuecomment-2017219835

simonw commented 7 months ago

Demo:

semantic-search

simonw commented 7 months ago

I'll land this with a Python version of the comparison function (though I'm likely to upgrade that to something much faster soon, especially now I know about binary embeddings).

I need it for:

simonw commented 7 months ago

Option should not show up if no API key available.

simonw commented 7 months ago

Looks like this now:

image