Add local embedding similarity score search to query pipeline

Altinn / digdir-slack-bot

MIT License

2 stars 0 forks source link

Add local embedding similarity score search to query pipeline #55

Closed bdb-dd closed 12 months ago

bdb-dd commented 1 year ago

Description

Typesense has support for storing vector embeddings as part of the same search index collection.

Now that we are manually stuffing the context window with retrieved documents, it should be straight forward to include the results of a similarity search.

Additional Information

No response

Tasks

[x] Generate embeddings during index update
[x] Add similarity search to RAG query pipeline
[x] Add RRF if necessary
[x] Evaluate results

Acceptance Criterias

No response

bdb-dd commented 1 year ago

Similarity search deployed to test environment.

bdb-dd commented 12 months ago

ad-hoc testing shows some improvements, but more structured test method needed.