search

wagtail / wagtail-vector-index

Store Wagtail pages & Django models as embeddings in vector databases
https://wagtail-vector-index.readthedocs.io/en/latest/
MIT License
15 stars 10 forks source link

Add pg_embedding backend #5

Closed zerolab closed 10 months ago

zerolab commented 10 months ago

https://github.com/neondatabase/pg_embedding

pg_embedding is a new extension in the vector search space promissing quite a bit of speedup over pg_vector - https://neon.tech/blog/pg-embedding-extension-for-vector-search

See notes from #4

tomusher commented 10 months ago

Note that pg_embedding is no longer supported by Neon as per the repo README:

As of Sept 29, 2023, Neon is no longer committing to pg_embedding.

Support will remain in place for existing users of the extension, but we strongly encourage migrating to pgvector.

Certainly not averse to supporting it if there is demand though.

zerolab commented 10 months ago

uff, I missed that note. Now found the blog post about pgvector implementing the pg_embedding algorithm - https://neon.tech/blog/pgvector-meets-hnsw-index

Given that the next blog post about vector indexing is about pgvector, and the note above - https://neon.tech/blog/understanding-vector-search-and-hnsw-index-with-pgvector, and https://neon.tech/blog/sunset-pgembedding - it is safe to not pursue this any further