timescale / pgvectorscale

A complement to pgvector for high performance, cost efficient vector search on large workloads.
PostgreSQL License
1.28k stars 52 forks source link

why the graph is not modified on bulk delete? #125

Open msk-apk opened 2 months ago

msk-apk commented 2 months ago

On seeing the code, bulk delete just deletes the data from node. Graph is not modified on bulk delete. Am i missing anything? Will there be any limitation as the neighbour id list is not modified? Do we need to implement the algorithm for delete as in fresh diskann?

msk-apk commented 2 months ago

any one knows the reason behind not implementing fresh diskann for delete?

cevian commented 1 month ago

The queries remain correct because we ignore deleted nodes at query-time. But it is true we don't free disk space. Ideally such cleanup would be done in the VACUUM process but it hasn't yet been implemented

msk-apk commented 1 month ago

ok that clears my question.