vespa-engine / vespa

AI + Data, online. https://vespa.ai
https://vespa.ai
Apache License 2.0
5.58k stars 586 forks source link

Option to skip hnsw indexing of a tensor which is unchanged from the current value #22025

Closed bratseth closed 2 years ago

bratseth commented 2 years ago

Some applications regularly reindex a corpus where much of the data is unchanged but there is not easy way to detect unchanged items from the outside.

It would be nice, and quite cheap, to do this detection inside Vespa by comparing the existing and to-be-written tensor values on the content node before reindexing.

geirst commented 2 years ago

Fixed in Vespa 8.8.4.