search

david-allison / manx-corpus-search

MIT License
3 stars 1 forks source link

feat: speed up search via Compacting Index #7

Closed david-allison closed 3 years ago

david-allison commented 3 years ago

Force merging down to 1 segment makes sense on a static index

Took about a second off the reference implementation.

I expect this will be a massive performance gain in PROD which has a lot more documents

david-allison commented 3 years ago

Before:

Returned 1322678 matches in 145 texts [64572.3695ms] for query '*'

david-allison commented 3 years ago

After

Returned 1327868 matches in 153 texts [4957.2108ms] for query '*'

Removed 1 minute... daaaamn