Add support for tracking positions and offsets

cozydev-pink / protosearch

prototype search library in pure scala

https://cozydev-pink.github.io/protosearch/

Apache License 2.0

9 stars 6 forks source link

Add support for tracking positions and offsets #34

Open valencik opened 1 year ago

valencik commented 1 year ago

Currently we just track term counts.

This limits our ability to execute phrase queries or span queries.

Additionally, supporting positions and offsets should make highlighting easier. To highlight we should be able to create a single doc index with position and offsets (or use them in the main index if available) and use that to score the doc's terms with the query to determine what parts of the doc to highlight. (https://lucidworks.com/post/lucene-highlighter/)

valencik commented 7 months ago

Just a note, we did add support for tracking positions in https://github.com/cozydev-pink/protosearch/pull/166