cozydev-pink / protosearch

prototype search library in pure scala
https://cozydev-pink.github.io/protosearch/
Apache License 2.0
9 stars 5 forks source link

Replace `Set` operations with "smart iterators" #189

Open valencik opened 3 months ago

valencik commented 3 months ago

Currently IndexSearcher works by iterating over the Query, gathering docs into a Set for each Query node, and combining those Sets. We want to move to an iterator based approach, similar to what PositionalIter currently does, but where query nodes form nodes in a tree of iterators working together to progressively find matches.

Screenshot 2024-03-25 at 08-01-57 Indexing 14 structured query execution - YouTube https://youtu.be/IKyhqpgyQpw?si=uXrQFK5co4oYid3K