andylokandy / simsearch-rs

A simple and lightweight fuzzy search engine that works in memory, searching for similar strings (a pun here).
MIT License
167 stars 25 forks source link

feat: dont deduplicate tokens #16

Closed andylokandy closed 5 months ago

andylokandy commented 5 months ago

Closes https://github.com/andylokandy/simsearch-rs/issues/15

This is not the cleverest solution solution. We could store the number of duplications. Anyway, this PR is sufficient for small datasets.