ThioJoe / YT-Spammer-Purge

Allows you easily scan for and delete scam comments using several methods.
GNU General Public License v3.0
4.52k stars 391 forks source link

cleanup rapidfuzz usage #1029

Closed maxbachmann closed 1 year ago

maxbachmann commented 1 year ago

This is a follow up to #752 and just cleans up the usage of rapidfuzz usage a bit (I am the maintainer of both rapidfuzz and python-Levenshtein).

This removes the benchmark, since it does not really help. It is a general performance comparision between rapidfuzz and python-Levenshtein for texts which on average have a length of around 500 characters. I doubt this is very meaningful for the usage in this project. In addition python-Levenshtein uses rapidfuzz under the hood nowadays, so the only difference is an additional function call overhead: https://github.com/maxbachmann/Levenshtein/blob/fd3565434d99c552c418f968c9cc3f9707faf7a4/src/Levenshtein/__init__.py#L164