search

OlivierBinette / StringCompare

Efficient String Comparison Functions and Fuzzy String Matching
https://olivierbinette.github.io/StringCompare/
17 stars 2 forks source link

Create Tokenizer class #5

Closed OlivierBinette closed 2 years ago

OlivierBinette commented 2 years ago

Create a class to tokenize strings.

It should be able to tokenize strings into both sets and multisets.

OlivierBinette commented 2 years ago

Done with Python implementation.