brunoarine / org-similarity

Emacs package that helps org-mode users (re)discover similar documents
GNU General Public License v3.0
88 stars 12 forks source link

Fix Scikit-learn warning when using custom tokenizer #3

Closed brunoarine closed 1 year ago

brunoarine commented 1 year ago

Scikit-learn started issuing a user warning from 0.23+ whenever its functions were called with a custom tokenizer. The message was meant to remember the user that when custom tokenizer functions were used, token_pattern argument would be ignored.

Referenced by #2

Fixed by setting token_pattern to None.