Closed brunoarine closed 1 year ago
Scikit-learn started issuing a user warning from 0.23+ whenever its functions were called with a custom tokenizer. The message was meant to remember the user that when custom tokenizer functions were used, token_pattern argument would be ignored.
token_pattern
Referenced by #2
Fixed by setting token_pattern to None.
None
Scikit-learn started issuing a user warning from 0.23+ whenever its functions were called with a custom tokenizer. The message was meant to remember the user that when custom tokenizer functions were used,
token_pattern
argument would be ignored.Referenced by #2
Fixed by setting
token_pattern
toNone
.