Open NeoZ666 opened 2 months ago
fix: Correct TokenGazetteer and Tokenizer initialization and data formatting
This fixes the issue where incorrect parameters were causing errors during the initialization of TokenGazetteer, NLTKTokenizer.
fix: Correct TokenGazetteer and Tokenizer initialization and data formatting
This fixes the issue where incorrect parameters were causing errors during the initialization of TokenGazetteer, NLTKTokenizer.