Closed bpfoley closed 2 years ago
Add ftfy 6.1.1 to stop OpenAIGPTTokenizer's warning/fallback to BERT BasicTokenizer.
👍
Add ftfy 6.1.1 to stop OpenAIGPTTokenizer's warning/fallback to BERT BasicTokenizer.