tensorflow / text

Making text a first-class citizen in TensorFlow.
https://www.tensorflow.org/beta/tutorials/tensorflow_text/intro
Apache License 2.0
1.23k stars 344 forks source link

Allow fast word piece tokenizer to take in external word piece model. #1327

Open copybara-service[bot] opened 1 week ago

copybara-service[bot] commented 1 week ago

Allow fast word piece tokenizer to take in external word piece model.