tensorflow / text

Making text a first-class citizen in TensorFlow.
https://www.tensorflow.org/beta/tutorials/tensorflow_text/intro
Apache License 2.0
1.22k stars 337 forks source link

Expose sentencepiece parallel tokenize in tf text sentencepiece wrapper. #1249

Open copybara-service[bot] opened 7 months ago

copybara-service[bot] commented 7 months ago

Expose sentencepiece parallel tokenize in tf text sentencepiece wrapper.