tensorflow / text

Making text a first-class citizen in TensorFlow.
https://www.tensorflow.org/beta/tutorials/tensorflow_text/intro
Apache License 2.0
1.22k stars 338 forks source link

Update phrase tokenizer to handle end-punctuation. #1199

Closed copybara-service[bot] closed 1 year ago

copybara-service[bot] commented 1 year ago

Update phrase tokenizer to handle end-punctuation.