Split implementation without FastTokenizer (to master)

openvinotoolkit / openvino_tokenizers

OpenVINO Tokenizers extension

Apache License 2.0

20 stars 16 forks source link

Closed pavel-esir closed 1 month ago

pavel-esir commented 1 month ago

Ticket: CVS-136469

pavel-esir commented 1 month ago

PR is ready for review. @apaniukov please take a look