search

openvinotoolkit / openvino_tokenizers

OpenVINO Tokenizers extension
Apache License 2.0
17 stars 13 forks source link

Fixed tokenizers on Windows #142

Closed ilya-lavrenov closed 2 months ago

ilya-lavrenov commented 2 months ago

Ported https://github.com/openvinotoolkit/openvino_tokenizers/pull/141