port 'use PCRE2 fallback for RegexNormalization' to release - Githubissues

openvinotoolkit / openvino_tokenizers

OpenVINO Tokenizers extension

Apache License 2.0

20 stars 16 forks source link

port 'use PCRE2 fallback for RegexNormalization' to release #203

Closed pavel-esir closed 1 month ago

pavel-esir commented 1 month ago

cherry pick of https://github.com/openvinotoolkit/openvino_tokenizers/pull/193/