Enabled build w/o FastTokenizers

openvinotoolkit / openvino_tokenizers

OpenVINO Tokenizers extension

Apache License 2.0

20 stars 16 forks source link

Closed ilya-lavrenov closed 2 weeks ago

ilya-lavrenov commented 2 weeks ago

Required for Android and other platforms where FastTokenizers are not available.