search

openvinotoolkit / openvino_tokenizers

OpenVINO Tokenizers extension
Apache License 2.0
20 stars 17 forks source link

Restore "Add RWKV Tokenizer Op"" #99

Closed mryzhov closed 5 months ago

mryzhov commented 5 months ago

Reverts openvinotoolkit/openvino_tokenizers#95