search

openvinotoolkit / openvino_tokenizers

OpenVINO Tokenizers extension
Apache License 2.0
20 stars 16 forks source link

[TF FE][Tokenizers] Avoid dependency from TF FE in tokenizers #227

Closed rkazants closed 3 weeks ago

rkazants commented 3 weeks ago

Details: Avoid dependency from TF FE in tokenizers. For this we expanded common FE API in https://github.com/openvinotoolkit/openvino/pull/26131. It should be merged after https://github.com/openvinotoolkit/openvino/pull/26131

Ticket: CVS-148101