search

openvinotoolkit / openvino_tokenizers

OpenVINO Tokenizers extension
Apache License 2.0
20 stars 16 forks source link

Ops Optimization #219

Closed apaniukov closed 1 month ago

apaniukov commented 1 month ago

Update VocabEncoder:

Parallelize Operations:

Add batch_size argument to benchmark.py

CVS-148967 CVS-148968