search

microsoft / onnxruntime-extensions

onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
MIT License
295 stars 80 forks source link

Implement HF WordLevel Tokenizer #662

Open HadiSDev opened 4 months ago

HadiSDev commented 4 months ago

Feature request: Implement HF WordLevel Tokenizer

wenbingl commented 4 months ago

Any link to a specific Huggingface model for an example?