search

microsoft / onnxruntime-extensions

onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
MIT License
323 stars 84 forks source link

Add Fairseq decoder support #612

Closed sayanshaw24 closed 10 months ago

sayanshaw24 commented 10 months ago

Adds support for decoding tokenized text from Fairseq model tokenizers such as XLMRobertaTokenizer.

Validation