microsoft / onnxruntime-extensions

onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
MIT License
295 stars 80 forks source link

Return added_tokens_ by reference #711

Closed baijumeswani closed 1 month ago

baijumeswani commented 1 month ago

https://github.com/microsoft/onnxruntime-extensions/blob/c58c930739ffa481744d59a3e170895e1461b9b4/operators/tokenizer/bpe_streaming.hpp#L34 is expecting a reference, but the function does not return a reference resulting in a compiler error.

This PR addresses this issue.

wenbingl commented 1 month ago

/azp run onnxruntime-extensions.CI

azure-pipelines[bot] commented 1 month ago
Azure Pipelines successfully started running 1 pipeline(s).