Add PreTrainedTokenizer return_offsets_mapping

xenova / transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

https://huggingface.co/docs/transformers.js

Apache License 2.0

9.82k stars 578 forks source link

Closed Th3G33k closed 1 month ago

Th3G33k commented 1 month ago

Add PreTrainedTokenizer return_offsets_mapping

Th3G33k commented 1 month ago

Will merge to PR #750