huggingface / swift-transformers

Swift Package to implement a transformers-like API in Swift
Apache License 2.0
727 stars 81 forks source link

NllbTokenizer #107

Open beginner-byte opened 4 months ago

beginner-byte commented 4 months ago

.unsupportedTokenizer("NllbTokenizer")

fumoboy007 commented 4 months ago

+1 Looking forward to using a CoreML implementation of the NLLB-200 model for translations in my Swift app!

I guess we would need to port NllbTokenizerFast to Swift? Maybe I can help with that. @pcuenca How difficult would it be for a n00b to do this?

beginner-byte commented 4 months ago

@fumoboy007 thank you very much