microsoft / DeBERTa

The implementation of DeBERTa
MIT License
1.91k stars 216 forks source link

SPM Tokenizer #82

Open kamalkraj opened 2 years ago

kamalkraj commented 2 years ago

What is the training parameters used for the SPM tokenizer ? How to initialize a new SPM tokenizer for training from scratch?

@BigBird01

Zacchaeus00 commented 1 year ago

👀