Transformer model for Portuguese language (Brazil pt_BR)
The first model trained (which is a RoBERTa model), can be found on tags page: https://github.com/rdenadai/BR-BERTo/releases/tag/0.1
The full and latest model, should be downloaded from Huggingface page: https://huggingface.co/rdenadai/BR_BERTo
Trained on a corpus of 6_993_330 sentences.
I follow the great tutorial from HuggingFace team:
How to train a new language model from scratch using Transformers and Tokenizers