NVIDIA / DeepLearningExamples

State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enterprise-grade infrastructure.
12.94k stars 3.12k forks source link

Finetune pretrained BERT with transformers library? #1330

Open mscherrmann opened 11 months ago

mscherrmann commented 11 months ago

Hi,

I am planning to pretrain a German Bert model with own data from scratch. Before I do this with your library, I like to make sure that it is possible to load and finetune the model after pre-training using the transformers library from huggingface. Is that the case?

Thank you very much in advance!