Pre-trained BERT model - Githubissues

alexandrainst / danlp

DaNLP is a repository for Natural Language Processing resources for the Danish Language.

BSD 3-Clause "New" or "Revised" License

196 stars 33 forks source link

Closed JensMadsen closed 4 years ago

JensMadsen commented 4 years ago

Ohøj

Two questions:

[ ] Do you still use the weights for BERT provided by XOBot or have you progressed any further? If so I can provide 100000 danish juridical documents for further pretraining if you are interested
[ ] Is it possible to download the pretrained BERT model that you use before pre-training (or do you pretrin the model provided by XoBot)?

AmaliePauli commented 4 years ago

Hej Jens,

We use the pretrained model open sourced by botxo, and it can be download here: https://github.com/botxo/nordic_bert

And lets keep the dialog through mails.:)

Amalie