peleiden / daluke

A Danish-speaking language model with entity-aware self-attention
MIT License
9 stars 0 forks source link

Choose mask percentage #40

Closed sorenmulli closed 3 years ago

sorenmulli commented 3 years ago

Seems that EVERYBODY uses the original BERT choices. Lets do that