Effect of random initalisation of BERT from scratch models

jbrry / Irish-BERT

Repository to store helper scripts for creating an Irish BERT model.

Other

9 stars 0 forks source link

Open jowagner opened 3 years ago

jowagner commented 3 years ago

How much is the noise from random initialisation of the "from scratch" models? Are our development decisions reliable?