Thank you for your code! If the pre-trained checkpoint of bert embeding is avaiable?

[guilk]

Hi, we train our models from scratch. You can find the trained word embeddings in our provided weights vlc_largeset.ckpt.