kpe / bert-for-tf2

A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.
https://github.com/kpe/bert-for-tf2
MIT License
803 stars 193 forks source link

How to get MLM outputs? #52

Open sharavsambuu opened 4 years ago

sharavsambuu commented 4 years ago

Hello, great library! How to return vocabulary sized logits used in Masked Language Model instead of embeddings? Any examples?