from bert import modeling, optimization not supported

kpe / bert-for-tf2

A Keras TensorFlow 2.0 implementation of BERT, ALBERT and adapter-BERT.

https://github.com/kpe/bert-for-tf2

MIT License

803 stars 193 forks source link

from bert import modeling, optimization not supported #71

Closed fgroesselfs closed 4 years ago

fgroesselfs commented 4 years ago

Original BERT from Google Research (https://github.com/google-research/bert) has modeling, optimization, run_pretraining. Is this not supported in bert-for-tf2?

kpe commented 4 years ago

the original google-research/bert has been coded for tensorflow 1 (which is the reason why bert-for-tf2 exists). Currently there is no example of how to do pre-training with bert-for-tf2.