BERT-Tensorflow2.x

A tensorflow 2.x BERT implementation using League of Legends myth data(Chinese).

使用Tensorflow2.x实现了BERT模型

Details

https://zhuanlan.zhihu.com/p/360420236

for Chinese readers. but the code is easy to understand and I believe English readers could see it.

any question, just issue or contact me at cmd2333@qq.com

Requirement

tensorflow 2.x
tensorboard

Usage

设置config，运行pretrain.py即可。

可使用tensorboard --logdir Logs来运行Tensorboard端口检测训练过程中损失函数变化。