[BERT] TF2 reference model

mlcommons / training

Reference implementations of MLPerf™ training benchmarks

https://mlcommons.org/en/groups/training

Apache License 2.0

1.59k stars 553 forks source link

[BERT] TF2 reference model #434

Open sgpyc opened 3 years ago

sgpyc commented 3 years ago

Reference implementation based on Google's v0.7 submission. Convergence on large batch size has issue.

sub-mod commented 3 years ago

recheck

github-actions[bot] commented 3 years ago

MLCommons CLA bot:
Thank you for your submission, we really appreciate it. We ask that you sign our MLCommons CLA and be a member before we can accept your contribution. If you are interested in membership, please contact membership@mlcommons.org .
0 out of 1 committers have signed the MLCommons CLA.
:x: @sgpyc
_{You can retrigger this bot by commenting recheck in this Pull Request}

johntran-nv commented 2 years ago

@sgpyc should this one have been merged?