search

mlcommons / logging

MLPerf™ logging library
https://mlcommons.org/en/groups/best-practices-benchmark-infra
Apache License 2.0
29 stars 46 forks source link

[BERT|RNNT] Verify vocab size in compliance checker #148

Open shangw-nvidia opened 2 years ago

shangw-nvidia commented 2 years ago

The compliance checker should verify the vocab size for the bert and rnnt benchmarks.

nv-rborkar commented 2 years ago

@shangw-nvidia , @emizan76 Will the compliance checker verify this for v1.1?

shangw-nvidia commented 2 years ago

Looks like the training WG no longer needs this. Closing this issue now.

shangw-nvidia commented 2 years ago

Sorry, clarification - this issue should be deferred after v1.1, not discarded. I'm removing the v1.1 label.