search

mlcommons / logging

MLPerf™ logging library
https://mlcommons.org/en/groups/best-practices-benchmark-infra
Apache License 2.0
29 stars 46 forks source link

[training_4.0][gpt3][compliance checker] wrong `compile_time_mins` for gpt3 task #366

Closed ZhiyuLi-goog closed 2 months ago

ZhiyuLi-goog commented 3 months ago

The compile_time_mins is 60min in gpt3 training according to the training rule.

It isn't yet reflected in the compliance checker: in mlperf_logging/compliance_checker/training_4.0.0/common.yaml:

# `compile_time_mins` is 30min for all open tasks without covering the special case in gpt3

enqueue_config('training_4.0.0/{}_common.yaml'.format(v['value'])); s['compile_time_mins'] = 240 if v['value'] == 'open' else 30
hiwotadese commented 2 months ago

60min is specific to v3.0