Oneflow-Inc / DLPerf

DeepLearning Framework Performance Profiling Toolkit
Apache License 2.0
275 stars 27 forks source link

modify oneflow wdl testing scripts #151

Closed ccddyy416 closed 2 years ago

ccddyy416 commented 2 years ago

修改oneflow测试脚本,log信息提取文件 script ├── 300k_iters.sh # 300k iterations test, display loss and auc every 1000 iterations. ├── 500_iters.sh # 500 iterations test, display loss and auc every iteration. ├── bsz_x2.sh # Batch Size Double Test ├── fix_bsz_per_device.sh # test with different number of devices and fixing batch size per device ├── fix_total_bsz.sh # test with different number of devices and fixing total batch size ├── vocab_x2.sh # Vocabulary Size Double Test

tool ├── gpu_memory_usage.py # log maximum GPU device memory usage during testing ├──extract_info_from_log.py # extract information from log files ├── extract_info_from_log.sh # bash extract_info_from_log.py