Submission rules 이해 및 submission tree 생성 스크립트 작성

[byounghak36]

아래 디렉토리 구성에 필요한 파일 조사하여 스크립트 작성

• * systems * .json # combines hardware and software stack information *하드웨어 정보* * code * / * implementation_id *모델 이름* * < Code interface with loadgen and other arbitrary stuff > *python 코드* * measurements * / * < benchmark > / *모델 이름* * < scenario > *시나리오* * __.json *찾는중* * README.md * user.conf *벤치마크 디렉토리에 위치해있음* * mlperf.conf *메인디렉토리에 위치해있음* * calibration_process.adoc * results/ * / *실행결과 첨부* * < benchmark > / * < scenario > / * performance / * run_x / # 1 run for all scenarios * mlperf_log_summary.txt * mlperf_log_detail.txt * accuracy / * mlperf_log_summary.txt * mlperf_log_detail.txt * mlperf_log_accuracy.json # truncated by truncate_accuracy_log.py if too large * accuracy.txt # stdout of reference accuracy scripts * compliance_checker_log.txt * compliance / [inference/compliance/nvidia at master · mlcommons/inference · GitHub](https://github.com/mlcommons/inference/tree/master/compliance/nvidia) *참조하여 생성* * < system_desc_id > / * < benchmark > / * < scenario > / * < test_id > / * performance / * run_1 / # 1 run for every scenario * mlperf_log_summary.txt * mlperf_log_detail.txt * accuracy / * accuracy.txt # for TEST01 only, generated from truncate_accuracy_log.py * mlperf_log_accuracy.json # only necessary for TEST01 * baseline_accuracy.txt # only for TEST01 if accuracy check fails * compliance_accuracy.txt # only for TEST01 if accuracy check fails * verify_performance.txt * verify_accuracy.txt # for TEST01 only

[byounghak36]

https://github.com/ltechkorea/mlperf-inference/tree/create_result

제출디렉토리생성 스크립트 작성