krai / axs2mlperf

Automated KRAI X workflows for reproducing MLPerf Inference submissions
https://krai.ai
MIT License
1 stars 1 forks source link

Move `param_to_conf_pair` to `data_axs.json` in `base_loadgen_program` #21

Closed maria-18-git closed 1 year ago

maria-18-git commented 1 year ago

We need to move param_to_conf_pair dictionary to data_axs.json in base_loadgen_program and use it as input parameter.

maria-18-git commented 1 year ago

Check:

maria@chai ~/work_collection/axs2mlperf/base_loadgen_program (master *=)$ time axs byquery loadgen_output,task=image_classification,framework=onnxrt,loadgen_scenario=Offline,loadgen_mode=PerformanceOnly,model_name=resnet50,loadgen_dataset_size=20,loadgen_buffer_size=100,execution_device=cpu,loadgen_target_qps=130,loadgen_min_duration_s=240,loadgen_max_duration_s=240
...
['^', 'byname', 'generated_by_image_classification_using_onnxrt_loadgen_on_get_c5b93ba6360d485ea2798a9d7f2bed53']
real    5m16.167s
user    125m56.810s
sys     0m6.423s

user.conf:

maria@chai ~/work_collection/axs2mlperf/base_loadgen_program (master *=)$ cat ~/work_collection/generated_by_image_classification_using_onnxrt_loadgen_on_get_c5b93ba6360d485ea2798a9d7f2bed53/user.conf
resnet50.Offline.performance_sample_count_override = 100
resnet50.Offline.target_qps = 130
resnet50.Offline.min_duration = 240000
resnet50.Offline.max_duration = 240000
maria-18-git commented 1 year ago

Commit: Move param_to_conf_pair to data_axs.json in base_loadgen_program

maria-18-git commented 1 year ago

Status: Done.