krai / axs2mlperf

Automated KRAI X workflows for reproducing MLPerf Inference submissions
https://krai.ai
MIT License
1 stars 1 forks source link

A more detailed summary of performance runs available with 'get performance' command #54

Closed bmsgit1 closed 3 months ago

bmsgit1 commented 3 months ago
bmsgit1 commented 3 months ago

example: for a server performance run, 'get performance' would return a list of strings, something like:

['VALID :', 'target_qps=152500', '99.00_percentile_latency=7.805 milliseconds', 'target_latency=15.000 milliseconds', 'latency_cutoff_ratio=0.5203223333333333', 'Completed_samples_per_second=152498.92']
bmsgit1 commented 3 months ago

sorry @xihajun I accidentally removed saheli !!

bmsgit1 commented 3 months ago

yep I will remove those spaces and the unsightly colon after the validity!

bmsgit1 commented 3 months ago

The command output now looks like this: ['VALID', 'target_qps=152000', '99.00_percentile_latency=7.722 milliseconds', 'target_latency=15.000 milliseconds', 'latency_cutoff_ratio=0.51', 'Completed_samples_per_second=150593.59']