IBM / k8s-storage-perf

This git repo will host the playbooks for collecting performance metrics for a Kubernetes persistent storage for IBM Cloud Paks
Apache License 2.0
9 stars 18 forks source link

Summary output missing results #4

Open cdingIBM opened 2 years ago

cdingIBM commented 2 years ago

When we are trying enable random read/sequential read or changing thread from 8 to 1 etc, we notice the summary in the result.csv gives inconsistent results. Sometimes no summary output is produced, or sometimes (when we disable sequential writes), we would miss random writes results and only see sequential writes s as seen below.

The expected behavior would be returning the correct summary result when 1) reads are enabled or 2) when mix of read/write is enabled/disabled based on the flag or 3) when different threads are configured.

Summary                            
Cluster Name PVC Storage Type Environment Test Name Thread Count write Mb/s Requirement            
wisc-ipa pvc-sysbench-rwx ocs vmware seqwr_1g_2 2 406.1 Recommended to meet the requirement of 226 Mb/s or higher      
wisc-ipa pvc-sysbench-rwo ocs vmware seqwr_1g_2 2 368.6 Recommended to meet the requirement of 226 Mb/s or higher      
                             
                             
Detailed Measurements                          
Cluster Name PVC Storage Type Environment Test Name Thread Count write Mb/s Writes/s read Mb/s Reads/s Total Time Latency Min Latency Avg Latency Max Latency 95th
Summary                            
Cluster Name PVC Storage Type Environment Test Name Thread Count write Mb/s Requirement            
                             
                             
Detailed Measurements                          
Cluster Name PVC Storage Type Environment Test Name Thread Count write Mb/s Writes/s read Mb/s Reads/s Total Time Latency Min Latency Avg Latency Max Latency 95th
yonglian commented 2 years ago

by design, we output the summary section only for the standard configuration as documented in the CP4D disk IO requirement page.

the right behavior of the tool should either not showing the summary section or maybe with a message like below

summary section is skipped as the standard test cases are not run.