Closed pmrowla closed 1 year ago
Fri May 5 06:38:59 UTC 2023 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.39.0] 1.2986 (1.18) 1.3340 (1.20) 1.3114 (1.18) 0.0137 (2.90) 1.3096 (1.18) 0.0154 (2.45) 1;0 0.7625 (0.84) 5 3 test_plots-plots-diff[2.40.0] 1.2700 (1.15) 1.3188 (1.18) 1.2948 (1.17) 0.0181 (3.84) 1.2921 (1.17) 0.0231 (3.67) 2;0 0.7723 (0.86) 5 3 test_plots-plots-diff[2.41.1] 1.2769 (1.16) 1.3108 (1.18) 1.2891 (1.16) 0.0128 (2.72) 1.2851 (1.16) 0.0122 (1.94) 1;0 0.7757 (0.86) 5 3 test_plots-plots-diff[2.45.0] 1.1754 (1.07) 1.2000 (1.08) 1.1879 (1.07) 0.0095 (2.02) 1.1879 (1.07) 0.0143 (2.26) 2;0 0.8419 (0.93) 5 3 test_plots-plots-diff[main] 1.1008 (1.0) 1.1135 (1.0) 1.1072 (1.0) 0.0047 (1.0) 1.1076 (1.0) 0.0063 (1.0) 2;0 0.9032 (1.0) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.39.0] 2.3406 (1.57) 2.3965 (1.57) 2.3638 (1.57) 0.0239 (1.50) 2.3651 (1.58) 0.0402 (1.78) 1;0 0.4231 (0.64) 5 3 test_plots-plots-diff-json[2.40.0] 2.3676 (1.59) 2.4502 (1.60) 2.4150 (1.60) 0.0357 (2.25) 2.4215 (1.61) 0.0626 (2.77) 1;0 0.4141 (0.62) 5 3 test_plots-plots-diff-json[2.41.1] 2.3147 (1.55) 2.3628 (1.54) 2.3468 (1.56) 0.0199 (1.25) 2.3528 (1.57) 0.0272 (1.20) 1;0 0.4261 (0.64) 5 3 test_plots-plots-diff-json[2.45.0] 2.1219 (1.42) 2.1702 (1.42) 2.1474 (1.43) 0.0206 (1.30) 2.1507 (1.43) 0.0363 (1.61) 2;0 0.4657 (0.70) 5 3 test_plots-plots-diff-json[main] 1.4896 (1.0) 1.5298 (1.0) 1.5060 (1.0) 0.0159 (1.0) 1.5006 (1.0) 0.0226 (1.0) 2;0 0.6640 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_plots-plots-show[2.39.0] 868.4098 (1.05) 906.4192 (1.07) 885.1382 (1.05) 15.9281 (2.27) 879.8483 (1.05) 26.4013 (2.57) 2;0 1.1298 (0.95) 5 3 test_plots-plots-show[2.40.0] 852.0077 (1.03) 902.7386 (1.06) 881.5889 (1.05) 20.5426 (2.93) 888.6547 (1.06) 31.5010 (3.07) 2;0 1.1343 (0.95) 5 3 test_plots-plots-show[2.41.1] 856.9232 (1.03) 873.1108 (1.03) 864.2100 (1.03) 7.0015 (1.0) 862.4981 (1.03) 12.3191 (1.20) 2;0 1.1571 (0.97) 5 3 test_plots-plots-show[2.45.0] 829.9697 (1.0) 849.8000 (1.0) 839.6858 (1.0) 7.4835 (1.07) 838.3322 (1.0) 10.2629 (1.0) 2;0 1.1909 (1.0) 5 3 test_plots-plots-show[main] 904.3788 (1.09) 931.6641 (1.10) 917.1456 (1.09) 10.9240 (1.56) 912.9605 (1.09) 16.4890 (1.61) 2;0 1.0903 (0.92) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.39.0] 1.4605 (1.33) 1.4859 (1.31) 1.4766 (1.32) 0.0102 (1.33) 1.4801 (1.31) 0.0139 (2.45) 1;0 0.6772 (0.76) 5 3 test_plots-plots-show-json[2.40.0] 1.4180 (1.29) 1.4768 (1.30) 1.4537 (1.30) 0.0221 (2.89) 1.4553 (1.29) 0.0241 (4.25) 2;0 0.6879 (0.77) 5 3 test_plots-plots-show-json[2.41.1] 1.4196 (1.29) 1.4741 (1.30) 1.4454 (1.29) 0.0209 (2.73) 1.4401 (1.28) 0.0295 (5.20) 2;0 0.6918 (0.78) 5 3 test_plots-plots-show-json[2.45.0] 1.3601 (1.23) 1.3789 (1.22) 1.3654 (1.22) 0.0076 (1.0) 1.3630 (1.21) 0.0057 (1.0) 1;1 0.7324 (0.82) 5 3 test_plots-plots-show-json[main] 1.1019 (1.0) 1.1335 (1.0) 1.1204 (1.0) 0.0147 (1.93) 1.1273 (1.0) 0.0265 (4.68) 1;0 0.8925 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.18.1] 1.3633 (1.0) 1.3633 (1.0) 1.3633 (1.0) 0.0000 (1.0) 1.3633 (1.0) 0.0000 (1.0) 0;0 0.7335 (1.0) 1 1 test_data_status_all_flags-data-changed[2.39.0] 1.4001 (1.03) 1.4001 (1.03) 1.4001 (1.03) 0.0000 (1.0) 1.4001 (1.03) 0.0000 (1.0) 0;0 0.7142 (0.97) 1 1 test_data_status_all_flags-data-changed[2.40.0] 1.4538 (1.07) 1.4538 (1.07) 1.4538 (1.07) 0.0000 (1.0) 1.4538 (1.07) 0.0000 (1.0) 0;0 0.6879 (0.94) 1 1 test_data_status_all_flags-data-changed[2.41.1] 1.4295 (1.05) 1.4295 (1.05) 1.4295 (1.05) 0.0000 (1.0) 1.4295 (1.05) 0.0000 (1.0) 0;0 0.6995 (0.95) 1 1 test_data_status_all_flags-data-changed[2.45.0] 1.6196 (1.19) 1.6196 (1.19) 1.6196 (1.19) 0.0000 (1.0) 1.6196 (1.19) 0.0000 (1.0) 0;0 0.6174 (0.84) 1 1 test_data_status_all_flags-data-changed[main] 1.4872 (1.09) 1.4872 (1.09) 1.4872 (1.09) 0.0000 (1.0) 1.4872 (1.09) 0.0000 (1.0) 0;0 0.6724 (0.92) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.18.1] 1.4133 (1.02) 1.4133 (1.02) 1.4133 (1.02) 0.0000 (1.0) 1.4133 (1.02) 0.0000 (1.0) 0;0 0.7076 (0.98) 1 1 test_data_status_all_flags-data-changed-noop[2.39.0] 1.4068 (1.01) 1.4068 (1.01) 1.4068 (1.01) 0.0000 (1.0) 1.4068 (1.01) 0.0000 (1.0) 0;0 0.7108 (0.99) 1 1 test_data_status_all_flags-data-changed-noop[2.40.0] 1.3899 (1.0) 1.3899 (1.0) 1.3899 (1.0) 0.0000 (1.0) 1.3899 (1.0) 0.0000 (1.0) 0;0 0.7195 (1.0) 1 1 test_data_status_all_flags-data-changed-noop[2.41.1] 1.5361 (1.11) 1.5361 (1.11) 1.5361 (1.11) 0.0000 (1.0) 1.5361 (1.11) 0.0000 (1.0) 0;0 0.6510 (0.90) 1 1 test_data_status_all_flags-data-changed-noop[2.45.0] 1.5521 (1.12) 1.5521 (1.12) 1.5521 (1.12) 0.0000 (1.0) 1.5521 (1.12) 0.0000 (1.0) 0;0 0.6443 (0.90) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.4422 (1.04) 1.4422 (1.04) 1.4422 (1.04) 0.0000 (1.0) 1.4422 (1.04) 0.0000 (1.0) 0;0 0.6934 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.18.1] 2.3479 (1.0) 2.3479 (1.0) 2.3479 (1.0) 0.0000 (1.0) 2.3479 (1.0) 0.0000 (1.0) 0;0 0.4259 (1.0) 1 1 test_data_status_all_flags-data-new[2.39.0] 2.5439 (1.08) 2.5439 (1.08) 2.5439 (1.08) 0.0000 (1.0) 2.5439 (1.08) 0.0000 (1.0) 0;0 0.3931 (0.92) 1 1 test_data_status_all_flags-data-new[2.40.0] 2.4752 (1.05) 2.4752 (1.05) 2.4752 (1.05) 0.0000 (1.0) 2.4752 (1.05) 0.0000 (1.0) 0;0 0.4040 (0.95) 1 1 test_data_status_all_flags-data-new[2.41.1] 2.5311 (1.08) 2.5311 (1.08) 2.5311 (1.08) 0.0000 (1.0) 2.5311 (1.08) 0.0000 (1.0) 0;0 0.3951 (0.93) 1 1 test_data_status_all_flags-data-new[2.45.0] 2.4205 (1.03) 2.4205 (1.03) 2.4205 (1.03) 0.0000 (1.0) 2.4205 (1.03) 0.0000 (1.0) 0;0 0.4131 (0.97) 1 1 test_data_status_all_flags-data-new[main] 2.4879 (1.06) 2.4879 (1.06) 2.4879 (1.06) 0.0000 (1.0) 2.4879 (1.06) 0.0000 (1.0) 0;0 0.4020 (0.94) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.18.1] 1.3034 (1.0) 1.3034 (1.0) 1.3034 (1.0) 0.0000 (1.0) 1.3034 (1.0) 0.0000 (1.0) 0;0 0.7672 (1.0) 1 1 test_data_status_all_flags-data-noop[2.39.0] 1.3779 (1.06) 1.3779 (1.06) 1.3779 (1.06) 0.0000 (1.0) 1.3779 (1.06) 0.0000 (1.0) 0;0 0.7257 (0.95) 1 1 test_data_status_all_flags-data-noop[2.40.0] 1.4340 (1.10) 1.4340 (1.10) 1.4340 (1.10) 0.0000 (1.0) 1.4340 (1.10) 0.0000 (1.0) 0;0 0.6974 (0.91) 1 1 test_data_status_all_flags-data-noop[2.41.1] 1.4169 (1.09) 1.4169 (1.09) 1.4169 (1.09) 0.0000 (1.0) 1.4169 (1.09) 0.0000 (1.0) 0;0 0.7058 (0.92) 1 1 test_data_status_all_flags-data-noop[2.45.0] 1.4187 (1.09) 1.4187 (1.09) 1.4187 (1.09) 0.0000 (1.0) 1.4187 (1.09) 0.0000 (1.0) 0;0 0.7049 (0.92) 1 1 test_data_status_all_flags-data-noop[main] 1.4771 (1.13) 1.4771 (1.13) 1.4771 (1.13) 0.0000 (1.0) 1.4771 (1.13) 0.0000 (1.0) 0;0 0.6770 (0.88) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.11.0] 7.8283 (1.94) 7.8283 (1.94) 7.8283 (1.94) 0.0000 (1.0) 7.8283 (1.94) 0.0000 (1.0) 0;0 0.1277 (0.52) 1 1 test_sharing-add[2.18.1] 6.7418 (1.67) 6.7418 (1.67) 6.7418 (1.67) 0.0000 (1.0) 6.7418 (1.67) 0.0000 (1.0) 0;0 0.1483 (0.60) 1 1 test_sharing-add[2.39.0] 6.2038 (1.53) 6.2038 (1.53) 6.2038 (1.53) 0.0000 (1.0) 6.2038 (1.53) 0.0000 (1.0) 0;0 0.1612 (0.65) 1 1 test_sharing-add[2.40.0] 6.1229 (1.51) 6.1229 (1.51) 6.1229 (1.51) 0.0000 (1.0) 6.1229 (1.51) 0.0000 (1.0) 0;0 0.1633 (0.66) 1 1 test_sharing-add[2.41.1] 6.1929 (1.53) 6.1929 (1.53) 6.1929 (1.53) 0.0000 (1.0) 6.1929 (1.53) 0.0000 (1.0) 0;0 0.1615 (0.65) 1 1 test_sharing-add[2.45.0] 4.1419 (1.02) 4.1419 (1.02) 4.1419 (1.02) 0.0000 (1.0) 4.1419 (1.02) 0.0000 (1.0) 0;0 0.2414 (0.98) 1 1 test_sharing-add[2.6.3] 8.8285 (2.18) 8.8285 (2.18) 8.8285 (2.18) 0.0000 (1.0) 8.8285 (2.18) 0.0000 (1.0) 0;0 0.1133 (0.46) 1 1 test_sharing-add[main] 4.0439 (1.0) 4.0439 (1.0) 4.0439 (1.0) 0.0000 (1.0) 4.0439 (1.0) 0.0000 (1.0) 0;0 0.2473 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.11.0] 3.5221 (3.70) 3.5221 (3.70) 3.5221 (3.70) 0.0000 (1.0) 3.5221 (3.70) 0.0000 (1.0) 0;0 0.2839 (0.27) 1 1 test_sharing-add-noop[2.18.1] 3.7205 (3.91) 3.7205 (3.91) 3.7205 (3.91) 0.0000 (1.0) 3.7205 (3.91) 0.0000 (1.0) 0;0 0.2688 (0.26) 1 1 test_sharing-add-noop[2.39.0] 2.6022 (2.73) 2.6022 (2.73) 2.6022 (2.73) 0.0000 (1.0) 2.6022 (2.73) 0.0000 (1.0) 0;0 0.3843 (0.37) 1 1 test_sharing-add-noop[2.40.0] 2.6026 (2.73) 2.6026 (2.73) 2.6026 (2.73) 0.0000 (1.0) 2.6026 (2.73) 0.0000 (1.0) 0;0 0.3842 (0.37) 1 1 test_sharing-add-noop[2.41.1] 2.5032 (2.63) 2.5032 (2.63) 2.5032 (2.63) 0.0000 (1.0) 2.5032 (2.63) 0.0000 (1.0) 0;0 0.3995 (0.38) 1 1 test_sharing-add-noop[2.45.0] 2.6532 (2.79) 2.6532 (2.79) 2.6532 (2.79) 0.0000 (1.0) 2.6532 (2.79) 0.0000 (1.0) 0;0 0.3769 (0.36) 1 1 test_sharing-add-noop[2.6.3] 0.9525 (1.0) 0.9525 (1.0) 0.9525 (1.0) 0.0000 (1.0) 0.9525 (1.0) 0.0000 (1.0) 0;0 1.0499 (1.0) 1 1 test_sharing-add-noop[main] 2.6830 (2.82) 2.6830 (2.82) 2.6830 (2.82) 0.0000 (1.0) 2.6830 (2.82) 0.0000 (1.0) 0;0 0.3727 (0.36) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.11.0] 537.1340 (1.26) 537.1340 (1.26) 537.1340 (1.26) 0.0000 (1.0) 537.1340 (1.26) 0.0000 (1.0) 0;0 1.8617 (0.79) 1 1 test_sharing-checkout-noop[2.18.1] 609.1021 (1.43) 609.1021 (1.43) 609.1021 (1.43) 0.0000 (1.0) 609.1021 (1.43) 0.0000 (1.0) 0;0 1.6418 (0.70) 1 1 test_sharing-checkout-noop[2.39.0] 635.7840 (1.49) 635.7840 (1.49) 635.7840 (1.49) 0.0000 (1.0) 635.7840 (1.49) 0.0000 (1.0) 0;0 1.5729 (0.67) 1 1 test_sharing-checkout-noop[2.40.0] 645.4561 (1.51) 645.4561 (1.51) 645.4561 (1.51) 0.0000 (1.0) 645.4561 (1.51) 0.0000 (1.0) 0;0 1.5493 (0.66) 1 1 test_sharing-checkout-noop[2.41.1] 618.2403 (1.45) 618.2403 (1.45) 618.2403 (1.45) 0.0000 (1.0) 618.2403 (1.45) 0.0000 (1.0) 0;0 1.6175 (0.69) 1 1 test_sharing-checkout-noop[2.45.0] 652.5299 (1.53) 652.5299 (1.53) 652.5299 (1.53) 0.0000 (1.0) 652.5299 (1.53) 0.0000 (1.0) 0;0 1.5325 (0.65) 1 1 test_sharing-checkout-noop[2.6.3] 426.3021 (1.0) 426.3021 (1.0) 426.3021 (1.0) 0.0000 (1.0) 426.3021 (1.0) 0.0000 (1.0) 0;0 2.3458 (1.0) 1 1 test_sharing-checkout-noop[main] 693.4266 (1.63) 693.4266 (1.63) 693.4266 (1.63) 0.0000 (1.0) 693.4266 (1.63) 0.0000 (1.0) 0;0 1.4421 (0.61) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-pull': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[2.11.0] 7.4587 (1.26) 7.4587 (1.26) 7.4587 (1.26) 0.0000 (1.0) 7.4587 (1.26) 0.0000 (1.0) 0;0 0.1341 (0.79) 1 1 test_sharing-pull[2.18.1] 7.6106 (1.29) 7.6106 (1.29) 7.6106 (1.29) 0.0000 (1.0) 7.6106 (1.29) 0.0000 (1.0) 0;0 0.1314 (0.78) 1 1 test_sharing-pull[2.39.0] 8.9013 (1.51) 8.9013 (1.51) 8.9013 (1.51) 0.0000 (1.0) 8.9013 (1.51) 0.0000 (1.0) 0;0 0.1123 (0.66) 1 1 test_sharing-pull[2.40.0] 8.8583 (1.50) 8.8583 (1.50) 8.8583 (1.50) 0.0000 (1.0) 8.8583 (1.50) 0.0000 (1.0) 0;0 0.1129 (0.67) 1 1 test_sharing-pull[2.41.1] 8.5605 (1.45) 8.5605 (1.45) 8.5605 (1.45) 0.0000 (1.0) 8.5605 (1.45) 0.0000 (1.0) 0;0 0.1168 (0.69) 1 1 test_sharing-pull[2.45.0] 6.9793 (1.18) 6.9793 (1.18) 6.9793 (1.18) 0.0000 (1.0) 6.9793 (1.18) 0.0000 (1.0) 0;0 0.1433 (0.85) 1 1 test_sharing-pull[2.6.3] 5.9116 (1.0) 5.9116 (1.0) 5.9116 (1.0) 0.0000 (1.0) 5.9116 (1.0) 0.0000 (1.0) 0;0 0.1692 (1.0) 1 1 test_sharing-pull[main] 6.9024 (1.17) 6.9024 (1.17) 6.9024 (1.17) 0.0000 (1.0) 6.9024 (1.17) 0.0000 (1.0) 0;0 0.1449 (0.86) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[2.11.0] 579.8741 (1.27) 579.8741 (1.27) 579.8741 (1.27) 0.0000 (1.0) 579.8741 (1.27) 0.0000 (1.0) 0;0 1.7245 (0.79) 1 1 test_sharing-pull-noop[2.18.1] 655.0165 (1.44) 655.0165 (1.44) 655.0165 (1.44) 0.0000 (1.0) 655.0165 (1.44) 0.0000 (1.0) 0;0 1.5267 (0.70) 1 1 test_sharing-pull-noop[2.39.0] 668.7716 (1.47) 668.7716 (1.47) 668.7716 (1.47) 0.0000 (1.0) 668.7716 (1.47) 0.0000 (1.0) 0;0 1.4953 (0.68) 1 1 test_sharing-pull-noop[2.40.0] 668.8598 (1.47) 668.8598 (1.47) 668.8598 (1.47) 0.0000 (1.0) 668.8598 (1.47) 0.0000 (1.0) 0;0 1.4951 (0.68) 1 1 test_sharing-pull-noop[2.41.1] 639.6013 (1.40) 639.6013 (1.40) 639.6013 (1.40) 0.0000 (1.0) 639.6013 (1.40) 0.0000 (1.0) 0;0 1.5635 (0.71) 1 1 test_sharing-pull-noop[2.45.0] 710.4636 (1.56) 710.4636 (1.56) 710.4636 (1.56) 0.0000 (1.0) 710.4636 (1.56) 0.0000 (1.0) 0;0 1.4075 (0.64) 1 1 test_sharing-pull-noop[2.6.3] 456.2407 (1.0) 456.2407 (1.0) 456.2407 (1.0) 0.0000 (1.0) 456.2407 (1.0) 0.0000 (1.0) 0;0 2.1918 (1.0) 1 1 test_sharing-pull-noop[main] 749.6804 (1.64) 749.6804 (1.64) 749.6804 (1.64) 0.0000 (1.0) 749.6804 (1.64) 0.0000 (1.0) 0;0 1.3339 (0.61) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-push': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.11.0] 4.1481 (1.26) 4.1481 (1.26) 4.1481 (1.26) 0.0000 (1.0) 4.1481 (1.26) 0.0000 (1.0) 0;0 0.2411 (0.79) 1 1 test_sharing-push[2.18.1] 4.1025 (1.25) 4.1025 (1.25) 4.1025 (1.25) 0.0000 (1.0) 4.1025 (1.25) 0.0000 (1.0) 0;0 0.2438 (0.80) 1 1 test_sharing-push[2.39.0] 5.2866 (1.61) 5.2866 (1.61) 5.2866 (1.61) 0.0000 (1.0) 5.2866 (1.61) 0.0000 (1.0) 0;0 0.1892 (0.62) 1 1 test_sharing-push[2.40.0] 5.2660 (1.61) 5.2660 (1.61) 5.2660 (1.61) 0.0000 (1.0) 5.2660 (1.61) 0.0000 (1.0) 0;0 0.1899 (0.62) 1 1 test_sharing-push[2.41.1] 5.1782 (1.58) 5.1782 (1.58) 5.1782 (1.58) 0.0000 (1.0) 5.1782 (1.58) 0.0000 (1.0) 0;0 0.1931 (0.63) 1 1 test_sharing-push[2.45.0] 3.5424 (1.08) 3.5424 (1.08) 3.5424 (1.08) 0.0000 (1.0) 3.5424 (1.08) 0.0000 (1.0) 0;0 0.2823 (0.93) 1 1 test_sharing-push[2.6.3] 3.2805 (1.0) 3.2805 (1.0) 3.2805 (1.0) 0.0000 (1.0) 3.2805 (1.0) 0.0000 (1.0) 0;0 0.3048 (1.0) 1 1 test_sharing-push[main] 3.5251 (1.07) 3.5251 (1.07) 3.5251 (1.07) 0.0000 (1.0) 3.5251 (1.07) 0.0000 (1.0) 0;0 0.2837 (0.93) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.11.0] 477.2861 (1.10) 477.2861 (1.10) 477.2861 (1.10) 0.0000 (1.0) 477.2861 (1.10) 0.0000 (1.0) 0;0 2.0952 (0.91) 1 1 test_sharing-push-noop[2.18.1] 482.7742 (1.11) 482.7742 (1.11) 482.7742 (1.11) 0.0000 (1.0) 482.7742 (1.11) 0.0000 (1.0) 0;0 2.0714 (0.90) 1 1 test_sharing-push-noop[2.39.0] 521.8257 (1.20) 521.8257 (1.20) 521.8257 (1.20) 0.0000 (1.0) 521.8257 (1.20) 0.0000 (1.0) 0;0 1.9163 (0.83) 1 1 test_sharing-push-noop[2.40.0] 520.5276 (1.20) 520.5276 (1.20) 520.5276 (1.20) 0.0000 (1.0) 520.5276 (1.20) 0.0000 (1.0) 0;0 1.9211 (0.84) 1 1 test_sharing-push-noop[2.41.1] 501.1176 (1.15) 501.1176 (1.15) 501.1176 (1.15) 0.0000 (1.0) 501.1176 (1.15) 0.0000 (1.0) 0;0 1.9955 (0.87) 1 1 test_sharing-push-noop[2.45.0] 513.8830 (1.18) 513.8830 (1.18) 513.8830 (1.18) 0.0000 (1.0) 513.8830 (1.18) 0.0000 (1.0) 0;0 1.9460 (0.85) 1 1 test_sharing-push-noop[2.6.3] 435.0849 (1.0) 435.0849 (1.0) 435.0849 (1.0) 0.0000 (1.0) 435.0849 (1.0) 0.0000 (1.0) 0;0 2.2984 (1.0) 1 1 test_sharing-push-noop[main] 580.2418 (1.33) 580.2418 (1.33) 580.2418 (1.33) 0.0000 (1.0) 580.2418 (1.33) 0.0000 (1.0) 0;0 1.7234 (0.75) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.11.0] 5.2516 (1.36) 5.2516 (1.36) 5.2516 (1.36) 0.0000 (1.0) 5.2516 (1.36) 0.0000 (1.0) 0;0 0.1904 (0.73) 1 1 test_get-get[2.18.1] 4.8558 (1.26) 4.8558 (1.26) 4.8558 (1.26) 0.0000 (1.0) 4.8558 (1.26) 0.0000 (1.0) 0;0 0.2059 (0.79) 1 1 test_get-get[2.39.0] 3.8983 (1.01) 3.8983 (1.01) 3.8983 (1.01) 0.0000 (1.0) 3.8983 (1.01) 0.0000 (1.0) 0;0 0.2565 (0.99) 1 1 test_get-get[2.40.0] 3.8572 (1.0) 3.8572 (1.0) 3.8572 (1.0) 0.0000 (1.0) 3.8572 (1.0) 0.0000 (1.0) 0;0 0.2593 (1.0) 1 1 test_get-get[2.41.1] 4.0871 (1.06) 4.0871 (1.06) 4.0871 (1.06) 0.0000 (1.0) 4.0871 (1.06) 0.0000 (1.0) 0;0 0.2447 (0.94) 1 1 test_get-get[2.45.0] 3.8898 (1.01) 3.8898 (1.01) 3.8898 (1.01) 0.0000 (1.0) 3.8898 (1.01) 0.0000 (1.0) 0;0 0.2571 (0.99) 1 1 test_get-get[2.6.3] 3.9848 (1.03) 3.9848 (1.03) 3.9848 (1.03) 0.0000 (1.0) 3.9848 (1.03) 0.0000 (1.0) 0;0 0.2510 (0.97) 1 1 test_get-get[main] 5.2861 (1.37) 5.2861 (1.37) 5.2861 (1.37) 0.0000 (1.0) 5.2861 (1.37) 0.0000 (1.0) 0;0 0.1892 (0.73) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.11.0] 1.2451 (1.37) 1.2451 (1.37) 1.2451 (1.37) 0.0000 (1.0) 1.2451 (1.37) 0.0000 (1.0) 0;0 0.8031 (0.73) 1 1 test_checkout_symlink-checkout[2.18.1] 1.2263 (1.35) 1.2263 (1.35) 1.2263 (1.35) 0.0000 (1.0) 1.2263 (1.35) 0.0000 (1.0) 0;0 0.8154 (0.74) 1 1 test_checkout_symlink-checkout[2.39.0] 1.2421 (1.37) 1.2421 (1.37) 1.2421 (1.37) 0.0000 (1.0) 1.2421 (1.37) 0.0000 (1.0) 0;0 0.8051 (0.73) 1 1 test_checkout_symlink-checkout[2.40.0] 1.2227 (1.35) 1.2227 (1.35) 1.2227 (1.35) 0.0000 (1.0) 1.2227 (1.35) 0.0000 (1.0) 0;0 0.8178 (0.74) 1 1 test_checkout_symlink-checkout[2.41.1] 1.2264 (1.35) 1.2264 (1.35) 1.2264 (1.35) 0.0000 (1.0) 1.2264 (1.35) 0.0000 (1.0) 0;0 0.8154 (0.74) 1 1 test_checkout_symlink-checkout[2.45.0] 1.4696 (1.62) 1.4696 (1.62) 1.4696 (1.62) 0.0000 (1.0) 1.4696 (1.62) 0.0000 (1.0) 0;0 0.6805 (0.62) 1 1 test_checkout_symlink-checkout[2.6.3] 0.9089 (1.0) 0.9089 (1.0) 0.9089 (1.0) 0.0000 (1.0) 0.9089 (1.0) 0.0000 (1.0) 0;0 1.1003 (1.0) 1 1 test_checkout_symlink-checkout[main] 1.5363 (1.69) 1.5363 (1.69) 1.5363 (1.69) 0.0000 (1.0) 1.5363 (1.69) 0.0000 (1.0) 0;0 0.6509 (0.59) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.11.0] 494.0992 (1.31) 494.0992 (1.31) 494.0992 (1.31) 0.0000 (1.0) 494.0992 (1.31) 0.0000 (1.0) 0;0 2.0239 (0.76) 1 1 test_checkout_symlink-checkout-noop[2.18.1] 539.0722 (1.43) 539.0722 (1.43) 539.0722 (1.43) 0.0000 (1.0) 539.0722 (1.43) 0.0000 (1.0) 0;0 1.8550 (0.70) 1 1 test_checkout_symlink-checkout-noop[2.39.0] 562.7518 (1.49) 562.7518 (1.49) 562.7518 (1.49) 0.0000 (1.0) 562.7518 (1.49) 0.0000 (1.0) 0;0 1.7770 (0.67) 1 1 test_checkout_symlink-checkout-noop[2.40.0] 563.1393 (1.49) 563.1393 (1.49) 563.1393 (1.49) 0.0000 (1.0) 563.1393 (1.49) 0.0000 (1.0) 0;0 1.7758 (0.67) 1 1 test_checkout_symlink-checkout-noop[2.41.1] 563.0767 (1.49) 563.0767 (1.49) 563.0767 (1.49) 0.0000 (1.0) 563.0767 (1.49) 0.0000 (1.0) 0;0 1.7760 (0.67) 1 1 test_checkout_symlink-checkout-noop[2.45.0] 602.4243 (1.60) 602.4243 (1.60) 602.4243 (1.60) 0.0000 (1.0) 602.4243 (1.60) 0.0000 (1.0) 0;0 1.6600 (0.63) 1 1 test_checkout_symlink-checkout-noop[2.6.3] 377.0043 (1.0) 377.0043 (1.0) 377.0043 (1.0) 0.0000 (1.0) 377.0043 (1.0) 0.0000 (1.0) 0;0 2.6525 (1.0) 1 1 test_checkout_symlink-checkout-noop[main] 667.2155 (1.77) 667.2155 (1.77) 667.2155 (1.77) 0.0000 (1.0) 667.2155 (1.77) 0.0000 (1.0) 0;0 1.4988 (0.57) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-update[2.11.0] 1.3272 (2.07) 1.3272 (2.07) 1.3272 (2.07) 0.0000 (1.0) 1.3272 (2.07) 0.0000 (1.0) 0;0 0.7534 (0.48) 1 1 test_checkout_symlink-checkout-update[2.18.1] 0.6415 (1.0) 0.6415 (1.0) 0.6415 (1.0) 0.0000 (1.0) 0.6415 (1.0) 0.0000 (1.0) 0;0 1.5590 (1.0) 1 1 test_checkout_symlink-checkout-update[2.39.0] 0.6570 (1.02) 0.6570 (1.02) 0.6570 (1.02) 0.0000 (1.0) 0.6570 (1.02) 0.0000 (1.0) 0;0 1.5220 (0.98) 1 1 test_checkout_symlink-checkout-update[2.40.0] 0.9257 (1.44) 0.9257 (1.44) 0.9257 (1.44) 0.0000 (1.0) 0.9257 (1.44) 0.0000 (1.0) 0;0 1.0803 (0.69) 1 1 test_checkout_symlink-checkout-update[2.41.1] 0.6553 (1.02) 0.6553 (1.02) 0.6553 (1.02) 0.0000 (1.0) 0.6553 (1.02) 0.0000 (1.0) 0;0 1.5261 (0.98) 1 1 test_checkout_symlink-checkout-update[2.45.0] 0.6945 (1.08) 0.6945 (1.08) 0.6945 (1.08) 0.0000 (1.0) 0.6945 (1.08) 0.0000 (1.0) 0;0 1.4399 (0.92) 1 1 test_checkout_symlink-checkout-update[2.6.3] 3.1976 (4.99) 3.1976 (4.99) 3.1976 (4.99) 0.0000 (1.0) 3.1976 (4.99) 0.0000 (1.0) 0;0 0.3127 (0.20) 1 1 test_checkout_symlink-checkout-update[main] 0.7642 (1.19) 0.7642 (1.19) 0.7642 (1.19) 0.0000 (1.0) 0.7642 (1.19) 0.0000 (1.0) 0;0 1.3085 (0.84) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.11.0] 576.3813 (1.0) 576.3813 (1.0) 576.3813 (1.0) 0.0000 (1.0) 576.3813 (1.0) 0.0000 (1.0) 0;0 1.7350 (1.0) 1 1 test_gc-gc[2.18.1] 589.1515 (1.02) 589.1515 (1.02) 589.1515 (1.02) 0.0000 (1.0) 589.1515 (1.02) 0.0000 (1.0) 0;0 1.6974 (0.98) 1 1 test_gc-gc[2.39.0] 609.4905 (1.06) 609.4905 (1.06) 609.4905 (1.06) 0.0000 (1.0) 609.4905 (1.06) 0.0000 (1.0) 0;0 1.6407 (0.95) 1 1 test_gc-gc[2.40.0] 626.9802 (1.09) 626.9802 (1.09) 626.9802 (1.09) 0.0000 (1.0) 626.9802 (1.09) 0.0000 (1.0) 0;0 1.5949 (0.92) 1 1 test_gc-gc[2.41.1] 621.9509 (1.08) 621.9509 (1.08) 621.9509 (1.08) 0.0000 (1.0) 621.9509 (1.08) 0.0000 (1.0) 0;0 1.6078 (0.93) 1 1 test_gc-gc[2.45.0] 609.1258 (1.06) 609.1258 (1.06) 609.1258 (1.06) 0.0000 (1.0) 609.1258 (1.06) 0.0000 (1.0) 0;0 1.6417 (0.95) 1 1 test_gc-gc[2.6.3] 681.2915 (1.18) 681.2915 (1.18) 681.2915 (1.18) 0.0000 (1.0) 681.2915 (1.18) 0.0000 (1.0) 0;0 1.4678 (0.85) 1 1 test_gc-gc[main] 650.8132 (1.13) 650.8132 (1.13) 650.8132 (1.13) 0.0000 (1.0) 650.8132 (1.13) 0.0000 (1.0) 0;0 1.5365 (0.89) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.11.0] 4.2852 (1.51) 4.2852 (1.51) 4.2852 (1.51) 0.0000 (1.0) 4.2852 (1.51) 0.0000 (1.0) 0;0 0.2334 (0.66) 1 1 test_get_url-get-url[2.18.1] 4.2626 (1.50) 4.2626 (1.50) 4.2626 (1.50) 0.0000 (1.0) 4.2626 (1.50) 0.0000 (1.0) 0;0 0.2346 (0.66) 1 1 test_get_url-get-url[2.39.0] 4.4111 (1.56) 4.4111 (1.56) 4.4111 (1.56) 0.0000 (1.0) 4.4111 (1.56) 0.0000 (1.0) 0;0 0.2267 (0.64) 1 1 test_get_url-get-url[2.40.0] 4.5130 (1.59) 4.5130 (1.59) 4.5130 (1.59) 0.0000 (1.0) 4.5130 (1.59) 0.0000 (1.0) 0;0 0.2216 (0.63) 1 1 test_get_url-get-url[2.41.1] 4.2167 (1.49) 4.2167 (1.49) 4.2167 (1.49) 0.0000 (1.0) 4.2167 (1.49) 0.0000 (1.0) 0;0 0.2372 (0.67) 1 1 test_get_url-get-url[2.45.0] 4.4101 (1.56) 4.4101 (1.56) 4.4101 (1.56) 0.0000 (1.0) 4.4101 (1.56) 0.0000 (1.0) 0;0 0.2268 (0.64) 1 1 test_get_url-get-url[2.6.3] 2.8327 (1.0) 2.8327 (1.0) 2.8327 (1.0) 0.0000 (1.0) 2.8327 (1.0) 0.0000 (1.0) 0;0 0.3530 (1.0) 1 1 test_get_url-get-url[main] 4.4696 (1.58) 4.4696 (1.58) 4.4696 (1.58) 0.0000 (1.0) 4.4696 (1.58) 0.0000 (1.0) 0;0 0.2237 (0.63) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 8 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.11.0] 15.3328 (1.42) 15.3328 (1.42) 15.3328 (1.42) 0.0000 (1.0) 15.3328 (1.42) 0.0000 (1.0) 0;0 0.0652 (0.70) 1 1 test_import_url-import-url[2.18.1] 13.5822 (1.26) 13.5822 (1.26) 13.5822 (1.26) 0.0000 (1.0) 13.5822 (1.26) 0.0000 (1.0) 0;0 0.0736 (0.79) 1 1 test_import_url-import-url[2.39.0] 13.4942 (1.25) 13.4942 (1.25) 13.4942 (1.25) 0.0000 (1.0) 13.4942 (1.25) 0.0000 (1.0) 0;0 0.0741 (0.80) 1 1 test_import_url-import-url[2.40.0] 13.4196 (1.25) 13.4196 (1.25) 13.4196 (1.25) 0.0000 (1.0) 13.4196 (1.25) 0.0000 (1.0) 0;0 0.0745 (0.80) 1 1 test_import_url-import-url[2.41.1] 13.3574 (1.24) 13.3574 (1.24) 13.3574 (1.24) 0.0000 (1.0) 13.3574 (1.24) 0.0000 (1.0) 0;0 0.0749 (0.81) 1 1 test_import_url-import-url[2.45.0] 10.7650 (1.0) 10.7650 (1.0) 10.7650 (1.0) 0.0000 (1.0) 10.7650 (1.0) 0.0000 (1.0) 0;0 0.0929 (1.0) 1 1 test_import_url-import-url[2.6.3] 16.2171 (1.51) 16.2171 (1.51) 16.2171 (1.51) 0.0000 (1.0) 16.2171 (1.51) 0.0000 (1.0) 0;0 0.0617 (0.66) 1 1 test_import_url-import-url[main] 10.7735 (1.00) 10.7735 (1.00) 10.7735 (1.00) 0.0000 (1.0) 10.7735 (1.00) 0.0000 (1.0) 0;0 0.0928 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.11.0] 2.1748 (1.58) 2.1748 (1.58) 2.1748 (1.58) 0.0000 (1.0) 2.1748 (1.58) 0.0000 (1.0) 0;0 0.4598 (0.63) 1 1 test_status-status[2.18.1] 1.9177 (1.39) 1.9177 (1.39) 1.9177 (1.39) 0.0000 (1.0) 1.9177 (1.39) 0.0000 (1.0) 0;0 0.5214 (0.72) 1 1 test_status-status[2.39.0] 1.3963 (1.01) 1.3963 (1.01) 1.3963 (1.01) 0.0000 (1.0) 1.3963 (1.01) 0.0000 (1.0) 0;0 0.7162 (0.99) 1 1 test_status-status[2.40.0] 1.4108 (1.02) 1.4108 (1.02) 1.4108 (1.02) 0.0000 (1.0) 1.4108 (1.02) 0.0000 (1.0) 0;0 0.7088 (0.98) 1 1 test_status-status[2.41.1] 1.5283 (1.11) 1.5283 (1.11) 1.5283 (1.11) 0.0000 (1.0) 1.5283 (1.11) 0.0000 (1.0) 0;0 0.6543 (0.90) 1 1 test_status-status[2.45.0] 1.3808 (1.0) 1.3808 (1.0) 1.3808 (1.0) 0.0000 (1.0) 1.3808 (1.0) 0.0000 (1.0) 0;0 0.7242 (1.0) 1 1 test_status-status[2.6.3] 3.4542 (2.50) 3.4542 (2.50) 3.4542 (2.50) 0.0000 (1.0) 3.4542 (2.50) 0.0000 (1.0) 0;0 0.2895 (0.40) 1 1 test_status-status[main] 1.4443 (1.05) 1.4443 (1.05) 1.4443 (1.05) 0.0000 (1.0) 1.4443 (1.05) 0.0000 (1.0) 0;0 0.6924 (0.96) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_status-status-changed': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.11.0] 1.5399 (3.03) 1.5399 (3.03) 1.5399 (3.03) 0.0000 (1.0) 1.5399 (3.03) 0.0000 (1.0) 0;0 0.6494 (0.33) 1 1 test_status-status-changed[2.18.1] 0.5078 (1.0) 0.5078 (1.0) 0.5078 (1.0) 0.0000 (1.0) 0.5078 (1.0) 0.0000 (1.0) 0;0 1.9692 (1.0) 1 1 test_status-status-changed[2.39.0] 0.5457 (1.07) 0.5457 (1.07) 0.5457 (1.07) 0.0000 (1.0) 0.5457 (1.07) 0.0000 (1.0) 0;0 1.8324 (0.93) 1 1 test_status-status-changed[2.40.0] 0.5449 (1.07) 0.5449 (1.07) 0.5449 (1.07) 0.0000 (1.0) 0.5449 (1.07) 0.0000 (1.0) 0;0 1.8351 (0.93) 1 1 test_status-status-changed[2.41.1] 0.5467 (1.08) 0.5467 (1.08) 0.5467 (1.08) 0.0000 (1.0) 0.5467 (1.08) 0.0000 (1.0) 0;0 1.8291 (0.93) 1 1 test_status-status-changed[2.45.0] 0.5799 (1.14) 0.5799 (1.14) 0.5799 (1.14) 0.0000 (1.0) 0.5799 (1.14) 0.0000 (1.0) 0;0 1.7243 (0.88) 1 1 test_status-status-changed[2.6.3] 3.0966 (6.10) 3.0966 (6.10) 3.0966 (6.10) 0.0000 (1.0) 3.0966 (6.10) 0.0000 (1.0) 0;0 0.3229 (0.16) 1 1 test_status-status-changed[main] 0.6567 (1.29) 0.6567 (1.29) 0.6567 (1.29) 0.0000 (1.0) 0.6567 (1.29) 0.0000 (1.0) 0;0 1.5229 (0.77) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 8 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.11.0] 662.4353 (1.30) 662.4353 (1.30) 662.4353 (1.30) 0.0000 (1.0) 662.4353 (1.30) 0.0000 (1.0) 0;0 1.5096 (0.77) 1 1 test_status-status-changed-noop[2.18.1] 510.7817 (1.0) 510.7817 (1.0) 510.7817 (1.0) 0.0000 (1.0) 510.7817 (1.0) 0.0000 (1.0) 0;0 1.9578 (1.0) 1 1 test_status-status-changed-noop[2.39.0] 542.6278 (1.06) 542.6278 (1.06) 542.6278 (1.06) 0.0000 (1.0) 542.6278 (1.06) 0.0000 (1.0) 0;0 1.8429 (0.94) 1 1 test_status-status-changed-noop[2.40.0] 551.5065 (1.08) 551.5065 (1.08) 551.5065 (1.08) 0.0000 (1.0) 551.5065 (1.08) 0.0000 (1.0) 0;0 1.8132 (0.93) 1 1 test_status-status-changed-noop[2.41.1] 546.2533 (1.07) 546.2533 (1.07) 546.2533 (1.07) 0.0000 (1.0) 546.2533 (1.07) 0.0000 (1.0) 0;0 1.8307 (0.94) 1 1 test_status-status-changed-noop[2.45.0] 578.9528 (1.13) 578.9528 (1.13) 578.9528 (1.13) 0.0000 (1.0) 578.9528 (1.13) 0.0000 (1.0) 0;0 1.7273 (0.88) 1 1 test_status-status-changed-noop[2.6.3] 2,850.8935 (5.58) 2,850.8935 (5.58) 2,850.8935 (5.58) 0.0000 (1.0) 2,850.8935 (5.58) 0.0000 (1.0) 0;0 0.3508 (0.18) 1 1 test_status-status-changed-noop[main] 649.3366 (1.27) 649.3366 (1.27) 649.3366 (1.27) 0.0000 (1.0) 649.3366 (1.27) 0.0000 (1.0) 0;0 1.5400 (0.79) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.11.0] 420.8844 (1.02) 420.8844 (1.02) 420.8844 (1.02) 0.0000 (1.0) 420.8844 (1.02) 0.0000 (1.0) 0;0 2.3759 (0.98) 1 1 test_status-status-noop[2.18.1] 504.7918 (1.22) 504.7918 (1.22) 504.7918 (1.22) 0.0000 (1.0) 504.7918 (1.22) 0.0000 (1.0) 0;0 1.9810 (0.82) 1 1 test_status-status-noop[2.39.0] 550.2481 (1.33) 550.2481 (1.33) 550.2481 (1.33) 0.0000 (1.0) 550.2481 (1.33) 0.0000 (1.0) 0;0 1.8174 (0.75) 1 1 test_status-status-noop[2.40.0] 548.2999 (1.32) 548.2999 (1.32) 548.2999 (1.32) 0.0000 (1.0) 548.2999 (1.32) 0.0000 (1.0) 0;0 1.8238 (0.76) 1 1 test_status-status-noop[2.41.1] 549.2792 (1.33) 549.2792 (1.33) 549.2792 (1.33) 0.0000 (1.0) 549.2792 (1.33) 0.0000 (1.0) 0;0 1.8206 (0.75) 1 1 test_status-status-noop[2.45.0] 579.3852 (1.40) 579.3852 (1.40) 579.3852 (1.40) 0.0000 (1.0) 579.3852 (1.40) 0.0000 (1.0) 0;0 1.7260 (0.71) 1 1 test_status-status-noop[2.6.3] 414.1932 (1.0) 414.1932 (1.0) 414.1932 (1.0) 0.0000 (1.0) 414.1932 (1.0) 0.0000 (1.0) 0;0 2.4143 (1.0) 1 1 test_status-status-noop[main] 646.2869 (1.56) 646.2869 (1.56) 646.2869 (1.56) 0.0000 (1.0) 646.2869 (1.56) 0.0000 (1.0) 0;0 1.5473 (0.64) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_pull-pull': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_pull-pull[2.11.0] 7.0755 (1.19) 7.0755 (1.19) 7.0755 (1.19) 0.0000 (1.0) 7.0755 (1.19) 0.0000 (1.0) 0;0 0.1413 (0.84) 1 1 test_pull-pull[2.18.1] 7.2949 (1.22) 7.2949 (1.22) 7.2949 (1.22) 0.0000 (1.0) 7.2949 (1.22) 0.0000 (1.0) 0;0 0.1371 (0.82) 1 1 test_pull-pull[2.39.0] 8.6211 (1.45) 8.6211 (1.45) 8.6211 (1.45) 0.0000 (1.0) 8.6211 (1.45) 0.0000 (1.0) 0;0 0.1160 (0.69) 1 1 test_pull-pull[2.40.0] 8.5448 (1.43) 8.5448 (1.43) 8.5448 (1.43) 0.0000 (1.0) 8.5448 (1.43) 0.0000 (1.0) 0;0 0.1170 (0.70) 1 1 test_pull-pull[2.41.1] 8.4475 (1.42) 8.4475 (1.42) 8.4475 (1.42) 0.0000 (1.0) 8.4475 (1.42) 0.0000 (1.0) 0;0 0.1184 (0.71) 1 1 test_pull-pull[2.45.0] 7.1022 (1.19) 7.1022 (1.19) 7.1022 (1.19) 0.0000 (1.0) 7.1022 (1.19) 0.0000 (1.0) 0;0 0.1408 (0.84) 1 1 test_pull-pull[2.6.3] 5.9630 (1.0) 5.9630 (1.0) 5.9630 (1.0) 0.0000 (1.0) 5.9630 (1.0) 0.0000 (1.0) 0;0 0.1677 (1.0) 1 1 test_pull-pull[main] 6.9054 (1.16) 6.9054 (1.16) 6.9054 (1.16) 0.0000 (1.0) 6.9054 (1.16) 0.0000 (1.0) 0;0 0.1448 (0.86) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add-add': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[2.11.0] 7.0336 (1.79) 7.0336 (1.79) 7.0336 (1.79) 0.0000 (1.0) 7.0336 (1.79) 0.0000 (1.0) 0;0 0.1422 (0.56) 1 1 test_add-add[2.18.1] 6.1335 (1.56) 6.1335 (1.56) 6.1335 (1.56) 0.0000 (1.0) 6.1335 (1.56) 0.0000 (1.0) 0;0 0.1630 (0.64) 1 1 test_add-add[2.39.0] 5.9746 (1.52) 5.9746 (1.52) 5.9746 (1.52) 0.0000 (1.0) 5.9746 (1.52) 0.0000 (1.0) 0;0 0.1674 (0.66) 1 1 test_add-add[2.40.0] 6.0914 (1.55) 6.0914 (1.55) 6.0914 (1.55) 0.0000 (1.0) 6.0914 (1.55) 0.0000 (1.0) 0;0 0.1642 (0.65) 1 1 test_add-add[2.41.1] 6.1083 (1.55) 6.1083 (1.55) 6.1083 (1.55) 0.0000 (1.0) 6.1083 (1.55) 0.0000 (1.0) 0;0 0.1637 (0.64) 1 1 test_add-add[2.45.0] 4.4052 (1.12) 4.4052 (1.12) 4.4052 (1.12) 0.0000 (1.0) 4.4052 (1.12) 0.0000 (1.0) 0;0 0.2270 (0.89) 1 1 test_add-add[2.6.3] 7.9587 (2.02) 7.9587 (2.02) 7.9587 (2.02) 0.0000 (1.0) 7.9587 (2.02) 0.0000 (1.0) 0;0 0.1256 (0.49) 1 1 test_add-add[main] 3.9307 (1.0) 3.9307 (1.0) 3.9307 (1.0) 0.0000 (1.0) 3.9307 (1.0) 0.0000 (1.0) 0;0 0.2544 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_init-init': 8 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.11.0] 322.7933 (1.07) 422.9807 (1.14) 330.2930 (1.07) 13.7475 (3.28) 327.1692 (1.07) 4.6041 (1.47) 3;6 3.0276 (0.93) 100 1 test_init-init[2.18.1] 330.9301 (1.09) 468.7146 (1.26) 338.5758 (1.10) 13.8669 (3.31) 336.4174 (1.10) 3.1230 (1.0) 3;9 2.9535 (0.91) 100 1 test_init-init[2.39.0] 385.5916 (1.27) 405.4655 (1.09) 393.7083 (1.28) 4.1884 (1.0) 393.2686 (1.28) 5.5991 (1.79) 32;1 2.5400 (0.78) 100 1 test_init-init[2.40.0] 385.9570 (1.28) 414.9078 (1.12) 392.7072 (1.27) 5.2556 (1.25) 391.9340 (1.28) 6.1283 (1.96) 23;4 2.5464 (0.79) 100 1 test_init-init[2.41.1] 386.2517 (1.28) 406.6793 (1.10) 394.0736 (1.28) 4.3306 (1.03) 393.5045 (1.28) 5.7603 (1.84) 31;2 2.5376 (0.78) 100 1 test_init-init[2.45.0] 386.9425 (1.28) 415.2446 (1.12) 396.4147 (1.29) 5.4476 (1.30) 395.8335 (1.29) 6.2671 (2.01) 26;4 2.5226 (0.78) 100 1 test_init-init[2.6.3] 302.6914 (1.0) 371.0818 (1.0) 308.4669 (1.0) 8.0883 (1.93) 306.5931 (1.0) 3.6519 (1.17) 6;9 3.2418 (1.0) 100 1 test_init-init[main] 478.3727 (1.58) 509.2222 (1.37) 485.8779 (1.58) 6.6282 (1.58) 483.6637 (1.58) 5.1760 (1.66) 16;11 2.0581 (0.63) 100 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.11.0] 3.8202 (1.21) 3.8202 (1.21) 3.8202 (1.21) 0.0000 (1.0) 3.8202 (1.21) 0.0000 (1.0) 0;0 0.2618 (0.83) 1 1 test_push-push[2.18.1] 3.6409 (1.15) 3.6409 (1.15) 3.6409 (1.15) 0.0000 (1.0) 3.6409 (1.15) 0.0000 (1.0) 0;0 0.2747 (0.87) 1 1 test_push-push[2.39.0] 4.7735 (1.51) 4.7735 (1.51) 4.7735 (1.51) 0.0000 (1.0) 4.7735 (1.51) 0.0000 (1.0) 0;0 0.2095 (0.66) 1 1 test_push-push[2.40.0] 4.7953 (1.52) 4.7953 (1.52) 4.7953 (1.52) 0.0000 (1.0) 4.7953 (1.52) 0.0000 (1.0) 0;0 0.2085 (0.66) 1 1 test_push-push[2.41.1] 4.7176 (1.49) 4.7176 (1.49) 4.7176 (1.49) 0.0000 (1.0) 4.7176 (1.49) 0.0000 (1.0) 0;0 0.2120 (0.67) 1 1 test_push-push[2.45.0] 3.3309 (1.05) 3.3309 (1.05) 3.3309 (1.05) 0.0000 (1.0) 3.3309 (1.05) 0.0000 (1.0) 0;0 0.3002 (0.95) 1 1 test_push-push[2.6.3] 3.1590 (1.0) 3.1590 (1.0) 3.1590 (1.0) 0.0000 (1.0) 3.1590 (1.0) 0.0000 (1.0) 0;0 0.3166 (1.0) 1 1 test_push-push[main] 3.2717 (1.04) 3.2717 (1.04) 3.2717 (1.04) 0.0000 (1.0) 3.2717 (1.04) 0.0000 (1.0) 0;0 0.3057 (0.97) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.11.0] 1.1476 (1.36) 1.1476 (1.36) 1.1476 (1.36) 0.0000 (1.0) 1.1476 (1.36) 0.0000 (1.0) 0;0 0.8714 (0.74) 1 1 test_checkout_hardlink-checkout[2.18.1] 1.1143 (1.32) 1.1143 (1.32) 1.1143 (1.32) 0.0000 (1.0) 1.1143 (1.32) 0.0000 (1.0) 0;0 0.8974 (0.76) 1 1 test_checkout_hardlink-checkout[2.39.0] 1.2117 (1.43) 1.2117 (1.43) 1.2117 (1.43) 0.0000 (1.0) 1.2117 (1.43) 0.0000 (1.0) 0;0 0.8253 (0.70) 1 1 test_checkout_hardlink-checkout[2.40.0] 1.1084 (1.31) 1.1084 (1.31) 1.1084 (1.31) 0.0000 (1.0) 1.1084 (1.31) 0.0000 (1.0) 0;0 0.9022 (0.76) 1 1 test_checkout_hardlink-checkout[2.41.1] 1.1081 (1.31) 1.1081 (1.31) 1.1081 (1.31) 0.0000 (1.0) 1.1081 (1.31) 0.0000 (1.0) 0;0 0.9024 (0.76) 1 1 test_checkout_hardlink-checkout[2.45.0] 1.9738 (2.34) 1.9738 (2.34) 1.9738 (2.34) 0.0000 (1.0) 1.9738 (2.34) 0.0000 (1.0) 0;0 0.5066 (0.43) 1 1 test_checkout_hardlink-checkout[2.6.3] 0.8449 (1.0) 0.8449 (1.0) 0.8449 (1.0) 0.0000 (1.0) 0.8449 (1.0) 0.0000 (1.0) 0;0 1.1835 (1.0) 1 1 test_checkout_hardlink-checkout[main] 1.4279 (1.69) 1.4279 (1.69) 1.4279 (1.69) 0.0000 (1.0) 1.4279 (1.69) 0.0000 (1.0) 0;0 0.7003 (0.59) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.11.0] 472.6838 (1.26) 472.6838 (1.26) 472.6838 (1.26) 0.0000 (1.0) 472.6838 (1.26) 0.0000 (1.0) 0;0 2.1156 (0.79) 1 1 test_checkout_hardlink-checkout-noop[2.18.1] 533.2755 (1.42) 533.2755 (1.42) 533.2755 (1.42) 0.0000 (1.0) 533.2755 (1.42) 0.0000 (1.0) 0;0 1.8752 (0.70) 1 1 test_checkout_hardlink-checkout-noop[2.39.0] 557.6838 (1.49) 557.6838 (1.49) 557.6838 (1.49) 0.0000 (1.0) 557.6838 (1.49) 0.0000 (1.0) 0;0 1.7931 (0.67) 1 1 test_checkout_hardlink-checkout-noop[2.40.0] 554.3342 (1.48) 554.3342 (1.48) 554.3342 (1.48) 0.0000 (1.0) 554.3342 (1.48) 0.0000 (1.0) 0;0 1.8040 (0.68) 1 1 test_checkout_hardlink-checkout-noop[2.41.1] 555.1847 (1.48) 555.1847 (1.48) 555.1847 (1.48) 0.0000 (1.0) 555.1847 (1.48) 0.0000 (1.0) 0;0 1.8012 (0.68) 1 1 test_checkout_hardlink-checkout-noop[2.45.0] 578.4173 (1.54) 578.4173 (1.54) 578.4173 (1.54) 0.0000 (1.0) 578.4173 (1.54) 0.0000 (1.0) 0;0 1.7289 (0.65) 1 1 test_checkout_hardlink-checkout-noop[2.6.3] 375.1776 (1.0) 375.1776 (1.0) 375.1776 (1.0) 0.0000 (1.0) 375.1776 (1.0) 0.0000 (1.0) 0;0 2.6654 (1.0) 1 1 test_checkout_hardlink-checkout-noop[main] 646.1384 (1.72) 646.1384 (1.72) 646.1384 (1.72) 0.0000 (1.0) 646.1384 (1.72) 0.0000 (1.0) 0;0 1.5477 (0.58) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.11.0] 1.1692 (1.90) 1.1692 (1.90) 1.1692 (1.90) 0.0000 (1.0) 1.1692 (1.90) 0.0000 (1.0) 0;0 0.8553 (0.53) 1 1 test_checkout_hardlink-checkout-update[2.18.1] 0.6140 (1.0) 0.6140 (1.0) 0.6140 (1.0) 0.0000 (1.0) 0.6140 (1.0) 0.0000 (1.0) 0;0 1.6286 (1.0) 1 1 test_checkout_hardlink-checkout-update[2.39.0] 0.6212 (1.01) 0.6212 (1.01) 0.6212 (1.01) 0.0000 (1.0) 0.6212 (1.01) 0.0000 (1.0) 0;0 1.6097 (0.99) 1 1 test_checkout_hardlink-checkout-update[2.40.0] 0.6233 (1.02) 0.6233 (1.02) 0.6233 (1.02) 0.0000 (1.0) 0.6233 (1.02) 0.0000 (1.0) 0;0 1.6043 (0.99) 1 1 test_checkout_hardlink-checkout-update[2.41.1] 0.6190 (1.01) 0.6190 (1.01) 0.6190 (1.01) 0.0000 (1.0) 0.6190 (1.01) 0.0000 (1.0) 0;0 1.6155 (0.99) 1 1 test_checkout_hardlink-checkout-update[2.45.0] 0.6448 (1.05) 0.6448 (1.05) 0.6448 (1.05) 0.0000 (1.0) 0.6448 (1.05) 0.0000 (1.0) 0;0 1.5508 (0.95) 1 1 test_checkout_hardlink-checkout-update[2.6.3] 2.7562 (4.49) 2.7562 (4.49) 2.7562 (4.49) 0.0000 (1.0) 2.7562 (4.49) 0.0000 (1.0) 0;0 0.3628 (0.22) 1 1 test_checkout_hardlink-checkout-update[main] 0.7118 (1.16) 0.7118 (1.16) 0.7118 (1.16) 0.0000 (1.0) 0.7118 (1.16) 0.0000 (1.0) 0;0 1.4049 (0.86) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-update': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.11.0] 8.4258 (1.27) 8.4258 (1.27) 8.4258 (1.27) 0.0000 (1.0) 8.4258 (1.27) 0.0000 (1.0) 0;0 0.1187 (0.79) 1 1 test_update-update[2.18.1] 7.5365 (1.13) 7.5365 (1.13) 7.5365 (1.13) 0.0000 (1.0) 7.5365 (1.13) 0.0000 (1.0) 0;0 0.1327 (0.88) 1 1 test_update-update[2.39.0] 6.7043 (1.01) 6.7043 (1.01) 6.7043 (1.01) 0.0000 (1.0) 6.7043 (1.01) 0.0000 (1.0) 0;0 0.1492 (0.99) 1 1 test_update-update[2.40.0] 6.7174 (1.01) 6.7174 (1.01) 6.7174 (1.01) 0.0000 (1.0) 6.7174 (1.01) 0.0000 (1.0) 0;0 0.1489 (0.99) 1 1 test_update-update[2.41.1] 6.6429 (1.0) 6.6429 (1.0) 6.6429 (1.0) 0.0000 (1.0) 6.6429 (1.0) 0.0000 (1.0) 0;0 0.1505 (1.0) 1 1 test_update-update[2.45.0] 6.7781 (1.02) 6.7781 (1.02) 6.7781 (1.02) 0.0000 (1.0) 6.7781 (1.02) 0.0000 (1.0) 0;0 0.1475 (0.98) 1 1 test_update-update[2.6.3] 9.1107 (1.37) 9.1107 (1.37) 9.1107 (1.37) 0.0000 (1.0) 9.1107 (1.37) 0.0000 (1.0) 0;0 0.1098 (0.73) 1 1 test_update-update[main] 7.3663 (1.11) 7.3663 (1.11) 7.3663 (1.11) 0.0000 (1.0) 7.3663 (1.11) 0.0000 (1.0) 0;0 0.1358 (0.90) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 8 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update-noop[2.11.0] 479.7859 (1.0) 479.7859 (1.0) 479.7859 (1.0) 0.0000 (1.0) 479.7859 (1.0) 0.0000 (1.0) 0;0 2.0843 (1.0) 1 1 test_update-update-noop[2.18.1] 621.0162 (1.29) 621.0162 (1.29) 621.0162 (1.29) 0.0000 (1.0) 621.0162 (1.29) 0.0000 (1.0) 0;0 1.6103 (0.77) 1 1 test_update-update-noop[2.39.0] 888.5339 (1.85) 888.5339 (1.85) 888.5339 (1.85) 0.0000 (1.0) 888.5339 (1.85) 0.0000 (1.0) 0;0 1.1254 (0.54) 1 1 test_update-update-noop[2.40.0] 902.9812 (1.88) 902.9812 (1.88) 902.9812 (1.88) 0.0000 (1.0) 902.9812 (1.88) 0.0000 (1.0) 0;0 1.1074 (0.53) 1 1 test_update-update-noop[2.41.1] 892.8875 (1.86) 892.8875 (1.86) 892.8875 (1.86) 0.0000 (1.0) 892.8875 (1.86) 0.0000 (1.0) 0;0 1.1200 (0.54) 1 1 test_update-update-noop[2.45.0] 989.9232 (2.06) 989.9232 (2.06) 989.9232 (2.06) 0.0000 (1.0) 989.9232 (2.06) 0.0000 (1.0) 0;0 1.0102 (0.48) 1 1 test_update-update-noop[2.6.3] 490.5466 (1.02) 490.5466 (1.02) 490.5466 (1.02) 0.0000 (1.0) 490.5466 (1.02) 0.0000 (1.0) 0;0 2.0385 (0.98) 1 1 test_update-update-noop[main] 1,069.3716 (2.23) 1,069.3716 (2.23) 1,069.3716 (2.23) 0.0000 (1.0) 1,069.3716 (2.23) 0.0000 (1.0) 0;0 0.9351 (0.45) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.18.1] 673.7673 (1.02) 673.7673 (1.02) 673.7673 (1.02) 0.0000 (1.0) 673.7673 (1.02) 0.0000 (1.0) 0;0 1.4842 (0.98) 1 1 test_data_status-data-changed[2.39.0] 706.3318 (1.06) 706.3318 (1.06) 706.3318 (1.06) 0.0000 (1.0) 706.3318 (1.06) 0.0000 (1.0) 0;0 1.4158 (0.94) 1 1 test_data_status-data-changed[2.40.0] 706.0414 (1.06) 706.0414 (1.06) 706.0414 (1.06) 0.0000 (1.0) 706.0414 (1.06) 0.0000 (1.0) 0;0 1.4163 (0.94) 1 1 test_data_status-data-changed[2.41.1] 709.9099 (1.07) 709.9099 (1.07) 709.9099 (1.07) 0.0000 (1.0) 709.9099 (1.07) 0.0000 (1.0) 0;0 1.4086 (0.93) 1 1 test_data_status-data-changed[2.45.0] 663.5016 (1.0) 663.5016 (1.0) 663.5016 (1.0) 0.0000 (1.0) 663.5016 (1.0) 0.0000 (1.0) 0;0 1.5072 (1.0) 1 1 test_data_status-data-changed[main] 726.3072 (1.09) 726.3072 (1.09) 726.3072 (1.09) 0.0000 (1.0) 726.3072 (1.09) 0.0000 (1.0) 0;0 1.3768 (0.91) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.18.1] 676.7804 (1.02) 676.7804 (1.02) 676.7804 (1.02) 0.0000 (1.0) 676.7804 (1.02) 0.0000 (1.0) 0;0 1.4776 (0.98) 1 1 test_data_status-data-changed-noop[2.39.0] 711.0032 (1.07) 711.0032 (1.07) 711.0032 (1.07) 0.0000 (1.0) 711.0032 (1.07) 0.0000 (1.0) 0;0 1.4065 (0.93) 1 1 test_data_status-data-changed-noop[2.40.0] 705.8424 (1.06) 705.8424 (1.06) 705.8424 (1.06) 0.0000 (1.0) 705.8424 (1.06) 0.0000 (1.0) 0;0 1.4167 (0.94) 1 1 test_data_status-data-changed-noop[2.41.1] 714.4255 (1.08) 714.4255 (1.08) 714.4255 (1.08) 0.0000 (1.0) 714.4255 (1.08) 0.0000 (1.0) 0;0 1.3997 (0.93) 1 1 test_data_status-data-changed-noop[2.45.0] 663.5288 (1.0) 663.5288 (1.0) 663.5288 (1.0) 0.0000 (1.0) 663.5288 (1.0) 0.0000 (1.0) 0;0 1.5071 (1.0) 1 1 test_data_status-data-changed-noop[main] 718.1576 (1.08) 718.1576 (1.08) 718.1576 (1.08) 0.0000 (1.0) 718.1576 (1.08) 0.0000 (1.0) 0;0 1.3925 (0.92) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.18.1] 1.5335 (1.02) 1.5335 (1.02) 1.5335 (1.02) 0.0000 (1.0) 1.5335 (1.02) 0.0000 (1.0) 0;0 0.6521 (0.98) 1 1 test_data_status-data-new[2.39.0] 1.5510 (1.03) 1.5510 (1.03) 1.5510 (1.03) 0.0000 (1.0) 1.5510 (1.03) 0.0000 (1.0) 0;0 0.6447 (0.97) 1 1 test_data_status-data-new[2.40.0] 2.2094 (1.47) 2.2094 (1.47) 2.2094 (1.47) 0.0000 (1.0) 2.2094 (1.47) 0.0000 (1.0) 0;0 0.4526 (0.68) 1 1 test_data_status-data-new[2.41.1] 2.2611 (1.51) 2.2611 (1.51) 2.2611 (1.51) 0.0000 (1.0) 2.2611 (1.51) 0.0000 (1.0) 0;0 0.4423 (0.66) 1 1 test_data_status-data-new[2.45.0] 2.0416 (1.36) 2.0416 (1.36) 2.0416 (1.36) 0.0000 (1.0) 2.0416 (1.36) 0.0000 (1.0) 0;0 0.4898 (0.73) 1 1 test_data_status-data-new[main] 1.5000 (1.0) 1.5000 (1.0) 1.5000 (1.0) 0.0000 (1.0) 1.5000 (1.0) 0.0000 (1.0) 0;0 0.6667 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.18.1] 666.0783 (1.01) 666.0783 (1.01) 666.0783 (1.01) 0.0000 (1.0) 666.0783 (1.01) 0.0000 (1.0) 0;0 1.5013 (0.99) 1 1 test_data_status-data-noop[2.39.0] 1,025.5421 (1.56) 1,025.5421 (1.56) 1,025.5421 (1.56) 0.0000 (1.0) 1,025.5421 (1.56) 0.0000 (1.0) 0;0 0.9751 (0.64) 1 1 test_data_status-data-noop[2.40.0] 696.2202 (1.06) 696.2202 (1.06) 696.2202 (1.06) 0.0000 (1.0) 696.2202 (1.06) 0.0000 (1.0) 0;0 1.4363 (0.95) 1 1 test_data_status-data-noop[2.41.1] 695.6979 (1.06) 695.6979 (1.06) 695.6979 (1.06) 0.0000 (1.0) 695.6979 (1.06) 0.0000 (1.0) 0;0 1.4374 (0.95) 1 1 test_data_status-data-noop[2.45.0] 659.3812 (1.0) 659.3812 (1.0) 659.3812 (1.0) 0.0000 (1.0) 659.3812 (1.0) 0.0000 (1.0) 0;0 1.5166 (1.0) 1 1 test_data_status-data-noop[main] 720.1830 (1.09) 720.1830 (1.09) 720.1830 (1.09) 0.0000 (1.0) 720.1830 (1.09) 0.0000 (1.0) 0;0 1.3885 (0.92) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.11.0] 3.6818 (1.13) 3.6818 (1.13) 3.6818 (1.13) 0.0000 (1.0) 3.6818 (1.13) 0.0000 (1.0) 0;0 0.2716 (0.89) 1 1 test_exp_show-exp[2.18.1] 3.7999 (1.16) 3.7999 (1.16) 3.7999 (1.16) 0.0000 (1.0) 3.7999 (1.16) 0.0000 (1.0) 0;0 0.2632 (0.86) 1 1 test_exp_show-exp[2.39.0] 3.2906 (1.01) 3.2906 (1.01) 3.2906 (1.01) 0.0000 (1.0) 3.2906 (1.01) 0.0000 (1.0) 0;0 0.3039 (0.99) 1 1 test_exp_show-exp[2.40.0] 3.2666 (1.0) 3.2666 (1.0) 3.2666 (1.0) 0.0000 (1.0) 3.2666 (1.0) 0.0000 (1.0) 0;0 0.3061 (1.0) 1 1 test_exp_show-exp[2.41.1] 3.3032 (1.01) 3.3032 (1.01) 3.3032 (1.01) 0.0000 (1.0) 3.3032 (1.01) 0.0000 (1.0) 0;0 0.3027 (0.99) 1 1 test_exp_show-exp[2.45.0] 3.3880 (1.04) 3.3880 (1.04) 3.3880 (1.04) 0.0000 (1.0) 3.3880 (1.04) 0.0000 (1.0) 0;0 0.2952 (0.96) 1 1 test_exp_show-exp[main] 4.2420 (1.30) 4.2420 (1.30) 4.2420 (1.30) 0.0000 (1.0) 4.2420 (1.30) 0.0000 (1.0) 0;0 0.2357 (0.77) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.11.0] 406.7689 (1.08) 406.7689 (1.08) 406.7689 (1.08) 0.0000 (1.0) 406.7689 (1.08) 0.0000 (1.0) 0;0 2.4584 (0.93) 1 1 test_list-list[2.18.1] 376.3910 (1.0) 376.3910 (1.0) 376.3910 (1.0) 0.0000 (1.0) 376.3910 (1.0) 0.0000 (1.0) 0;0 2.6568 (1.0) 1 1 test_list-list[2.39.0] 402.4804 (1.07) 402.4804 (1.07) 402.4804 (1.07) 0.0000 (1.0) 402.4804 (1.07) 0.0000 (1.0) 0;0 2.4846 (0.94) 1 1 test_list-list[2.40.0] 390.4202 (1.04) 390.4202 (1.04) 390.4202 (1.04) 0.0000 (1.0) 390.4202 (1.04) 0.0000 (1.0) 0;0 2.5613 (0.96) 1 1 test_list-list[2.41.1] 391.2858 (1.04) 391.2858 (1.04) 391.2858 (1.04) 0.0000 (1.0) 391.2858 (1.04) 0.0000 (1.0) 0;0 2.5557 (0.96) 1 1 test_list-list[2.45.0] 413.4419 (1.10) 413.4419 (1.10) 413.4419 (1.10) 0.0000 (1.0) 413.4419 (1.10) 0.0000 (1.0) 0;0 2.4187 (0.91) 1 1 test_list-list[2.6.3] 507.6428 (1.35) 507.6428 (1.35) 507.6428 (1.35) 0.0000 (1.0) 507.6428 (1.35) 0.0000 (1.0) 0;0 1.9699 (0.74) 1 1 test_list-list[main] 485.0450 (1.29) 485.0450 (1.29) 485.0450 (1.29) 0.0000 (1.0) 485.0450 (1.29) 0.0000 (1.0) 0;0 2.0617 (0.78) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.11.0] 393.2020 (1.09) 393.2020 (1.09) 393.2020 (1.09) 0.0000 (1.0) 393.2020 (1.09) 0.0000 (1.0) 0;0 2.5432 (0.92) 1 1 test_list-list-dvc-only[2.18.1] 362.0911 (1.0) 362.0911 (1.0) 362.0911 (1.0) 0.0000 (1.0) 362.0911 (1.0) 0.0000 (1.0) 0;0 2.7617 (1.0) 1 1 test_list-list-dvc-only[2.39.0] 389.0865 (1.07) 389.0865 (1.07) 389.0865 (1.07) 0.0000 (1.0) 389.0865 (1.07) 0.0000 (1.0) 0;0 2.5701 (0.93) 1 1 test_list-list-dvc-only[2.40.0] 384.9204 (1.06) 384.9204 (1.06) 384.9204 (1.06) 0.0000 (1.0) 384.9204 (1.06) 0.0000 (1.0) 0;0 2.5979 (0.94) 1 1 test_list-list-dvc-only[2.41.1] 383.1738 (1.06) 383.1738 (1.06) 383.1738 (1.06) 0.0000 (1.0) 383.1738 (1.06) 0.0000 (1.0) 0;0 2.6098 (0.94) 1 1 test_list-list-dvc-only[2.45.0] 403.2640 (1.11) 403.2640 (1.11) 403.2640 (1.11) 0.0000 (1.0) 403.2640 (1.11) 0.0000 (1.0) 0;0 2.4798 (0.90) 1 1 test_list-list-dvc-only[2.6.3] 402.5363 (1.11) 402.5363 (1.11) 402.5363 (1.11) 0.0000 (1.0) 402.5363 (1.11) 0.0000 (1.0) 0;0 2.4842 (0.90) 1 1 test_list-list-dvc-only[main] 476.9682 (1.32) 476.9682 (1.32) 476.9682 (1.32) 0.0000 (1.0) 476.9682 (1.32) 0.0000 (1.0) 0;0 2.0966 (0.76) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.11.0] 1.6572 (3.66) 1.6572 (3.66) 1.6572 (3.66) 0.0000 (1.0) 1.6572 (3.66) 0.0000 (1.0) 0;0 0.6034 (0.27) 1 1 test_list-list-recursive[2.18.1] 2.3713 (5.23) 2.3713 (5.23) 2.3713 (5.23) 0.0000 (1.0) 2.3713 (5.23) 0.0000 (1.0) 0;0 0.4217 (0.19) 1 1 test_list-list-recursive[2.39.0] 0.7650 (1.69) 0.7650 (1.69) 0.7650 (1.69) 0.0000 (1.0) 0.7650 (1.69) 0.0000 (1.0) 0;0 1.3072 (0.59) 1 1 test_list-list-recursive[2.40.0] 0.4532 (1.0) 0.4532 (1.0) 0.4532 (1.0) 0.0000 (1.0) 0.4532 (1.0) 0.0000 (1.0) 0;0 2.2064 (1.0) 1 1 test_list-list-recursive[2.41.1] 0.4556 (1.01) 0.4556 (1.01) 0.4556 (1.01) 0.0000 (1.0) 0.4556 (1.01) 0.0000 (1.0) 0;0 2.1947 (0.99) 1 1 test_list-list-recursive[2.45.0] 0.4669 (1.03) 0.4669 (1.03) 0.4669 (1.03) 0.0000 (1.0) 0.4669 (1.03) 0.0000 (1.0) 0;0 2.1420 (0.97) 1 1 test_list-list-recursive[2.6.3] 0.9678 (2.14) 0.9678 (2.14) 0.9678 (2.14) 0.0000 (1.0) 0.9678 (2.14) 0.0000 (1.0) 0;0 1.0332 (0.47) 1 1 test_list-list-recursive[main] 0.5743 (1.27) 0.5743 (1.27) 0.5743 (1.27) 0.0000 (1.0) 0.5743 (1.27) 0.0000 (1.0) 0;0 1.7412 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.11.0] 394.0106 (1.01) 394.0106 (1.01) 394.0106 (1.01) 0.0000 (1.0) 394.0106 (1.01) 0.0000 (1.0) 0;0 2.5380 (0.99) 1 1 test_list-list-shallow[2.18.1] 391.6934 (1.0) 391.6934 (1.0) 391.6934 (1.0) 0.0000 (1.0) 391.6934 (1.0) 0.0000 (1.0) 0;0 2.5530 (1.0) 1 1 test_list-list-shallow[2.39.0] 419.0208 (1.07) 419.0208 (1.07) 419.0208 (1.07) 0.0000 (1.0) 419.0208 (1.07) 0.0000 (1.0) 0;0 2.3865 (0.93) 1 1 test_list-list-shallow[2.40.0] 416.1382 (1.06) 416.1382 (1.06) 416.1382 (1.06) 0.0000 (1.0) 416.1382 (1.06) 0.0000 (1.0) 0;0 2.4030 (0.94) 1 1 test_list-list-shallow[2.41.1] 418.1163 (1.07) 418.1163 (1.07) 418.1163 (1.07) 0.0000 (1.0) 418.1163 (1.07) 0.0000 (1.0) 0;0 2.3917 (0.94) 1 1 test_list-list-shallow[2.45.0] 429.1556 (1.10) 429.1556 (1.10) 429.1556 (1.10) 0.0000 (1.0) 429.1556 (1.10) 0.0000 (1.0) 0;0 2.3302 (0.91) 1 1 test_list-list-shallow[2.6.3] 433.2327 (1.11) 433.2327 (1.11) 433.2327 (1.11) 0.0000 (1.0) 433.2327 (1.11) 0.0000 (1.0) 0;0 2.3082 (0.90) 1 1 test_list-list-shallow[main] 482.1706 (1.23) 482.1706 (1.23) 482.1706 (1.23) 0.0000 (1.0) 482.1706 (1.23) 0.0000 (1.0) 0;0 2.0740 (0.81) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.11.0] 138.3145 (1.0) 142.4917 (1.0) 139.6841 (1.0) 0.8037 (1.08) 139.6238 (1.0) 0.9777 (1.09) 31;3 7.1590 (1.0) 100 1 test_help---help[2.18.1] 142.5635 (1.03) 146.6119 (1.03) 144.0252 (1.03) 0.7462 (1.0) 143.9329 (1.03) 0.8936 (1.0) 25;3 6.9432 (0.97) 100 1 test_help---help[2.39.0] 181.2284 (1.31) 186.1326 (1.31) 183.1404 (1.31) 1.0507 (1.41) 182.9700 (1.31) 1.1802 (1.32) 27;5 5.4603 (0.76) 100 1 test_help---help[2.40.0] 182.3150 (1.32) 187.9192 (1.32) 183.9494 (1.32) 1.0393 (1.39) 183.7851 (1.32) 1.0509 (1.18) 22;5 5.4363 (0.76) 100 1 test_help---help[2.41.1] 181.5283 (1.31) 189.0895 (1.33) 183.5022 (1.31) 1.1135 (1.49) 183.4328 (1.31) 1.4258 (1.60) 25;2 5.4495 (0.76) 100 1 test_help---help[2.45.0] 144.7342 (1.05) 148.5033 (1.04) 146.4231 (1.05) 0.8409 (1.13) 146.3643 (1.05) 1.0313 (1.15) 31;1 6.8295 (0.95) 100 1 test_help---help[2.6.3] 180.1589 (1.30) 186.1156 (1.31) 182.0398 (1.30) 1.0534 (1.41) 181.9809 (1.30) 1.2385 (1.39) 23;4 5.4933 (0.77) 100 1 test_help---help[main] 146.2924 (1.06) 155.1885 (1.09) 148.1802 (1.06) 1.0383 (1.39) 148.0571 (1.06) 0.9624 (1.08) 15;3 6.7485 (0.94) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.11.0] 1.6433 (1.21) 1.6433 (1.21) 1.6433 (1.21) 0.0000 (1.0) 1.6433 (1.21) 0.0000 (1.0) 0;0 0.6085 (0.83) 1 1 test_diff-diff[2.18.1] 1.3596 (1.0) 1.3596 (1.0) 1.3596 (1.0) 0.0000 (1.0) 1.3596 (1.0) 0.0000 (1.0) 0;0 0.7355 (1.0) 1 1 test_diff-diff[2.39.0] 1.4016 (1.03) 1.4016 (1.03) 1.4016 (1.03) 0.0000 (1.0) 1.4016 (1.03) 0.0000 (1.0) 0;0 0.7135 (0.97) 1 1 test_diff-diff[2.40.0] 1.4054 (1.03) 1.4054 (1.03) 1.4054 (1.03) 0.0000 (1.0) 1.4054 (1.03) 0.0000 (1.0) 0;0 0.7115 (0.97) 1 1 test_diff-diff[2.41.1] 1.5455 (1.14) 1.5455 (1.14) 1.5455 (1.14) 0.0000 (1.0) 1.5455 (1.14) 0.0000 (1.0) 0;0 0.6470 (0.88) 1 1 test_diff-diff[2.45.0] 1.8083 (1.33) 1.8083 (1.33) 1.8083 (1.33) 0.0000 (1.0) 1.8083 (1.33) 0.0000 (1.0) 0;0 0.5530 (0.75) 1 1 test_diff-diff[2.6.3] 3.0539 (2.25) 3.0539 (2.25) 3.0539 (2.25) 0.0000 (1.0) 3.0539 (2.25) 0.0000 (1.0) 0;0 0.3274 (0.45) 1 1 test_diff-diff[main] 1.3862 (1.02) 1.3862 (1.02) 1.3862 (1.02) 0.0000 (1.0) 1.3862 (1.02) 0.0000 (1.0) 0;0 0.7214 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.11.0] 1.1127 (1.73) 1.1127 (1.73) 1.1127 (1.73) 0.0000 (1.0) 1.1127 (1.73) 0.0000 (1.0) 0;0 0.8987 (0.58) 1 1 test_diff-diff-changed[2.18.1] 0.6439 (1.0) 0.6439 (1.0) 0.6439 (1.0) 0.0000 (1.0) 0.6439 (1.0) 0.0000 (1.0) 0;0 1.5531 (1.0) 1 1 test_diff-diff-changed[2.39.0] 0.6712 (1.04) 0.6712 (1.04) 0.6712 (1.04) 0.0000 (1.0) 0.6712 (1.04) 0.0000 (1.0) 0;0 1.4898 (0.96) 1 1 test_diff-diff-changed[2.40.0] 0.6770 (1.05) 0.6770 (1.05) 0.6770 (1.05) 0.0000 (1.0) 0.6770 (1.05) 0.0000 (1.0) 0;0 1.4771 (0.95) 1 1 test_diff-diff-changed[2.41.1] 0.6689 (1.04) 0.6689 (1.04) 0.6689 (1.04) 0.0000 (1.0) 0.6689 (1.04) 0.0000 (1.0) 0;0 1.4950 (0.96) 1 1 test_diff-diff-changed[2.45.0] 0.7123 (1.11) 0.7123 (1.11) 0.7123 (1.11) 0.0000 (1.0) 0.7123 (1.11) 0.0000 (1.0) 0;0 1.4039 (0.90) 1 1 test_diff-diff-changed[2.6.3] 3.1780 (4.94) 3.1780 (4.94) 3.1780 (4.94) 0.0000 (1.0) 3.1780 (4.94) 0.0000 (1.0) 0;0 0.3147 (0.20) 1 1 test_diff-diff-changed[main] 0.7836 (1.22) 0.7836 (1.22) 0.7836 (1.22) 0.0000 (1.0) 0.7836 (1.22) 0.0000 (1.0) 0;0 1.2761 (0.82) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 8 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_diff-diff-changed-noop[2.11.0] 501.4563 (1.0) 501.4563 (1.0) 501.4563 (1.0) 0.0000 (1.0) 501.4563 (1.0) 0.0000 (1.0) 0;0 1.9942 (1.0) 1 1 test_diff-diff-changed-noop[2.18.1] 643.8875 (1.28) 643.8875 (1.28) 643.8875 (1.28) 0.0000 (1.0) 643.8875 (1.28) 0.0000 (1.0) 0;0 1.5531 (0.78) 1 1 test_diff-diff-changed-noop[2.39.0] 674.4015 (1.34) 674.4015 (1.34) 674.4015 (1.34) 0.0000 (1.0) 674.4015 (1.34) 0.0000 (1.0) 0;0 1.4828 (0.74) 1 1 test_diff-diff-changed-noop[2.40.0] 669.1201 (1.33) 669.1201 (1.33) 669.1201 (1.33) 0.0000 (1.0) 669.1201 (1.33) 0.0000 (1.0) 0;0 1.4945 (0.75) 1 1 test_diff-diff-changed-noop[2.41.1] 666.1309 (1.33) 666.1309 (1.33) 666.1309 (1.33) 0.0000 (1.0) 666.1309 (1.33) 0.0000 (1.0) 0;0 1.5012 (0.75) 1 1 test_diff-diff-changed-noop[2.45.0] 708.2700 (1.41) 708.2700 (1.41) 708.2700 (1.41) 0.0000 (1.0) 708.2700 (1.41) 0.0000 (1.0) 0;0 1.4119 (0.71) 1 1 test_diff-diff-changed-noop[2.6.3] 2,367.0472 (4.72) 2,367.0472 (4.72) 2,367.0472 (4.72) 0.0000 (1.0) 2,367.0472 (4.72) 0.0000 (1.0) 0;0 0.4225 (0.21) 1 1 test_diff-diff-changed-noop[main] 739.4567 (1.47) 739.4567 (1.47) 739.4567 (1.47) 0.0000 (1.0) 739.4567 (1.47) 0.0000 (1.0) 0;0 1.3523 (0.68) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 8 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.11.0] 459.5856 (1.0) 459.5856 (1.0) 459.5856 (1.0) 0.0000 (1.0) 459.5856 (1.0) 0.0000 (1.0) 0;0 2.1759 (1.0) 1 1 test_diff-diff-noop[2.18.1] 595.6723 (1.30) 595.6723 (1.30) 595.6723 (1.30) 0.0000 (1.0) 595.6723 (1.30) 0.0000 (1.0) 0;0 1.6788 (0.77) 1 1 test_diff-diff-noop[2.39.0] 636.8163 (1.39) 636.8163 (1.39) 636.8163 (1.39) 0.0000 (1.0) 636.8163 (1.39) 0.0000 (1.0) 0;0 1.5703 (0.72) 1 1 test_diff-diff-noop[2.40.0] 637.2744 (1.39) 637.2744 (1.39) 637.2744 (1.39) 0.0000 (1.0) 637.2744 (1.39) 0.0000 (1.0) 0;0 1.5692 (0.72) 1 1 test_diff-diff-noop[2.41.1] 632.7141 (1.38) 632.7141 (1.38) 632.7141 (1.38) 0.0000 (1.0) 632.7141 (1.38) 0.0000 (1.0) 0;0 1.5805 (0.73) 1 1 test_diff-diff-noop[2.45.0] 668.2749 (1.45) 668.2749 (1.45) 668.2749 (1.45) 0.0000 (1.0) 668.2749 (1.45) 0.0000 (1.0) 0;0 1.4964 (0.69) 1 1 test_diff-diff-noop[2.6.3] 1,753.7412 (3.82) 1,753.7412 (3.82) 1,753.7412 (3.82) 0.0000 (1.0) 1,753.7412 (3.82) 0.0000 (1.0) 0;0 0.5702 (0.26) 1 1 test_diff-diff-noop[main] 690.6591 (1.50) 690.6591 (1.50) 690.6591 (1.50) 0.0000 (1.0) 690.6591 (1.50) 0.0000 (1.0) 0;0 1.4479 (0.67) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.11.0] 4.1135 (1.21) 4.1135 (1.21) 4.1135 (1.21) 0.0000 (1.0) 4.1135 (1.21) 0.0000 (1.0) 0;0 0.2431 (0.83) 1 1 test_checkout_copy-checkout[2.18.1] 4.3038 (1.26) 4.3038 (1.26) 4.3038 (1.26) 0.0000 (1.0) 4.3038 (1.26) 0.0000 (1.0) 0;0 0.2324 (0.79) 1 1 test_checkout_copy-checkout[2.39.0] 4.1532 (1.22) 4.1532 (1.22) 4.1532 (1.22) 0.0000 (1.0) 4.1532 (1.22) 0.0000 (1.0) 0;0 0.2408 (0.82) 1 1 test_checkout_copy-checkout[2.40.0] 4.1209 (1.21) 4.1209 (1.21) 4.1209 (1.21) 0.0000 (1.0) 4.1209 (1.21) 0.0000 (1.0) 0;0 0.2427 (0.83) 1 1 test_checkout_copy-checkout[2.41.1] 4.2957 (1.26) 4.2957 (1.26) 4.2957 (1.26) 0.0000 (1.0) 4.2957 (1.26) 0.0000 (1.0) 0;0 0.2328 (0.79) 1 1 test_checkout_copy-checkout[2.45.0] 4.3546 (1.28) 4.3546 (1.28) 4.3546 (1.28) 0.0000 (1.0) 4.3546 (1.28) 0.0000 (1.0) 0;0 0.2296 (0.78) 1 1 test_checkout_copy-checkout[2.6.3] 3.4088 (1.0) 3.4088 (1.0) 3.4088 (1.0) 0.0000 (1.0) 3.4088 (1.0) 0.0000 (1.0) 0;0 0.2934 (1.0) 1 1 test_checkout_copy-checkout[main] 4.4562 (1.31) 4.4562 (1.31) 4.4562 (1.31) 0.0000 (1.0) 4.4562 (1.31) 0.0000 (1.0) 0;0 0.2244 (0.76) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.11.0] 617.2803 (1.28) 617.2803 (1.28) 617.2803 (1.28) 0.0000 (1.0) 617.2803 (1.28) 0.0000 (1.0) 0;0 1.6200 (0.78) 1 1 test_checkout_copy-checkout-noop[2.18.1] 781.6947 (1.62) 781.6947 (1.62) 781.6947 (1.62) 0.0000 (1.0) 781.6947 (1.62) 0.0000 (1.0) 0;0 1.2793 (0.62) 1 1 test_checkout_copy-checkout-noop[2.39.0] 773.9111 (1.61) 773.9111 (1.61) 773.9111 (1.61) 0.0000 (1.0) 773.9111 (1.61) 0.0000 (1.0) 0;0 1.2921 (0.62) 1 1 test_checkout_copy-checkout-noop[2.40.0] 758.4913 (1.58) 758.4913 (1.58) 758.4913 (1.58) 0.0000 (1.0) 758.4913 (1.58) 0.0000 (1.0) 0;0 1.3184 (0.63) 1 1 test_checkout_copy-checkout-noop[2.41.1] 764.8560 (1.59) 764.8560 (1.59) 764.8560 (1.59) 0.0000 (1.0) 764.8560 (1.59) 0.0000 (1.0) 0;0 1.3074 (0.63) 1 1 test_checkout_copy-checkout-noop[2.45.0] 783.0989 (1.63) 783.0989 (1.63) 783.0989 (1.63) 0.0000 (1.0) 783.0989 (1.63) 0.0000 (1.0) 0;0 1.2770 (0.61) 1 1 test_checkout_copy-checkout-noop[2.6.3] 481.1495 (1.0) 481.1495 (1.0) 481.1495 (1.0) 0.0000 (1.0) 481.1495 (1.0) 0.0000 (1.0) 0;0 2.0784 (1.0) 1 1 test_checkout_copy-checkout-noop[main] 879.0696 (1.83) 879.0696 (1.83) 879.0696 (1.83) 0.0000 (1.0) 879.0696 (1.83) 0.0000 (1.0) 0;0 1.1376 (0.55) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.11.0] 1.6455 (1.95) 1.6455 (1.95) 1.6455 (1.95) 0.0000 (1.0) 1.6455 (1.95) 0.0000 (1.0) 0;0 0.6077 (0.51) 1 1 test_checkout_copy-checkout-update[2.18.1] 0.8956 (1.06) 0.8956 (1.06) 0.8956 (1.06) 0.0000 (1.0) 0.8956 (1.06) 0.0000 (1.0) 0;0 1.1166 (0.94) 1 1 test_checkout_copy-checkout-update[2.39.0] 0.8440 (1.00) 0.8440 (1.00) 0.8440 (1.00) 0.0000 (1.0) 0.8440 (1.00) 0.0000 (1.0) 0;0 1.1848 (1.00) 1 1 test_checkout_copy-checkout-update[2.40.0] 0.8438 (1.0) 0.8438 (1.0) 0.8438 (1.0) 0.0000 (1.0) 0.8438 (1.0) 0.0000 (1.0) 0;0 1.1851 (1.0) 1 1 test_checkout_copy-checkout-update[2.41.1] 0.8478 (1.00) 0.8478 (1.00) 0.8478 (1.00) 0.0000 (1.0) 0.8478 (1.00) 0.0000 (1.0) 0;0 1.1795 (1.00) 1 1 test_checkout_copy-checkout-update[2.45.0] 0.8825 (1.05) 0.8825 (1.05) 0.8825 (1.05) 0.0000 (1.0) 0.8825 (1.05) 0.0000 (1.0) 0;0 1.1332 (0.96) 1 1 test_checkout_copy-checkout-update[2.6.3] 3.8634 (4.58) 3.8634 (4.58) 3.8634 (4.58) 0.0000 (1.0) 3.8634 (4.58) 0.0000 (1.0) 0;0 0.2588 (0.22) 1 1 test_checkout_copy-checkout-update[main] 0.9187 (1.09) 0.9187 (1.09) 0.9187 (1.09) 0.0000 (1.0) 0.9187 (1.09) 0.0000 (1.0) 0;0 1.0885 (0.92) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 8 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.11.0] 14.8849 (1.51) 14.8849 (1.51) 14.8849 (1.51) 0.0000 (1.0) 14.8849 (1.51) 0.0000 (1.0) 0;0 0.0672 (0.66) 1 1 test_import-import[2.18.1] 14.3592 (1.46) 14.3592 (1.46) 14.3592 (1.46) 0.0000 (1.0) 14.3592 (1.46) 0.0000 (1.0) 0;0 0.0696 (0.69) 1 1 test_import-import[2.39.0] 14.1466 (1.44) 14.1466 (1.44) 14.1466 (1.44) 0.0000 (1.0) 14.1466 (1.44) 0.0000 (1.0) 0;0 0.0707 (0.70) 1 1 test_import-import[2.40.0] 13.1709 (1.34) 13.1709 (1.34) 13.1709 (1.34) 0.0000 (1.0) 13.1709 (1.34) 0.0000 (1.0) 0;0 0.0759 (0.75) 1 1 test_import-import[2.41.1] 12.4093 (1.26) 12.4093 (1.26) 12.4093 (1.26) 0.0000 (1.0) 12.4093 (1.26) 0.0000 (1.0) 0;0 0.0806 (0.79) 1 1 test_import-import[2.45.0] 9.8365 (1.0) 9.8365 (1.0) 9.8365 (1.0) 0.0000 (1.0) 9.8365 (1.0) 0.0000 (1.0) 0;0 0.1017 (1.0) 1 1 test_import-import[2.6.3] 12.0504 (1.23) 12.0504 (1.23) 12.0504 (1.23) 0.0000 (1.0) 12.0504 (1.23) 0.0000 (1.0) 0;0 0.0830 (0.82) 1 1 test_import-import[main] 10.4946 (1.07) 10.4946 (1.07) 10.4946 (1.07) 0.0000 (1.0) 10.4946 (1.07) 0.0000 (1.0) 0;0 0.0953 (0.94) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------------- benchmark 'test_partial_remove-add': 8 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.11.0] 607.2234 (1.0) 607.2234 (1.0) 607.2234 (1.0) 0.0000 (1.0) 607.2234 (1.0) 0.0000 (1.0) 0;0 1.6468 (1.0) 1 1 test_partial_remove-add[2.18.1] 4,581.3812 (7.54) 4,581.3812 (7.54) 4,581.3812 (7.54) 0.0000 (1.0) 4,581.3812 (7.54) 0.0000 (1.0) 0;0 0.2183 (0.13) 1 1 test_partial_remove-add[2.39.0] 3,350.5540 (5.52) 3,350.5540 (5.52) 3,350.5540 (5.52) 0.0000 (1.0) 3,350.5540 (5.52) 0.0000 (1.0) 0;0 0.2985 (0.18) 1 1 test_partial_remove-add[2.40.0] 1,956.4016 (3.22) 1,956.4016 (3.22) 1,956.4016 (3.22) 0.0000 (1.0) 1,956.4016 (3.22) 0.0000 (1.0) 0;0 0.5111 (0.31) 1 1 test_partial_remove-add[2.41.1] 1,939.6479 (3.19) 1,939.6479 (3.19) 1,939.6479 (3.19) 0.0000 (1.0) 1,939.6479 (3.19) 0.0000 (1.0) 0;0 0.5156 (0.31) 1 1 test_partial_remove-add[2.45.0] 2,022.2569 (3.33) 2,022.2569 (3.33) 2,022.2569 (3.33) 0.0000 (1.0) 2,022.2569 (3.33) 0.0000 (1.0) 0;0 0.4945 (0.30) 1 1 test_partial_remove-add[2.6.3] 2,758.5660 (4.54) 2,758.5660 (4.54) 2,758.5660 (4.54) 0.0000 (1.0) 2,758.5660 (4.54) 0.0000 (1.0) 0;0 0.3625 (0.22) 1 1 test_partial_remove-add[main] 2,677.7001 (4.41) 2,677.7001 (4.41) 2,677.7001 (4.41) 0.0000 (1.0) 2,677.7001 (4.41) 0.0000 (1.0) 0;0 0.3735 (0.23) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.11.0] 464.9989 (1.15) 464.9989 (1.15) 464.9989 (1.15) 0.0000 (1.0) 464.9989 (1.15) 0.0000 (1.0) 0;0 2.1505 (0.87) 1 1 test_partial_remove-gc[2.18.1] 466.1306 (1.15) 466.1306 (1.15) 466.1306 (1.15) 0.0000 (1.0) 466.1306 (1.15) 0.0000 (1.0) 0;0 2.1453 (0.87) 1 1 test_partial_remove-gc[2.39.0] 502.4758 (1.24) 502.4758 (1.24) 502.4758 (1.24) 0.0000 (1.0) 502.4758 (1.24) 0.0000 (1.0) 0;0 1.9901 (0.81) 1 1 test_partial_remove-gc[2.40.0] 503.1827 (1.24) 503.1827 (1.24) 503.1827 (1.24) 0.0000 (1.0) 503.1827 (1.24) 0.0000 (1.0) 0;0 1.9873 (0.81) 1 1 test_partial_remove-gc[2.41.1] 503.8876 (1.24) 503.8876 (1.24) 503.8876 (1.24) 0.0000 (1.0) 503.8876 (1.24) 0.0000 (1.0) 0;0 1.9846 (0.81) 1 1 test_partial_remove-gc[2.45.0] 488.8346 (1.20) 488.8346 (1.20) 488.8346 (1.20) 0.0000 (1.0) 488.8346 (1.20) 0.0000 (1.0) 0;0 2.0457 (0.83) 1 1 test_partial_remove-gc[2.6.3] 405.9275 (1.0) 405.9275 (1.0) 405.9275 (1.0) 0.0000 (1.0) 405.9275 (1.0) 0.0000 (1.0) 0;0 2.4635 (1.0) 1 1 test_partial_remove-gc[main] 568.8963 (1.40) 568.8963 (1.40) 568.8963 (1.40) 0.0000 (1.0) 568.8963 (1.40) 0.0000 (1.0) 0;0 1.7578 (0.71) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.11.0] 481.1294 (1.06) 481.1294 (1.06) 481.1294 (1.06) 0.0000 (1.0) 481.1294 (1.06) 0.0000 (1.0) 0;0 2.0784 (0.94) 1 1 test_partial_remove-gc-cloud[2.18.1] 494.0592 (1.09) 494.0592 (1.09) 494.0592 (1.09) 0.0000 (1.0) 494.0592 (1.09) 0.0000 (1.0) 0;0 2.0240 (0.92) 1 1 test_partial_remove-gc-cloud[2.39.0] 531.1202 (1.17) 531.1202 (1.17) 531.1202 (1.17) 0.0000 (1.0) 531.1202 (1.17) 0.0000 (1.0) 0;0 1.8828 (0.85) 1 1 test_partial_remove-gc-cloud[2.40.0] 553.5432 (1.22) 553.5432 (1.22) 553.5432 (1.22) 0.0000 (1.0) 553.5432 (1.22) 0.0000 (1.0) 0;0 1.8065 (0.82) 1 1 test_partial_remove-gc-cloud[2.41.1] 537.7749 (1.19) 537.7749 (1.19) 537.7749 (1.19) 0.0000 (1.0) 537.7749 (1.19) 0.0000 (1.0) 0;0 1.8595 (0.84) 1 1 test_partial_remove-gc-cloud[2.45.0] 532.4016 (1.18) 532.4016 (1.18) 532.4016 (1.18) 0.0000 (1.0) 532.4016 (1.18) 0.0000 (1.0) 0;0 1.8783 (0.85) 1 1 test_partial_remove-gc-cloud[2.6.3] 452.3057 (1.0) 452.3057 (1.0) 452.3057 (1.0) 0.0000 (1.0) 452.3057 (1.0) 0.0000 (1.0) 0;0 2.2109 (1.0) 1 1 test_partial_remove-gc-cloud[main] 604.0514 (1.34) 604.0514 (1.34) 604.0514 (1.34) 0.0000 (1.0) 604.0514 (1.34) 0.0000 (1.0) 0;0 1.6555 (0.75) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.11.0] 390.0157 (1.0) 390.0157 (1.0) 390.0157 (1.0) 0.0000 (1.0) 390.0157 (1.0) 0.0000 (1.0) 0;0 2.5640 (1.0) 1 1 test_partial_remove-push[2.18.1] 478.6762 (1.23) 478.6762 (1.23) 478.6762 (1.23) 0.0000 (1.0) 478.6762 (1.23) 0.0000 (1.0) 0;0 2.0891 (0.81) 1 1 test_partial_remove-push[2.39.0] 529.7585 (1.36) 529.7585 (1.36) 529.7585 (1.36) 0.0000 (1.0) 529.7585 (1.36) 0.0000 (1.0) 0;0 1.8877 (0.74) 1 1 test_partial_remove-push[2.40.0] 494.9680 (1.27) 494.9680 (1.27) 494.9680 (1.27) 0.0000 (1.0) 494.9680 (1.27) 0.0000 (1.0) 0;0 2.0203 (0.79) 1 1 test_partial_remove-push[2.41.1] 491.0482 (1.26) 491.0482 (1.26) 491.0482 (1.26) 0.0000 (1.0) 491.0482 (1.26) 0.0000 (1.0) 0;0 2.0365 (0.79) 1 1 test_partial_remove-push[2.45.0] 491.9273 (1.26) 491.9273 (1.26) 491.9273 (1.26) 0.0000 (1.0) 491.9273 (1.26) 0.0000 (1.0) 0;0 2.0328 (0.79) 1 1 test_partial_remove-push[2.6.3] 416.6608 (1.07) 416.6608 (1.07) 416.6608 (1.07) 0.0000 (1.0) 416.6608 (1.07) 0.0000 (1.0) 0;0 2.4000 (0.94) 1 1 test_partial_remove-push[main] 563.2849 (1.44) 563.2849 (1.44) 563.2849 (1.44) 0.0000 (1.0) 563.2849 (1.44) 0.0000 (1.0) 0;0 1.7753 (0.69) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 8 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial-add[2.11.0] 4.8312 (1.56) 4.8312 (1.56) 4.8312 (1.56) 0.0000 (1.0) 4.8312 (1.56) 0.0000 (1.0) 0;0 0.2070 (0.64) 1 1 test_partial_add-add-partial-add[2.18.1] 5.0641 (1.63) 5.0641 (1.63) 5.0641 (1.63) 0.0000 (1.0) 5.0641 (1.63) 0.0000 (1.0) 0;0 0.1975 (0.61) 1 1 test_partial_add-add-partial-add[2.39.0] 4.3499 (1.40) 4.3499 (1.40) 4.3499 (1.40) 0.0000 (1.0) 4.3499 (1.40) 0.0000 (1.0) 0;0 0.2299 (0.71) 1 1 test_partial_add-add-partial-add[2.40.0] 4.3466 (1.40) 4.3466 (1.40) 4.3466 (1.40) 0.0000 (1.0) 4.3466 (1.40) 0.0000 (1.0) 0;0 0.2301 (0.71) 1 1 test_partial_add-add-partial-add[2.41.1] 4.2961 (1.39) 4.2961 (1.39) 4.2961 (1.39) 0.0000 (1.0) 4.2961 (1.39) 0.0000 (1.0) 0;0 0.2328 (0.72) 1 1 test_partial_add-add-partial-add[2.45.0] 3.0978 (1.0) 3.0978 (1.0) 3.0978 (1.0) 0.0000 (1.0) 3.0978 (1.0) 0.0000 (1.0) 0;0 0.3228 (1.0) 1 1 test_partial_add-add-partial-add[2.6.3] 8.9095 (2.88) 8.9095 (2.88) 8.9095 (2.88) 0.0000 (1.0) 8.9095 (2.88) 0.0000 (1.0) 0;0 0.1122 (0.35) 1 1 test_partial_add-add-partial-add[main] 3.6972 (1.19) 3.6972 (1.19) 3.6972 (1.19) 0.0000 (1.0) 3.6972 (1.19) 0.0000 (1.0) 0;0 0.2705 (0.84) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.11.0] 459.8468 (1.0) 459.8468 (1.0) 459.8468 (1.0) 0.0000 (1.0) 459.8468 (1.0) 0.0000 (1.0) 0;0 2.1746 (1.0) 1 1 test_partial_add-gc-cloud-noop[2.18.1] 537.7777 (1.17) 537.7777 (1.17) 537.7777 (1.17) 0.0000 (1.0) 537.7777 (1.17) 0.0000 (1.0) 0;0 1.8595 (0.86) 1 1 test_partial_add-gc-cloud-noop[2.39.0] 573.3614 (1.25) 573.3614 (1.25) 573.3614 (1.25) 0.0000 (1.0) 573.3614 (1.25) 0.0000 (1.0) 0;0 1.7441 (0.80) 1 1 test_partial_add-gc-cloud-noop[2.40.0] 578.1367 (1.26) 578.1367 (1.26) 578.1367 (1.26) 0.0000 (1.0) 578.1367 (1.26) 0.0000 (1.0) 0;0 1.7297 (0.80) 1 1 test_partial_add-gc-cloud-noop[2.41.1] 582.3674 (1.27) 582.3674 (1.27) 582.3674 (1.27) 0.0000 (1.0) 582.3674 (1.27) 0.0000 (1.0) 0;0 1.7171 (0.79) 1 1 test_partial_add-gc-cloud-noop[2.45.0] 547.6788 (1.19) 547.6788 (1.19) 547.6788 (1.19) 0.0000 (1.0) 547.6788 (1.19) 0.0000 (1.0) 0;0 1.8259 (0.84) 1 1 test_partial_add-gc-cloud-noop[2.6.3] 470.1832 (1.02) 470.1832 (1.02) 470.1832 (1.02) 0.0000 (1.0) 470.1832 (1.02) 0.0000 (1.0) 0;0 2.1268 (0.98) 1 1 test_partial_add-gc-cloud-noop[main] 662.6368 (1.44) 662.6368 (1.44) 662.6368 (1.44) 0.0000 (1.0) 662.6368 (1.44) 0.0000 (1.0) 0;0 1.5091 (0.69) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 8 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.11.0] 425.1942 (1.08) 425.1942 (1.08) 425.1942 (1.08) 0.0000 (1.0) 425.1942 (1.08) 0.0000 (1.0) 0;0 2.3519 (0.92) 1 1 test_partial_add-gc-noop[2.18.1] 477.9085 (1.22) 477.9085 (1.22) 477.9085 (1.22) 0.0000 (1.0) 477.9085 (1.22) 0.0000 (1.0) 0;0 2.0925 (0.82) 1 1 test_partial_add-gc-noop[2.39.0] 498.3328 (1.27) 498.3328 (1.27) 498.3328 (1.27) 0.0000 (1.0) 498.3328 (1.27) 0.0000 (1.0) 0;0 2.0067 (0.79) 1 1 test_partial_add-gc-noop[2.40.0] 507.8049 (1.30) 507.8049 (1.30) 507.8049 (1.30) 0.0000 (1.0) 507.8049 (1.30) 0.0000 (1.0) 0;0 1.9693 (0.77) 1 1 test_partial_add-gc-noop[2.41.1] 509.4242 (1.30) 509.4242 (1.30) 509.4242 (1.30) 0.0000 (1.0) 509.4242 (1.30) 0.0000 (1.0) 0;0 1.9630 (0.77) 1 1 test_partial_add-gc-noop[2.45.0] 507.1850 (1.29) 507.1850 (1.29) 507.1850 (1.29) 0.0000 (1.0) 507.1850 (1.29) 0.0000 (1.0) 0;0 1.9717 (0.77) 1 1 test_partial_add-gc-noop[2.6.3] 392.0811 (1.0) 392.0811 (1.0) 392.0811 (1.0) 0.0000 (1.0) 392.0811 (1.0) 0.0000 (1.0) 0;0 2.5505 (1.0) 1 1 test_partial_add-gc-noop[main] 592.2383 (1.51) 592.2383 (1.51) 592.2383 (1.51) 0.0000 (1.0) 592.2383 (1.51) 0.0000 (1.0) 0;0 1.6885 (0.66) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial-add': 8 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_partial_add-push-partial-add[2.11.0] 471.2662 (1.0) 471.2662 (1.0) 471.2662 (1.0) 0.0000 (1.0) 471.2662 (1.0) 0.0000 (1.0) 0;0 2.1219 (1.0) 1 1 test_partial_add-push-partial-add[2.18.1] 2,315.7815 (4.91) 2,315.7815 (4.91) 2,315.7815 (4.91) 0.0000 (1.0) 2,315.7815 (4.91) 0.0000 (1.0) 0;0 0.4318 (0.20) 1 1 test_partial_add-push-partial-add[2.39.0] 2,777.5950 (5.89) 2,777.5950 (5.89) 2,777.5950 (5.89) 0.0000 (1.0) 2,777.5950 (5.89) 0.0000 (1.0) 0;0 0.3600 (0.17) 1 1 test_partial_add-push-partial-add[2.40.0] 2,795.8010 (5.93) 2,795.8010 (5.93) 2,795.8010 (5.93) 0.0000 (1.0) 2,795.8010 (5.93) 0.0000 (1.0) 0;0 0.3577 (0.17) 1 1 test_partial_add-push-partial-add[2.41.1] 2,728.6976 (5.79) 2,728.6976 (5.79) 2,728.6976 (5.79) 0.0000 (1.0) 2,728.6976 (5.79) 0.0000 (1.0) 0;0 0.3665 (0.17) 1 1 test_partial_add-push-partial-add[2.45.0] 523.5832 (1.11) 523.5832 (1.11) 523.5832 (1.11) 0.0000 (1.0) 523.5832 (1.11) 0.0000 (1.0) 0;0 1.9099 (0.90) 1 1 test_partial_add-push-partial-add[2.6.3] 3,263.8657 (6.93) 3,263.8657 (6.93) 3,263.8657 (6.93) 0.0000 (1.0) 3,263.8657 (6.93) 0.0000 (1.0) 0;0 0.3064 (0.14) 1 1 test_partial_add-push-partial-add[main] 3,558.5469 (7.55) 3,558.5469 (7.55) 3,558.5469 (7.55) 0.0000 (1.0) 3,558.5469 (7.55) 0.0000 (1.0) 0;0 0.2810 (0.13) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 year ago 
github-actions[bot]
commented
1 year ago