Closed pmrowla closed 1 year ago
Tue May 9 07:35:49 UTC 2023 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.39.0] 1.1048 (1.17) 1.1229 (1.18) 1.1131 (1.17) 0.0076 (3.53) 1.1116 (1.17) 0.0131 (6.85) 2;0 0.8984 (0.85) 5 3 test_plots-plots-diff[2.40.0] 1.1317 (1.20) 1.1446 (1.20) 1.1377 (1.20) 0.0047 (2.17) 1.1375 (1.20) 0.0052 (2.70) 2;0 0.8790 (0.83) 5 3 test_plots-plots-diff[2.41.1] 1.1101 (1.17) 1.1202 (1.18) 1.1139 (1.17) 0.0041 (1.89) 1.1121 (1.17) 0.0057 (2.96) 1;0 0.8978 (0.85) 5 3 test_plots-plots-diff[2.45.0] 1.0091 (1.07) 1.0299 (1.08) 1.0180 (1.07) 0.0083 (3.83) 1.0181 (1.07) 0.0127 (6.62) 2;0 0.9823 (0.93) 5 3 test_plots-plots-diff[main] 0.9453 (1.0) 0.9513 (1.0) 0.9486 (1.0) 0.0022 (1.0) 0.9487 (1.0) 0.0019 (1.0) 2;0 1.0542 (1.0) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.39.0] 2.0522 (1.64) 2.0853 (1.64) 2.0665 (1.63) 0.0122 (2.05) 2.0663 (1.64) 0.0138 (1.64) 2;0 0.4839 (0.61) 5 3 test_plots-plots-diff-json[2.40.0] 2.0764 (1.66) 2.1038 (1.65) 2.0888 (1.65) 0.0109 (1.84) 2.0884 (1.66) 0.0173 (2.06) 2;0 0.4787 (0.61) 5 3 test_plots-plots-diff-json[2.41.1] 2.0538 (1.64) 2.0688 (1.62) 2.0596 (1.63) 0.0059 (1.0) 2.0586 (1.63) 0.0084 (1.0) 1;0 0.4855 (0.61) 5 3 test_plots-plots-diff-json[2.45.0] 1.8436 (1.47) 1.8764 (1.47) 1.8560 (1.47) 0.0127 (2.14) 1.8518 (1.47) 0.0158 (1.88) 1;0 0.5388 (0.68) 5 3 test_plots-plots-diff-json[main] 1.2532 (1.0) 1.2751 (1.0) 1.2641 (1.0) 0.0102 (1.71) 1.2612 (1.0) 0.0190 (2.25) 3;0 0.7911 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_plots-plots-show[2.39.0] 750.9406 (1.06) 767.8652 (1.06) 759.3422 (1.07) 6.3474 (1.21) 758.3995 (1.07) 8.5664 (1.76) 2;0 1.3169 (0.94) 5 3 test_plots-plots-show[2.40.0] 742.8803 (1.05) 771.3070 (1.07) 757.1242 (1.06) 10.2072 (1.94) 758.5789 (1.07) 10.3963 (2.13) 2;0 1.3208 (0.94) 5 3 test_plots-plots-show[2.41.1] 749.8849 (1.06) 772.4829 (1.07) 756.3790 (1.06) 9.3068 (1.77) 752.6432 (1.06) 9.5820 (1.97) 1;0 1.3221 (0.94) 5 3 test_plots-plots-show[2.45.0] 708.6199 (1.0) 721.5893 (1.0) 712.4393 (1.0) 5.2658 (1.0) 711.3777 (1.0) 4.8733 (1.0) 1;1 1.4036 (1.0) 5 3 test_plots-plots-show[main] 764.4922 (1.08) 781.9160 (1.08) 772.9966 (1.08) 6.2405 (1.19) 773.3011 (1.09) 6.3524 (1.30) 2;0 1.2937 (0.92) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.39.0] 1.2494 (1.33) 1.2636 (1.33) 1.2548 (1.33) 0.0056 (2.48) 1.2529 (1.33) 0.0076 (2.23) 1;0 0.7969 (0.75) 5 3 test_plots-plots-show-json[2.40.0] 1.2803 (1.36) 1.3181 (1.39) 1.2959 (1.37) 0.0152 (6.74) 1.2991 (1.37) 0.0216 (6.34) 2;0 0.7716 (0.73) 5 3 test_plots-plots-show-json[2.41.1] 1.2505 (1.33) 1.2821 (1.35) 1.2588 (1.33) 0.0132 (5.84) 1.2545 (1.33) 0.0102 (2.98) 1;1 0.7944 (0.75) 5 3 test_plots-plots-show-json[2.45.0] 1.1557 (1.23) 1.1649 (1.23) 1.1610 (1.23) 0.0035 (1.57) 1.1609 (1.23) 0.0049 (1.43) 2;0 0.8613 (0.81) 5 3 test_plots-plots-show-json[main] 0.9418 (1.0) 0.9473 (1.0) 0.9451 (1.0) 0.0023 (1.0) 0.9451 (1.0) 0.0034 (1.0) 1;0 1.0581 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.18.1] 1.3792 (1.0) 1.3792 (1.0) 1.3792 (1.0) 0.0000 (1.0) 1.3792 (1.0) 0.0000 (1.0) 0;0 0.7251 (1.0) 1 1 test_data_status_all_flags-data-changed[2.39.0] 1.5245 (1.11) 1.5245 (1.11) 1.5245 (1.11) 0.0000 (1.0) 1.5245 (1.11) 0.0000 (1.0) 0;0 0.6559 (0.90) 1 1 test_data_status_all_flags-data-changed[2.40.0] 1.5346 (1.11) 1.5346 (1.11) 1.5346 (1.11) 0.0000 (1.0) 1.5346 (1.11) 0.0000 (1.0) 0;0 0.6516 (0.90) 1 1 test_data_status_all_flags-data-changed[2.41.1] 1.5455 (1.12) 1.5455 (1.12) 1.5455 (1.12) 0.0000 (1.0) 1.5455 (1.12) 0.0000 (1.0) 0;0 0.6470 (0.89) 1 1 test_data_status_all_flags-data-changed[2.45.0] 1.5295 (1.11) 1.5295 (1.11) 1.5295 (1.11) 0.0000 (1.0) 1.5295 (1.11) 0.0000 (1.0) 0;0 0.6538 (0.90) 1 1 test_data_status_all_flags-data-changed[main] 1.4609 (1.06) 1.4609 (1.06) 1.4609 (1.06) 0.0000 (1.0) 1.4609 (1.06) 0.0000 (1.0) 0;0 0.6845 (0.94) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.18.1] 1.6002 (1.12) 1.6002 (1.12) 1.6002 (1.12) 0.0000 (1.0) 1.6002 (1.12) 0.0000 (1.0) 0;0 0.6249 (0.89) 1 1 test_data_status_all_flags-data-changed-noop[2.39.0] 1.5561 (1.09) 1.5561 (1.09) 1.5561 (1.09) 0.0000 (1.0) 1.5561 (1.09) 0.0000 (1.0) 0;0 0.6426 (0.92) 1 1 test_data_status_all_flags-data-changed-noop[2.40.0] 1.5775 (1.10) 1.5775 (1.10) 1.5775 (1.10) 0.0000 (1.0) 1.5775 (1.10) 0.0000 (1.0) 0;0 0.6339 (0.91) 1 1 test_data_status_all_flags-data-changed-noop[2.41.1] 1.4276 (1.0) 1.4276 (1.0) 1.4276 (1.0) 0.0000 (1.0) 1.4276 (1.0) 0.0000 (1.0) 0;0 0.7005 (1.0) 1 1 test_data_status_all_flags-data-changed-noop[2.45.0] 1.4719 (1.03) 1.4719 (1.03) 1.4719 (1.03) 0.0000 (1.0) 1.4719 (1.03) 0.0000 (1.0) 0;0 0.6794 (0.97) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.4593 (1.02) 1.4593 (1.02) 1.4593 (1.02) 0.0000 (1.0) 1.4593 (1.02) 0.0000 (1.0) 0;0 0.6853 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.18.1] 2.4166 (1.0) 2.4166 (1.0) 2.4166 (1.0) 0.0000 (1.0) 2.4166 (1.0) 0.0000 (1.0) 0;0 0.4138 (1.0) 1 1 test_data_status_all_flags-data-new[2.39.0] 2.6029 (1.08) 2.6029 (1.08) 2.6029 (1.08) 0.0000 (1.0) 2.6029 (1.08) 0.0000 (1.0) 0;0 0.3842 (0.93) 1 1 test_data_status_all_flags-data-new[2.40.0] 2.6466 (1.10) 2.6466 (1.10) 2.6466 (1.10) 0.0000 (1.0) 2.6466 (1.10) 0.0000 (1.0) 0;0 0.3778 (0.91) 1 1 test_data_status_all_flags-data-new[2.41.1] 2.7105 (1.12) 2.7105 (1.12) 2.7105 (1.12) 0.0000 (1.0) 2.7105 (1.12) 0.0000 (1.0) 0;0 0.3689 (0.89) 1 1 test_data_status_all_flags-data-new[2.45.0] 2.5152 (1.04) 2.5152 (1.04) 2.5152 (1.04) 0.0000 (1.0) 2.5152 (1.04) 0.0000 (1.0) 0;0 0.3976 (0.96) 1 1 test_data_status_all_flags-data-new[main] 2.6254 (1.09) 2.6254 (1.09) 2.6254 (1.09) 0.0000 (1.0) 2.6254 (1.09) 0.0000 (1.0) 0;0 0.3809 (0.92) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.18.1] 1.3515 (1.0) 1.3515 (1.0) 1.3515 (1.0) 0.0000 (1.0) 1.3515 (1.0) 0.0000 (1.0) 0;0 0.7399 (1.0) 1 1 test_data_status_all_flags-data-noop[2.39.0] 1.5485 (1.15) 1.5485 (1.15) 1.5485 (1.15) 0.0000 (1.0) 1.5485 (1.15) 0.0000 (1.0) 0;0 0.6458 (0.87) 1 1 test_data_status_all_flags-data-noop[2.40.0] 1.3826 (1.02) 1.3826 (1.02) 1.3826 (1.02) 0.0000 (1.0) 1.3826 (1.02) 0.0000 (1.0) 0;0 0.7233 (0.98) 1 1 test_data_status_all_flags-data-noop[2.41.1] 1.4413 (1.07) 1.4413 (1.07) 1.4413 (1.07) 0.0000 (1.0) 1.4413 (1.07) 0.0000 (1.0) 0;0 0.6938 (0.94) 1 1 test_data_status_all_flags-data-noop[2.45.0] 1.3752 (1.02) 1.3752 (1.02) 1.3752 (1.02) 0.0000 (1.0) 1.3752 (1.02) 0.0000 (1.0) 0;0 0.7272 (0.98) 1 1 test_data_status_all_flags-data-noop[main] 1.4259 (1.06) 1.4259 (1.06) 1.4259 (1.06) 0.0000 (1.0) 1.4259 (1.06) 0.0000 (1.0) 0;0 0.7013 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_sharing-add': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.11.0] 10.1089 (1.81) 10.1089 (1.81) 10.1089 (1.81) 0.0000 (1.0) 10.1089 (1.81) 0.0000 (1.0) 0;0 0.0989 (0.55) 1 1 test_sharing-add[2.18.1] 9.3622 (1.67) 9.3622 (1.67) 9.3622 (1.67) 0.0000 (1.0) 9.3622 (1.67) 0.0000 (1.0) 0;0 0.1068 (0.60) 1 1 test_sharing-add[2.39.0] 8.6743 (1.55) 8.6743 (1.55) 8.6743 (1.55) 0.0000 (1.0) 8.6743 (1.55) 0.0000 (1.0) 0;0 0.1153 (0.64) 1 1 test_sharing-add[2.40.0] 8.6663 (1.55) 8.6663 (1.55) 8.6663 (1.55) 0.0000 (1.0) 8.6663 (1.55) 0.0000 (1.0) 0;0 0.1154 (0.65) 1 1 test_sharing-add[2.41.1] 8.4871 (1.52) 8.4871 (1.52) 8.4871 (1.52) 0.0000 (1.0) 8.4871 (1.52) 0.0000 (1.0) 0;0 0.1178 (0.66) 1 1 test_sharing-add[2.45.0] 5.5903 (1.0) 5.5903 (1.0) 5.5903 (1.0) 0.0000 (1.0) 5.5903 (1.0) 0.0000 (1.0) 0;0 0.1789 (1.0) 1 1 test_sharing-add[main] 5.6182 (1.00) 5.6182 (1.00) 5.6182 (1.00) 0.0000 (1.0) 5.6182 (1.00) 0.0000 (1.0) 0;0 0.1780 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.11.0] 4.8185 (1.41) 4.8185 (1.41) 4.8185 (1.41) 0.0000 (1.0) 4.8185 (1.41) 0.0000 (1.0) 0;0 0.2075 (0.71) 1 1 test_sharing-add-noop[2.18.1] 5.1925 (1.52) 5.1925 (1.52) 5.1925 (1.52) 0.0000 (1.0) 5.1925 (1.52) 0.0000 (1.0) 0;0 0.1926 (0.66) 1 1 test_sharing-add-noop[2.39.0] 3.5240 (1.03) 3.5240 (1.03) 3.5240 (1.03) 0.0000 (1.0) 3.5240 (1.03) 0.0000 (1.0) 0;0 0.2838 (0.97) 1 1 test_sharing-add-noop[2.40.0] 3.5726 (1.04) 3.5726 (1.04) 3.5726 (1.04) 0.0000 (1.0) 3.5726 (1.04) 0.0000 (1.0) 0;0 0.2799 (0.96) 1 1 test_sharing-add-noop[2.41.1] 3.4240 (1.0) 3.4240 (1.0) 3.4240 (1.0) 0.0000 (1.0) 3.4240 (1.0) 0.0000 (1.0) 0;0 0.2921 (1.0) 1 1 test_sharing-add-noop[2.45.0] 3.5889 (1.05) 3.5889 (1.05) 3.5889 (1.05) 0.0000 (1.0) 3.5889 (1.05) 0.0000 (1.0) 0;0 0.2786 (0.95) 1 1 test_sharing-add-noop[main] 3.6655 (1.07) 3.6655 (1.07) 3.6655 (1.07) 0.0000 (1.0) 3.6655 (1.07) 0.0000 (1.0) 0;0 0.2728 (0.93) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.11.0] 630.3138 (1.0) 630.3138 (1.0) 630.3138 (1.0) 0.0000 (1.0) 630.3138 (1.0) 0.0000 (1.0) 0;0 1.5865 (1.0) 1 1 test_sharing-checkout-noop[2.18.1] 829.8407 (1.32) 829.8407 (1.32) 829.8407 (1.32) 0.0000 (1.0) 829.8407 (1.32) 0.0000 (1.0) 0;0 1.2051 (0.76) 1 1 test_sharing-checkout-noop[2.39.0] 810.8946 (1.29) 810.8946 (1.29) 810.8946 (1.29) 0.0000 (1.0) 810.8946 (1.29) 0.0000 (1.0) 0;0 1.2332 (0.78) 1 1 test_sharing-checkout-noop[2.40.0] 832.9323 (1.32) 832.9323 (1.32) 832.9323 (1.32) 0.0000 (1.0) 832.9323 (1.32) 0.0000 (1.0) 0;0 1.2006 (0.76) 1 1 test_sharing-checkout-noop[2.41.1] 794.7480 (1.26) 794.7480 (1.26) 794.7480 (1.26) 0.0000 (1.0) 794.7480 (1.26) 0.0000 (1.0) 0;0 1.2583 (0.79) 1 1 test_sharing-checkout-noop[2.45.0] 838.5153 (1.33) 838.5153 (1.33) 838.5153 (1.33) 0.0000 (1.0) 838.5153 (1.33) 0.0000 (1.0) 0;0 1.1926 (0.75) 1 1 test_sharing-checkout-noop[main] 973.7798 (1.54) 973.7798 (1.54) 973.7798 (1.54) 0.0000 (1.0) 973.7798 (1.54) 0.0000 (1.0) 0;0 1.0269 (0.65) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing-pull': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[2.11.0] 10.6503 (1.07) 10.6503 (1.07) 10.6503 (1.07) 0.0000 (1.0) 10.6503 (1.07) 0.0000 (1.0) 0;0 0.0939 (0.94) 1 1 test_sharing-pull[2.18.1] 10.3946 (1.04) 10.3946 (1.04) 10.3946 (1.04) 0.0000 (1.0) 10.3946 (1.04) 0.0000 (1.0) 0;0 0.0962 (0.96) 1 1 test_sharing-pull[2.39.0] 12.6514 (1.27) 12.6514 (1.27) 12.6514 (1.27) 0.0000 (1.0) 12.6514 (1.27) 0.0000 (1.0) 0;0 0.0790 (0.79) 1 1 test_sharing-pull[2.40.0] 12.6304 (1.26) 12.6304 (1.26) 12.6304 (1.26) 0.0000 (1.0) 12.6304 (1.26) 0.0000 (1.0) 0;0 0.0792 (0.79) 1 1 test_sharing-pull[2.41.1] 12.1685 (1.22) 12.1685 (1.22) 12.1685 (1.22) 0.0000 (1.0) 12.1685 (1.22) 0.0000 (1.0) 0;0 0.0822 (0.82) 1 1 test_sharing-pull[2.45.0] 9.9936 (1.0) 9.9936 (1.0) 9.9936 (1.0) 0.0000 (1.0) 9.9936 (1.0) 0.0000 (1.0) 0;0 0.1001 (1.0) 1 1 test_sharing-pull[main] 10.0061 (1.00) 10.0061 (1.00) 10.0061 (1.00) 0.0000 (1.0) 10.0061 (1.00) 0.0000 (1.0) 0;0 0.0999 (1.00) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[2.11.0] 661.4247 (1.0) 661.4247 (1.0) 661.4247 (1.0) 0.0000 (1.0) 661.4247 (1.0) 0.0000 (1.0) 0;0 1.5119 (1.0) 1 1 test_sharing-pull-noop[2.18.1] 856.1649 (1.29) 856.1649 (1.29) 856.1649 (1.29) 0.0000 (1.0) 856.1649 (1.29) 0.0000 (1.0) 0;0 1.1680 (0.77) 1 1 test_sharing-pull-noop[2.39.0] 923.6001 (1.40) 923.6001 (1.40) 923.6001 (1.40) 0.0000 (1.0) 923.6001 (1.40) 0.0000 (1.0) 0;0 1.0827 (0.72) 1 1 test_sharing-pull-noop[2.40.0] 850.1479 (1.29) 850.1479 (1.29) 850.1479 (1.29) 0.0000 (1.0) 850.1479 (1.29) 0.0000 (1.0) 0;0 1.1763 (0.78) 1 1 test_sharing-pull-noop[2.41.1] 863.5709 (1.31) 863.5709 (1.31) 863.5709 (1.31) 0.0000 (1.0) 863.5709 (1.31) 0.0000 (1.0) 0;0 1.1580 (0.77) 1 1 test_sharing-pull-noop[2.45.0] 925.3484 (1.40) 925.3484 (1.40) 925.3484 (1.40) 0.0000 (1.0) 925.3484 (1.40) 0.0000 (1.0) 0;0 1.0807 (0.71) 1 1 test_sharing-pull-noop[main] 998.4325 (1.51) 998.4325 (1.51) 998.4325 (1.51) 0.0000 (1.0) 998.4325 (1.51) 0.0000 (1.0) 0;0 1.0016 (0.66) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.11.0] 5.8073 (1.19) 5.8073 (1.19) 5.8073 (1.19) 0.0000 (1.0) 5.8073 (1.19) 0.0000 (1.0) 0;0 0.1722 (0.84) 1 1 test_sharing-push[2.18.1] 5.8154 (1.19) 5.8154 (1.19) 5.8154 (1.19) 0.0000 (1.0) 5.8154 (1.19) 0.0000 (1.0) 0;0 0.1720 (0.84) 1 1 test_sharing-push[2.39.0] 7.4794 (1.53) 7.4794 (1.53) 7.4794 (1.53) 0.0000 (1.0) 7.4794 (1.53) 0.0000 (1.0) 0;0 0.1337 (0.65) 1 1 test_sharing-push[2.40.0] 7.3210 (1.50) 7.3210 (1.50) 7.3210 (1.50) 0.0000 (1.0) 7.3210 (1.50) 0.0000 (1.0) 0;0 0.1366 (0.67) 1 1 test_sharing-push[2.41.1] 7.1313 (1.46) 7.1313 (1.46) 7.1313 (1.46) 0.0000 (1.0) 7.1313 (1.46) 0.0000 (1.0) 0;0 0.1402 (0.68) 1 1 test_sharing-push[2.45.0] 4.8751 (1.0) 4.8751 (1.0) 4.8751 (1.0) 0.0000 (1.0) 4.8751 (1.0) 0.0000 (1.0) 0;0 0.2051 (1.0) 1 1 test_sharing-push[main] 5.0843 (1.04) 5.0843 (1.04) 5.0843 (1.04) 0.0000 (1.0) 5.0843 (1.04) 0.0000 (1.0) 0;0 0.1967 (0.96) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.11.0] 574.3745 (1.03) 574.3745 (1.03) 574.3745 (1.03) 0.0000 (1.0) 574.3745 (1.03) 0.0000 (1.0) 0;0 1.7410 (0.98) 1 1 test_sharing-push-noop[2.18.1] 560.2881 (1.0) 560.2881 (1.0) 560.2881 (1.0) 0.0000 (1.0) 560.2881 (1.0) 0.0000 (1.0) 0;0 1.7848 (1.0) 1 1 test_sharing-push-noop[2.39.0] 654.8051 (1.17) 654.8051 (1.17) 654.8051 (1.17) 0.0000 (1.0) 654.8051 (1.17) 0.0000 (1.0) 0;0 1.5272 (0.86) 1 1 test_sharing-push-noop[2.40.0] 626.9413 (1.12) 626.9413 (1.12) 626.9413 (1.12) 0.0000 (1.0) 626.9413 (1.12) 0.0000 (1.0) 0;0 1.5950 (0.89) 1 1 test_sharing-push-noop[2.41.1] 621.6445 (1.11) 621.6445 (1.11) 621.6445 (1.11) 0.0000 (1.0) 621.6445 (1.11) 0.0000 (1.0) 0;0 1.6086 (0.90) 1 1 test_sharing-push-noop[2.45.0] 626.1188 (1.12) 626.1188 (1.12) 626.1188 (1.12) 0.0000 (1.0) 626.1188 (1.12) 0.0000 (1.0) 0;0 1.5971 (0.89) 1 1 test_sharing-push-noop[main] 719.4900 (1.28) 719.4900 (1.28) 719.4900 (1.28) 0.0000 (1.0) 719.4900 (1.28) 0.0000 (1.0) 0;0 1.3899 (0.78) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.11.0] 8.1038 (1.41) 8.1038 (1.41) 8.1038 (1.41) 0.0000 (1.0) 8.1038 (1.41) 0.0000 (1.0) 0;0 0.1234 (0.71) 1 1 test_get-get[2.18.1] 7.5568 (1.32) 7.5568 (1.32) 7.5568 (1.32) 0.0000 (1.0) 7.5568 (1.32) 0.0000 (1.0) 0;0 0.1323 (0.76) 1 1 test_get-get[2.39.0] 6.2264 (1.08) 6.2264 (1.08) 6.2264 (1.08) 0.0000 (1.0) 6.2264 (1.08) 0.0000 (1.0) 0;0 0.1606 (0.92) 1 1 test_get-get[2.40.0] 5.7458 (1.0) 5.7458 (1.0) 5.7458 (1.0) 0.0000 (1.0) 5.7458 (1.0) 0.0000 (1.0) 0;0 0.1740 (1.0) 1 1 test_get-get[2.41.1] 5.7495 (1.00) 5.7495 (1.00) 5.7495 (1.00) 0.0000 (1.0) 5.7495 (1.00) 0.0000 (1.0) 0;0 0.1739 (1.00) 1 1 test_get-get[2.45.0] 6.1338 (1.07) 6.1338 (1.07) 6.1338 (1.07) 0.0000 (1.0) 6.1338 (1.07) 0.0000 (1.0) 0;0 0.1630 (0.94) 1 1 test_get-get[main] 7.8445 (1.37) 7.8445 (1.37) 7.8445 (1.37) 0.0000 (1.0) 7.8445 (1.37) 0.0000 (1.0) 0;0 0.1275 (0.73) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.11.0] 1.6328 (1.03) 1.6328 (1.03) 1.6328 (1.03) 0.0000 (1.0) 1.6328 (1.03) 0.0000 (1.0) 0;0 0.6125 (0.97) 1 1 test_checkout_symlink-checkout[2.18.1] 1.7257 (1.09) 1.7257 (1.09) 1.7257 (1.09) 0.0000 (1.0) 1.7257 (1.09) 0.0000 (1.0) 0;0 0.5795 (0.92) 1 1 test_checkout_symlink-checkout[2.39.0] 1.8544 (1.17) 1.8544 (1.17) 1.8544 (1.17) 0.0000 (1.0) 1.8544 (1.17) 0.0000 (1.0) 0;0 0.5393 (0.85) 1 1 test_checkout_symlink-checkout[2.40.0] 1.6099 (1.02) 1.6099 (1.02) 1.6099 (1.02) 0.0000 (1.0) 1.6099 (1.02) 0.0000 (1.0) 0;0 0.6212 (0.98) 1 1 test_checkout_symlink-checkout[2.41.1] 1.5833 (1.0) 1.5833 (1.0) 1.5833 (1.0) 0.0000 (1.0) 1.5833 (1.0) 0.0000 (1.0) 0;0 0.6316 (1.0) 1 1 test_checkout_symlink-checkout[2.45.0] 2.1732 (1.37) 2.1732 (1.37) 2.1732 (1.37) 0.0000 (1.0) 2.1732 (1.37) 0.0000 (1.0) 0;0 0.4602 (0.73) 1 1 test_checkout_symlink-checkout[main] 2.0497 (1.29) 2.0497 (1.29) 2.0497 (1.29) 0.0000 (1.0) 2.0497 (1.29) 0.0000 (1.0) 0;0 0.4879 (0.77) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.11.0] 611.6357 (1.0) 611.6357 (1.0) 611.6357 (1.0) 0.0000 (1.0) 611.6357 (1.0) 0.0000 (1.0) 0;0 1.6350 (1.0) 1 1 test_checkout_symlink-checkout-noop[2.18.1] 662.1045 (1.08) 662.1045 (1.08) 662.1045 (1.08) 0.0000 (1.0) 662.1045 (1.08) 0.0000 (1.0) 0;0 1.5103 (0.92) 1 1 test_checkout_symlink-checkout-noop[2.39.0] 679.1204 (1.11) 679.1204 (1.11) 679.1204 (1.11) 0.0000 (1.0) 679.1204 (1.11) 0.0000 (1.0) 0;0 1.4725 (0.90) 1 1 test_checkout_symlink-checkout-noop[2.40.0] 662.9627 (1.08) 662.9627 (1.08) 662.9627 (1.08) 0.0000 (1.0) 662.9627 (1.08) 0.0000 (1.0) 0;0 1.5084 (0.92) 1 1 test_checkout_symlink-checkout-noop[2.41.1] 683.0869 (1.12) 683.0869 (1.12) 683.0869 (1.12) 0.0000 (1.0) 683.0869 (1.12) 0.0000 (1.0) 0;0 1.4639 (0.90) 1 1 test_checkout_symlink-checkout-noop[2.45.0] 768.1747 (1.26) 768.1747 (1.26) 768.1747 (1.26) 0.0000 (1.0) 768.1747 (1.26) 0.0000 (1.0) 0;0 1.3018 (0.80) 1 1 test_checkout_symlink-checkout-noop[main] 846.3646 (1.38) 846.3646 (1.38) 846.3646 (1.38) 0.0000 (1.0) 846.3646 (1.38) 0.0000 (1.0) 0;0 1.1815 (0.72) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-update[2.11.0] 1.7017 (2.18) 1.7017 (2.18) 1.7017 (2.18) 0.0000 (1.0) 1.7017 (2.18) 0.0000 (1.0) 0;0 0.5877 (0.46) 1 1 test_checkout_symlink-checkout-update[2.18.1] 0.8036 (1.03) 0.8036 (1.03) 0.8036 (1.03) 0.0000 (1.0) 0.8036 (1.03) 0.0000 (1.0) 0;0 1.2444 (0.97) 1 1 test_checkout_symlink-checkout-update[2.39.0] 0.7792 (1.0) 0.7792 (1.0) 0.7792 (1.0) 0.0000 (1.0) 0.7792 (1.0) 0.0000 (1.0) 0;0 1.2834 (1.0) 1 1 test_checkout_symlink-checkout-update[2.40.0] 0.8008 (1.03) 0.8008 (1.03) 0.8008 (1.03) 0.0000 (1.0) 0.8008 (1.03) 0.0000 (1.0) 0;0 1.2487 (0.97) 1 1 test_checkout_symlink-checkout-update[2.41.1] 0.7934 (1.02) 0.7934 (1.02) 0.7934 (1.02) 0.0000 (1.0) 0.7934 (1.02) 0.0000 (1.0) 0;0 1.2604 (0.98) 1 1 test_checkout_symlink-checkout-update[2.45.0] 0.9213 (1.18) 0.9213 (1.18) 0.9213 (1.18) 0.0000 (1.0) 0.9213 (1.18) 0.0000 (1.0) 0;0 1.0854 (0.85) 1 1 test_checkout_symlink-checkout-update[main] 0.9309 (1.19) 0.9309 (1.19) 0.9309 (1.19) 0.0000 (1.0) 0.9309 (1.19) 0.0000 (1.0) 0;0 1.0743 (0.84) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.11.0] 460.7043 (1.0) 460.7043 (1.0) 460.7043 (1.0) 0.0000 (1.0) 460.7043 (1.0) 0.0000 (1.0) 0;0 2.1706 (1.0) 1 1 test_gc-gc[2.18.1] 471.7595 (1.02) 471.7595 (1.02) 471.7595 (1.02) 0.0000 (1.0) 471.7595 (1.02) 0.0000 (1.0) 0;0 2.1197 (0.98) 1 1 test_gc-gc[2.39.0] 517.2965 (1.12) 517.2965 (1.12) 517.2965 (1.12) 0.0000 (1.0) 517.2965 (1.12) 0.0000 (1.0) 0;0 1.9331 (0.89) 1 1 test_gc-gc[2.40.0] 514.0626 (1.12) 514.0626 (1.12) 514.0626 (1.12) 0.0000 (1.0) 514.0626 (1.12) 0.0000 (1.0) 0;0 1.9453 (0.90) 1 1 test_gc-gc[2.41.1] 509.9287 (1.11) 509.9287 (1.11) 509.9287 (1.11) 0.0000 (1.0) 509.9287 (1.11) 0.0000 (1.0) 0;0 1.9611 (0.90) 1 1 test_gc-gc[2.45.0] 493.4060 (1.07) 493.4060 (1.07) 493.4060 (1.07) 0.0000 (1.0) 493.4060 (1.07) 0.0000 (1.0) 0;0 2.0267 (0.93) 1 1 test_gc-gc[main] 548.3224 (1.19) 548.3224 (1.19) 548.3224 (1.19) 0.0000 (1.0) 548.3224 (1.19) 0.0000 (1.0) 0;0 1.8237 (0.84) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.11.0] 2.7008 (1.0) 2.7008 (1.0) 2.7008 (1.0) 0.0000 (1.0) 2.7008 (1.0) 0.0000 (1.0) 0;0 0.3703 (1.0) 1 1 test_get_url-get-url[2.18.1] 2.7143 (1.00) 2.7143 (1.00) 2.7143 (1.00) 0.0000 (1.0) 2.7143 (1.00) 0.0000 (1.0) 0;0 0.3684 (1.00) 1 1 test_get_url-get-url[2.39.0] 2.7771 (1.03) 2.7771 (1.03) 2.7771 (1.03) 0.0000 (1.0) 2.7771 (1.03) 0.0000 (1.0) 0;0 0.3601 (0.97) 1 1 test_get_url-get-url[2.40.0] 2.7686 (1.03) 2.7686 (1.03) 2.7686 (1.03) 0.0000 (1.0) 2.7686 (1.03) 0.0000 (1.0) 0;0 0.3612 (0.98) 1 1 test_get_url-get-url[2.41.1] 2.7377 (1.01) 2.7377 (1.01) 2.7377 (1.01) 0.0000 (1.0) 2.7377 (1.01) 0.0000 (1.0) 0;0 0.3653 (0.99) 1 1 test_get_url-get-url[2.45.0] 2.7396 (1.01) 2.7396 (1.01) 2.7396 (1.01) 0.0000 (1.0) 2.7396 (1.01) 0.0000 (1.0) 0;0 0.3650 (0.99) 1 1 test_get_url-get-url[main] 2.8330 (1.05) 2.8330 (1.05) 2.8330 (1.05) 0.0000 (1.0) 2.8330 (1.05) 0.0000 (1.0) 0;0 0.3530 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add_s3-add-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-add-partial-add[2.11.0] 7.4934 (2.27) 7.4934 (2.27) 7.4934 (2.27) 0.0000 (1.0) 7.4934 (2.27) 0.0000 (1.0) 0;0 0.1335 (0.44) 1 1 test_partial_add_s3-add-partial-add[2.18.1] 6.7608 (2.05) 6.7608 (2.05) 6.7608 (2.05) 0.0000 (1.0) 6.7608 (2.05) 0.0000 (1.0) 0;0 0.1479 (0.49) 1 1 test_partial_add_s3-add-partial-add[2.39.0] 3.2961 (1.0) 3.2961 (1.0) 3.2961 (1.0) 0.0000 (1.0) 3.2961 (1.0) 0.0000 (1.0) 0;0 0.3034 (1.0) 1 1 test_partial_add_s3-add-partial-add[2.40.0] 4.6507 (1.41) 4.6507 (1.41) 4.6507 (1.41) 0.0000 (1.0) 4.6507 (1.41) 0.0000 (1.0) 0;0 0.2150 (0.71) 1 1 test_partial_add_s3-add-partial-add[2.41.1] 5.5445 (1.68) 5.5445 (1.68) 5.5445 (1.68) 0.0000 (1.0) 5.5445 (1.68) 0.0000 (1.0) 0;0 0.1804 (0.59) 1 1 test_partial_add_s3-add-partial-add[2.45.0] 3.5753 (1.08) 3.5753 (1.08) 3.5753 (1.08) 0.0000 (1.0) 3.5753 (1.08) 0.0000 (1.0) 0;0 0.2797 (0.92) 1 1 test_partial_add_s3-add-partial-add[main] 3.3085 (1.00) 3.3085 (1.00) 3.3085 (1.00) 0.0000 (1.0) 3.3085 (1.00) 0.0000 (1.0) 0;0 0.3022 (1.00) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add_s3-gc-cloud-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-gc-cloud-noop[2.11.0] 1.3450 (1.0) 1.3450 (1.0) 1.3450 (1.0) 0.0000 (1.0) 1.3450 (1.0) 0.0000 (1.0) 0;0 0.7435 (1.0) 1 1 test_partial_add_s3-gc-cloud-noop[2.18.1] 1.4100 (1.05) 1.4100 (1.05) 1.4100 (1.05) 0.0000 (1.0) 1.4100 (1.05) 0.0000 (1.0) 0;0 0.7092 (0.95) 1 1 test_partial_add_s3-gc-cloud-noop[2.39.0] 1.3699 (1.02) 1.3699 (1.02) 1.3699 (1.02) 0.0000 (1.0) 1.3699 (1.02) 0.0000 (1.0) 0;0 0.7300 (0.98) 1 1 test_partial_add_s3-gc-cloud-noop[2.40.0] 1.4095 (1.05) 1.4095 (1.05) 1.4095 (1.05) 0.0000 (1.0) 1.4095 (1.05) 0.0000 (1.0) 0;0 0.7095 (0.95) 1 1 test_partial_add_s3-gc-cloud-noop[2.41.1] 1.4117 (1.05) 1.4117 (1.05) 1.4117 (1.05) 0.0000 (1.0) 1.4117 (1.05) 0.0000 (1.0) 0;0 0.7083 (0.95) 1 1 test_partial_add_s3-gc-cloud-noop[2.45.0] 1.3918 (1.03) 1.3918 (1.03) 1.3918 (1.03) 0.0000 (1.0) 1.3918 (1.03) 0.0000 (1.0) 0;0 0.7185 (0.97) 1 1 test_partial_add_s3-gc-cloud-noop[main] 1.4870 (1.11) 1.4870 (1.11) 1.4870 (1.11) 0.0000 (1.0) 1.4870 (1.11) 0.0000 (1.0) 0;0 0.6725 (0.90) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add_s3-gc-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-gc-noop[2.11.0] 418.4174 (1.0) 418.4174 (1.0) 418.4174 (1.0) 0.0000 (1.0) 418.4174 (1.0) 0.0000 (1.0) 0;0 2.3900 (1.0) 1 1 test_partial_add_s3-gc-noop[2.18.1] 466.6521 (1.12) 466.6521 (1.12) 466.6521 (1.12) 0.0000 (1.0) 466.6521 (1.12) 0.0000 (1.0) 0;0 2.1429 (0.90) 1 1 test_partial_add_s3-gc-noop[2.39.0] 487.3092 (1.16) 487.3092 (1.16) 487.3092 (1.16) 0.0000 (1.0) 487.3092 (1.16) 0.0000 (1.0) 0;0 2.0521 (0.86) 1 1 test_partial_add_s3-gc-noop[2.40.0] 489.1839 (1.17) 489.1839 (1.17) 489.1839 (1.17) 0.0000 (1.0) 489.1839 (1.17) 0.0000 (1.0) 0;0 2.0442 (0.86) 1 1 test_partial_add_s3-gc-noop[2.41.1] 486.1751 (1.16) 486.1751 (1.16) 486.1751 (1.16) 0.0000 (1.0) 486.1751 (1.16) 0.0000 (1.0) 0;0 2.0569 (0.86) 1 1 test_partial_add_s3-gc-noop[2.45.0] 483.9038 (1.16) 483.9038 (1.16) 483.9038 (1.16) 0.0000 (1.0) 483.9038 (1.16) 0.0000 (1.0) 0;0 2.0665 (0.86) 1 1 test_partial_add_s3-gc-noop[main] 557.6447 (1.33) 557.6447 (1.33) 557.6447 (1.33) 0.0000 (1.0) 557.6447 (1.33) 0.0000 (1.0) 0;0 1.7933 (0.75) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_partial_add_s3-push-partial-add': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-push-partial-add[2.11.0] 20.7853 (20.54) 20.7853 (20.54) 20.7853 (20.54) 0.0000 (1.0) 20.7853 (20.54) 0.0000 (1.0) 0;0 0.0481 (0.05) 1 1 test_partial_add_s3-push-partial-add[2.18.1] 20.7301 (20.49) 20.7301 (20.49) 20.7301 (20.49) 0.0000 (1.0) 20.7301 (20.49) 0.0000 (1.0) 0;0 0.0482 (0.05) 1 1 test_partial_add_s3-push-partial-add[2.39.0] 1.0118 (1.0) 1.0118 (1.0) 1.0118 (1.0) 0.0000 (1.0) 1.0118 (1.0) 0.0000 (1.0) 0;0 0.9883 (1.0) 1 1 test_partial_add_s3-push-partial-add[2.40.0] 10.9708 (10.84) 10.9708 (10.84) 10.9708 (10.84) 0.0000 (1.0) 10.9708 (10.84) 0.0000 (1.0) 0;0 0.0912 (0.09) 1 1 test_partial_add_s3-push-partial-add[2.41.1] 6.5824 (6.51) 6.5824 (6.51) 6.5824 (6.51) 0.0000 (1.0) 6.5824 (6.51) 0.0000 (1.0) 0;0 0.1519 (0.15) 1 1 test_partial_add_s3-push-partial-add[2.45.0] 5.5098 (5.45) 5.5098 (5.45) 5.5098 (5.45) 0.0000 (1.0) 5.5098 (5.45) 0.0000 (1.0) 0;0 0.1815 (0.18) 1 1 test_partial_add_s3-push-partial-add[main] 5.4588 (5.40) 5.4588 (5.40) 5.4588 (5.40) 0.0000 (1.0) 5.4588 (5.40) 0.0000 (1.0) 0;0 0.1832 (0.19) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-add': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-add[2.11.0] 587.0919 (1.09) 587.0919 (1.09) 587.0919 (1.09) 0.0000 (1.0) 587.0919 (1.09) 0.0000 (1.0) 0;0 1.7033 (0.92) 1 1 test_partial_remove_s3-add[2.18.1] 4,494.3448 (8.35) 4,494.3448 (8.35) 4,494.3448 (8.35) 0.0000 (1.0) 4,494.3448 (8.35) 0.0000 (1.0) 0;0 0.2225 (0.12) 1 1 test_partial_remove_s3-add[2.39.0] 538.0617 (1.0) 538.0617 (1.0) 538.0617 (1.0) 0.0000 (1.0) 538.0617 (1.0) 0.0000 (1.0) 0;0 1.8585 (1.0) 1 1 test_partial_remove_s3-add[2.40.0] 3,290.0045 (6.11) 3,290.0045 (6.11) 3,290.0045 (6.11) 0.0000 (1.0) 3,290.0045 (6.11) 0.0000 (1.0) 0;0 0.3040 (0.16) 1 1 test_partial_remove_s3-add[2.41.1] 1,935.4157 (3.60) 1,935.4157 (3.60) 1,935.4157 (3.60) 0.0000 (1.0) 1,935.4157 (3.60) 0.0000 (1.0) 0;0 0.5167 (0.28) 1 1 test_partial_remove_s3-add[2.45.0] 1,905.9672 (3.54) 1,905.9672 (3.54) 1,905.9672 (3.54) 0.0000 (1.0) 1,905.9672 (3.54) 0.0000 (1.0) 0;0 0.5247 (0.28) 1 1 test_partial_remove_s3-add[main] 1,621.8638 (3.01) 1,621.8638 (3.01) 1,621.8638 (3.01) 0.0000 (1.0) 1,621.8638 (3.01) 0.0000 (1.0) 0;0 0.6166 (0.33) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-gc[2.11.0] 461.2432 (1.0) 461.2432 (1.0) 461.2432 (1.0) 0.0000 (1.0) 461.2432 (1.0) 0.0000 (1.0) 0;0 2.1681 (1.0) 1 1 test_partial_remove_s3-gc[2.18.1] 463.5411 (1.00) 463.5411 (1.00) 463.5411 (1.00) 0.0000 (1.0) 463.5411 (1.00) 0.0000 (1.0) 0;0 2.1573 (1.00) 1 1 test_partial_remove_s3-gc[2.39.0] 502.0495 (1.09) 502.0495 (1.09) 502.0495 (1.09) 0.0000 (1.0) 502.0495 (1.09) 0.0000 (1.0) 0;0 1.9918 (0.92) 1 1 test_partial_remove_s3-gc[2.40.0] 482.8208 (1.05) 482.8208 (1.05) 482.8208 (1.05) 0.0000 (1.0) 482.8208 (1.05) 0.0000 (1.0) 0;0 2.0712 (0.96) 1 1 test_partial_remove_s3-gc[2.41.1] 491.2641 (1.07) 491.2641 (1.07) 491.2641 (1.07) 0.0000 (1.0) 491.2641 (1.07) 0.0000 (1.0) 0;0 2.0356 (0.94) 1 1 test_partial_remove_s3-gc[2.45.0] 486.9687 (1.06) 486.9687 (1.06) 486.9687 (1.06) 0.0000 (1.0) 486.9687 (1.06) 0.0000 (1.0) 0;0 2.0535 (0.95) 1 1 test_partial_remove_s3-gc[main] 563.3060 (1.22) 563.3060 (1.22) 563.3060 (1.22) 0.0000 (1.0) 563.3060 (1.22) 0.0000 (1.0) 0;0 1.7752 (0.82) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-gc-cloud': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-gc-cloud[2.11.0] 25.6314 (18.62) 25.6314 (18.62) 25.6314 (18.62) 0.0000 (1.0) 25.6314 (18.62) 0.0000 (1.0) 0;0 0.0390 (0.05) 1 1 test_partial_remove_s3-gc-cloud[2.18.1] 1.3763 (1.0) 1.3763 (1.0) 1.3763 (1.0) 0.0000 (1.0) 1.3763 (1.0) 0.0000 (1.0) 0;0 0.7266 (1.0) 1 1 test_partial_remove_s3-gc-cloud[2.39.0] 26.0660 (18.94) 26.0660 (18.94) 26.0660 (18.94) 0.0000 (1.0) 26.0660 (18.94) 0.0000 (1.0) 0;0 0.0384 (0.05) 1 1 test_partial_remove_s3-gc-cloud[2.40.0] 1.3860 (1.01) 1.3860 (1.01) 1.3860 (1.01) 0.0000 (1.0) 1.3860 (1.01) 0.0000 (1.0) 0;0 0.7215 (0.99) 1 1 test_partial_remove_s3-gc-cloud[2.41.1] 13.5354 (9.83) 13.5354 (9.83) 13.5354 (9.83) 0.0000 (1.0) 13.5354 (9.83) 0.0000 (1.0) 0;0 0.0739 (0.10) 1 1 test_partial_remove_s3-gc-cloud[2.45.0] 1.6945 (1.23) 1.6945 (1.23) 1.6945 (1.23) 0.0000 (1.0) 1.6945 (1.23) 0.0000 (1.0) 0;0 0.5902 (0.81) 1 1 test_partial_remove_s3-gc-cloud[main] 1.5563 (1.13) 1.5563 (1.13) 1.5563 (1.13) 0.0000 (1.0) 1.5563 (1.13) 0.0000 (1.0) 0;0 0.6426 (0.88) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-push': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_partial_remove_s3-push[2.11.0] 922.4260 (1.0) 922.4260 (1.0) 922.4260 (1.0) 0.0000 (1.0) 922.4260 (1.0) 0.0000 (1.0) 0;0 1.0841 (1.0) 1 1 test_partial_remove_s3-push[2.18.1] 978.7016 (1.06) 978.7016 (1.06) 978.7016 (1.06) 0.0000 (1.0) 978.7016 (1.06) 0.0000 (1.0) 0;0 1.0218 (0.94) 1 1 test_partial_remove_s3-push[2.39.0] 942.3723 (1.02) 942.3723 (1.02) 942.3723 (1.02) 0.0000 (1.0) 942.3723 (1.02) 0.0000 (1.0) 0;0 1.0612 (0.98) 1 1 test_partial_remove_s3-push[2.40.0] 1,010.8813 (1.10) 1,010.8813 (1.10) 1,010.8813 (1.10) 0.0000 (1.0) 1,010.8813 (1.10) 0.0000 (1.0) 0;0 0.9892 (0.91) 1 1 test_partial_remove_s3-push[2.41.1] 1,452.2254 (1.57) 1,452.2254 (1.57) 1,452.2254 (1.57) 0.0000 (1.0) 1,452.2254 (1.57) 0.0000 (1.0) 0;0 0.6886 (0.64) 1 1 test_partial_remove_s3-push[2.45.0] 1,376.1842 (1.49) 1,376.1842 (1.49) 1,376.1842 (1.49) 0.0000 (1.0) 1,376.1842 (1.49) 0.0000 (1.0) 0;0 0.7266 (0.67) 1 1 test_partial_remove_s3-push[main] 1,150.8460 (1.25) 1,150.8460 (1.25) 1,150.8460 (1.25) 0.0000 (1.0) 1,150.8460 (1.25) 0.0000 (1.0) 0;0 0.8689 (0.80) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 14 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.11.0] 7.6431 (1.99) 7.6431 (1.99) 7.6431 (1.99) 0.0000 (1.0) 7.6431 (1.99) 0.0000 (1.0) 0;0 0.1308 (0.50) 1 1 test_sharing_s3-add[2.11.0] 7.1353 (1.86) 7.1353 (1.86) 7.1353 (1.86) 0.0000 (1.0) 7.1353 (1.86) 0.0000 (1.0) 0;0 0.1401 (0.54) 1 1 test_sharing_s3-add[2.18.1] 6.1712 (1.60) 6.1712 (1.60) 6.1712 (1.60) 0.0000 (1.0) 6.1712 (1.60) 0.0000 (1.0) 0;0 0.1620 (0.62) 1 1 test_sharing_s3-add[2.18.1] 6.0601 (1.58) 6.0601 (1.58) 6.0601 (1.58) 0.0000 (1.0) 6.0601 (1.58) 0.0000 (1.0) 0;0 0.1650 (0.63) 1 1 test_sharing_s3-add[2.39.0] 5.8943 (1.53) 5.8943 (1.53) 5.8943 (1.53) 0.0000 (1.0) 5.8943 (1.53) 0.0000 (1.0) 0;0 0.1697 (0.65) 1 1 test_sharing_s3-add[2.39.0] 5.8369 (1.52) 5.8369 (1.52) 5.8369 (1.52) 0.0000 (1.0) 5.8369 (1.52) 0.0000 (1.0) 0;0 0.1713 (0.66) 1 1 test_sharing_s3-add[2.40.0] 5.9031 (1.54) 5.9031 (1.54) 5.9031 (1.54) 0.0000 (1.0) 5.9031 (1.54) 0.0000 (1.0) 0;0 0.1694 (0.65) 1 1 test_sharing_s3-add[2.40.0] 5.8517 (1.52) 5.8517 (1.52) 5.8517 (1.52) 0.0000 (1.0) 5.8517 (1.52) 0.0000 (1.0) 0;0 0.1709 (0.66) 1 1 test_sharing_s3-add[2.41.1] 6.1019 (1.59) 6.1019 (1.59) 6.1019 (1.59) 0.0000 (1.0) 6.1019 (1.59) 0.0000 (1.0) 0;0 0.1639 (0.63) 1 1 test_sharing_s3-add[2.41.1] 5.7782 (1.50) 5.7782 (1.50) 5.7782 (1.50) 0.0000 (1.0) 5.7782 (1.50) 0.0000 (1.0) 0;0 0.1731 (0.67) 1 1 test_sharing_s3-add[2.45.0] 3.8780 (1.01) 3.8780 (1.01) 3.8780 (1.01) 0.0000 (1.0) 3.8780 (1.01) 0.0000 (1.0) 0;0 0.2579 (0.99) 1 1 test_sharing_s3-add[2.45.0] 3.8452 (1.0) 3.8452 (1.0) 3.8452 (1.0) 0.0000 (1.0) 3.8452 (1.0) 0.0000 (1.0) 0;0 0.2601 (1.0) 1 1 test_sharing_s3-add[main] 3.8940 (1.01) 3.8940 (1.01) 3.8940 (1.01) 0.0000 (1.0) 3.8940 (1.01) 0.0000 (1.0) 0;0 0.2568 (0.99) 1 1 test_sharing_s3-add[main] 3.9063 (1.02) 3.9063 (1.02) 3.9063 (1.02) 0.0000 (1.0) 3.9063 (1.02) 0.0000 (1.0) 0;0 0.2560 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 14 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.11.0] 3.5008 (1.46) 3.5008 (1.46) 3.5008 (1.46) 0.0000 (1.0) 3.5008 (1.46) 0.0000 (1.0) 0;0 0.2856 (0.69) 1 1 test_sharing_s3-add-noop[2.11.0] 3.4523 (1.44) 3.4523 (1.44) 3.4523 (1.44) 0.0000 (1.0) 3.4523 (1.44) 0.0000 (1.0) 0;0 0.2897 (0.70) 1 1 test_sharing_s3-add-noop[2.18.1] 3.6450 (1.52) 3.6450 (1.52) 3.6450 (1.52) 0.0000 (1.0) 3.6450 (1.52) 0.0000 (1.0) 0;0 0.2743 (0.66) 1 1 test_sharing_s3-add-noop[2.18.1] 3.6460 (1.52) 3.6460 (1.52) 3.6460 (1.52) 0.0000 (1.0) 3.6460 (1.52) 0.0000 (1.0) 0;0 0.2743 (0.66) 1 1 test_sharing_s3-add-noop[2.39.0] 2.4375 (1.01) 2.4375 (1.01) 2.4375 (1.01) 0.0000 (1.0) 2.4375 (1.01) 0.0000 (1.0) 0;0 0.4102 (0.99) 1 1 test_sharing_s3-add-noop[2.39.0] 2.4429 (1.02) 2.4429 (1.02) 2.4429 (1.02) 0.0000 (1.0) 2.4429 (1.02) 0.0000 (1.0) 0;0 0.4094 (0.98) 1 1 test_sharing_s3-add-noop[2.40.0] 2.4658 (1.03) 2.4658 (1.03) 2.4658 (1.03) 0.0000 (1.0) 2.4658 (1.03) 0.0000 (1.0) 0;0 0.4055 (0.97) 1 1 test_sharing_s3-add-noop[2.40.0] 2.4241 (1.01) 2.4241 (1.01) 2.4241 (1.01) 0.0000 (1.0) 2.4241 (1.01) 0.0000 (1.0) 0;0 0.4125 (0.99) 1 1 test_sharing_s3-add-noop[2.41.1] 2.4794 (1.03) 2.4794 (1.03) 2.4794 (1.03) 0.0000 (1.0) 2.4794 (1.03) 0.0000 (1.0) 0;0 0.4033 (0.97) 1 1 test_sharing_s3-add-noop[2.41.1] 2.4037 (1.0) 2.4037 (1.0) 2.4037 (1.0) 0.0000 (1.0) 2.4037 (1.0) 0.0000 (1.0) 0;0 0.4160 (1.0) 1 1 test_sharing_s3-add-noop[2.45.0] 2.5200 (1.05) 2.5200 (1.05) 2.5200 (1.05) 0.0000 (1.0) 2.5200 (1.05) 0.0000 (1.0) 0;0 0.3968 (0.95) 1 1 test_sharing_s3-add-noop[2.45.0] 2.4947 (1.04) 2.4947 (1.04) 2.4947 (1.04) 0.0000 (1.0) 2.4947 (1.04) 0.0000 (1.0) 0;0 0.4009 (0.96) 1 1 test_sharing_s3-add-noop[main] 2.5851 (1.08) 2.5851 (1.08) 2.5851 (1.08) 0.0000 (1.0) 2.5851 (1.08) 0.0000 (1.0) 0;0 0.3868 (0.93) 1 1 test_sharing_s3-add-noop[main] 2.5594 (1.06) 2.5594 (1.06) 2.5594 (1.06) 0.0000 (1.0) 2.5594 (1.06) 0.0000 (1.0) 0;0 0.3907 (0.94) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 14 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.11.0] 489.2765 (1.0) 489.2765 (1.0) 489.2765 (1.0) 0.0000 (1.0) 489.2765 (1.0) 0.0000 (1.0) 0;0 2.0438 (1.0) 1 1 test_sharing_s3-checkout-noop[2.11.0] 492.7064 (1.01) 492.7064 (1.01) 492.7064 (1.01) 0.0000 (1.0) 492.7064 (1.01) 0.0000 (1.0) 0;0 2.0296 (0.99) 1 1 test_sharing_s3-checkout-noop[2.18.1] 558.1078 (1.14) 558.1078 (1.14) 558.1078 (1.14) 0.0000 (1.0) 558.1078 (1.14) 0.0000 (1.0) 0;0 1.7918 (0.88) 1 1 test_sharing_s3-checkout-noop[2.18.1] 568.2094 (1.16) 568.2094 (1.16) 568.2094 (1.16) 0.0000 (1.0) 568.2094 (1.16) 0.0000 (1.0) 0;0 1.7599 (0.86) 1 1 test_sharing_s3-checkout-noop[2.39.0] 574.3399 (1.17) 574.3399 (1.17) 574.3399 (1.17) 0.0000 (1.0) 574.3399 (1.17) 0.0000 (1.0) 0;0 1.7411 (0.85) 1 1 test_sharing_s3-checkout-noop[2.39.0] 576.3216 (1.18) 576.3216 (1.18) 576.3216 (1.18) 0.0000 (1.0) 576.3216 (1.18) 0.0000 (1.0) 0;0 1.7351 (0.85) 1 1 test_sharing_s3-checkout-noop[2.40.0] 581.5795 (1.19) 581.5795 (1.19) 581.5795 (1.19) 0.0000 (1.0) 581.5795 (1.19) 0.0000 (1.0) 0;0 1.7195 (0.84) 1 1 test_sharing_s3-checkout-noop[2.40.0] 582.4283 (1.19) 582.4283 (1.19) 582.4283 (1.19) 0.0000 (1.0) 582.4283 (1.19) 0.0000 (1.0) 0;0 1.7169 (0.84) 1 1 test_sharing_s3-checkout-noop[2.41.1] 580.1089 (1.19) 580.1089 (1.19) 580.1089 (1.19) 0.0000 (1.0) 580.1089 (1.19) 0.0000 (1.0) 0;0 1.7238 (0.84) 1 1 test_sharing_s3-checkout-noop[2.41.1] 575.9561 (1.18) 575.9561 (1.18) 575.9561 (1.18) 0.0000 (1.0) 575.9561 (1.18) 0.0000 (1.0) 0;0 1.7362 (0.85) 1 1 test_sharing_s3-checkout-noop[2.45.0] 599.3335 (1.22) 599.3335 (1.22) 599.3335 (1.22) 0.0000 (1.0) 599.3335 (1.22) 0.0000 (1.0) 0;0 1.6685 (0.82) 1 1 test_sharing_s3-checkout-noop[2.45.0] 597.2113 (1.22) 597.2113 (1.22) 597.2113 (1.22) 0.0000 (1.0) 597.2113 (1.22) 0.0000 (1.0) 0;0 1.6744 (0.82) 1 1 test_sharing_s3-checkout-noop[main] 663.9815 (1.36) 663.9815 (1.36) 663.9815 (1.36) 0.0000 (1.0) 663.9815 (1.36) 0.0000 (1.0) 0;0 1.5061 (0.74) 1 1 test_sharing_s3-checkout-noop[main] 672.6791 (1.37) 672.6791 (1.37) 672.6791 (1.37) 0.0000 (1.0) 672.6791 (1.37) 0.0000 (1.0) 0;0 1.4866 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 14 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.11.0] 14.7728 (1.19) 14.7728 (1.19) 14.7728 (1.19) 0.0000 (1.0) 14.7728 (1.19) 0.0000 (1.0) 0;0 0.0677 (0.84) 1 1 test_sharing_s3-pull[2.11.0] 14.8198 (1.19) 14.8198 (1.19) 14.8198 (1.19) 0.0000 (1.0) 14.8198 (1.19) 0.0000 (1.0) 0;0 0.0675 (0.84) 1 1 test_sharing_s3-pull[2.18.1] 14.7363 (1.19) 14.7363 (1.19) 14.7363 (1.19) 0.0000 (1.0) 14.7363 (1.19) 0.0000 (1.0) 0;0 0.0679 (0.84) 1 1 test_sharing_s3-pull[2.18.1] 15.0127 (1.21) 15.0127 (1.21) 15.0127 (1.21) 0.0000 (1.0) 15.0127 (1.21) 0.0000 (1.0) 0;0 0.0666 (0.83) 1 1 test_sharing_s3-pull[2.39.0] 15.0024 (1.21) 15.0024 (1.21) 15.0024 (1.21) 0.0000 (1.0) 15.0024 (1.21) 0.0000 (1.0) 0;0 0.0667 (0.83) 1 1 test_sharing_s3-pull[2.39.0] 14.9733 (1.20) 14.9733 (1.20) 14.9733 (1.20) 0.0000 (1.0) 14.9733 (1.20) 0.0000 (1.0) 0;0 0.0668 (0.83) 1 1 test_sharing_s3-pull[2.40.0] 15.0934 (1.21) 15.0934 (1.21) 15.0934 (1.21) 0.0000 (1.0) 15.0934 (1.21) 0.0000 (1.0) 0;0 0.0663 (0.82) 1 1 test_sharing_s3-pull[2.40.0] 14.6765 (1.18) 14.6765 (1.18) 14.6765 (1.18) 0.0000 (1.0) 14.6765 (1.18) 0.0000 (1.0) 0;0 0.0681 (0.85) 1 1 test_sharing_s3-pull[2.41.1] 15.2174 (1.22) 15.2174 (1.22) 15.2174 (1.22) 0.0000 (1.0) 15.2174 (1.22) 0.0000 (1.0) 0;0 0.0657 (0.82) 1 1 test_sharing_s3-pull[2.41.1] 14.8208 (1.19) 14.8208 (1.19) 14.8208 (1.19) 0.0000 (1.0) 14.8208 (1.19) 0.0000 (1.0) 0;0 0.0675 (0.84) 1 1 test_sharing_s3-pull[2.45.0] 12.7857 (1.03) 12.7857 (1.03) 12.7857 (1.03) 0.0000 (1.0) 12.7857 (1.03) 0.0000 (1.0) 0;0 0.0782 (0.97) 1 1 test_sharing_s3-pull[2.45.0] 12.4348 (1.0) 12.4348 (1.0) 12.4348 (1.0) 0.0000 (1.0) 12.4348 (1.0) 0.0000 (1.0) 0;0 0.0804 (1.0) 1 1 test_sharing_s3-pull[main] 12.8291 (1.03) 12.8291 (1.03) 12.8291 (1.03) 0.0000 (1.0) 12.8291 (1.03) 0.0000 (1.0) 0;0 0.0779 (0.97) 1 1 test_sharing_s3-pull[main] 12.7893 (1.03) 12.7893 (1.03) 12.7893 (1.03) 0.0000 (1.0) 12.7893 (1.03) 0.0000 (1.0) 0;0 0.0782 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 14 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.11.0] 708.7519 (1.0) 708.7519 (1.0) 708.7519 (1.0) 0.0000 (1.0) 708.7519 (1.0) 0.0000 (1.0) 0;0 1.4109 (1.0) 1 1 test_sharing_s3-pull-noop[2.11.0] 715.6932 (1.01) 715.6932 (1.01) 715.6932 (1.01) 0.0000 (1.0) 715.6932 (1.01) 0.0000 (1.0) 0;0 1.3972 (0.99) 1 1 test_sharing_s3-pull-noop[2.18.1] 782.6995 (1.10) 782.6995 (1.10) 782.6995 (1.10) 0.0000 (1.0) 782.6995 (1.10) 0.0000 (1.0) 0;0 1.2776 (0.91) 1 1 test_sharing_s3-pull-noop[2.18.1] 797.5020 (1.13) 797.5020 (1.13) 797.5020 (1.13) 0.0000 (1.0) 797.5020 (1.13) 0.0000 (1.0) 0;0 1.2539 (0.89) 1 1 test_sharing_s3-pull-noop[2.39.0] 794.5297 (1.12) 794.5297 (1.12) 794.5297 (1.12) 0.0000 (1.0) 794.5297 (1.12) 0.0000 (1.0) 0;0 1.2586 (0.89) 1 1 test_sharing_s3-pull-noop[2.39.0] 798.9542 (1.13) 798.9542 (1.13) 798.9542 (1.13) 0.0000 (1.0) 798.9542 (1.13) 0.0000 (1.0) 0;0 1.2516 (0.89) 1 1 test_sharing_s3-pull-noop[2.40.0] 797.3574 (1.13) 797.3574 (1.13) 797.3574 (1.13) 0.0000 (1.0) 797.3574 (1.13) 0.0000 (1.0) 0;0 1.2541 (0.89) 1 1 test_sharing_s3-pull-noop[2.40.0] 794.5210 (1.12) 794.5210 (1.12) 794.5210 (1.12) 0.0000 (1.0) 794.5210 (1.12) 0.0000 (1.0) 0;0 1.2586 (0.89) 1 1 test_sharing_s3-pull-noop[2.41.1] 794.7680 (1.12) 794.7680 (1.12) 794.7680 (1.12) 0.0000 (1.0) 794.7680 (1.12) 0.0000 (1.0) 0;0 1.2582 (0.89) 1 1 test_sharing_s3-pull-noop[2.41.1] 796.4925 (1.12) 796.4925 (1.12) 796.4925 (1.12) 0.0000 (1.0) 796.4925 (1.12) 0.0000 (1.0) 0;0 1.2555 (0.89) 1 1 test_sharing_s3-pull-noop[2.45.0] 817.1734 (1.15) 817.1734 (1.15) 817.1734 (1.15) 0.0000 (1.0) 817.1734 (1.15) 0.0000 (1.0) 0;0 1.2237 (0.87) 1 1 test_sharing_s3-pull-noop[2.45.0] 821.2010 (1.16) 821.2010 (1.16) 821.2010 (1.16) 0.0000 (1.0) 821.2010 (1.16) 0.0000 (1.0) 0;0 1.2177 (0.86) 1 1 test_sharing_s3-pull-noop[main] 888.1440 (1.25) 888.1440 (1.25) 888.1440 (1.25) 0.0000 (1.0) 888.1440 (1.25) 0.0000 (1.0) 0;0 1.1259 (0.80) 1 1 test_sharing_s3-pull-noop[main] 904.7368 (1.28) 904.7368 (1.28) 904.7368 (1.28) 0.0000 (1.0) 904.7368 (1.28) 0.0000 (1.0) 0;0 1.1053 (0.78) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 14 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.11.0] 21.2126 (2.44) 21.2126 (2.44) 21.2126 (2.44) 0.0000 (1.0) 21.2126 (2.44) 0.0000 (1.0) 0;0 0.0471 (0.41) 1 1 test_sharing_s3-push[2.11.0] 20.5330 (2.36) 20.5330 (2.36) 20.5330 (2.36) 0.0000 (1.0) 20.5330 (2.36) 0.0000 (1.0) 0;0 0.0487 (0.42) 1 1 test_sharing_s3-push[2.18.1] 20.4330 (2.35) 20.4330 (2.35) 20.4330 (2.35) 0.0000 (1.0) 20.4330 (2.35) 0.0000 (1.0) 0;0 0.0489 (0.43) 1 1 test_sharing_s3-push[2.18.1] 21.3348 (2.45) 21.3348 (2.45) 21.3348 (2.45) 0.0000 (1.0) 21.3348 (2.45) 0.0000 (1.0) 0;0 0.0469 (0.41) 1 1 test_sharing_s3-push[2.39.0] 21.8803 (2.51) 21.8803 (2.51) 21.8803 (2.51) 0.0000 (1.0) 21.8803 (2.51) 0.0000 (1.0) 0;0 0.0457 (0.40) 1 1 test_sharing_s3-push[2.39.0] 22.3737 (2.57) 22.3737 (2.57) 22.3737 (2.57) 0.0000 (1.0) 22.3737 (2.57) 0.0000 (1.0) 0;0 0.0447 (0.39) 1 1 test_sharing_s3-push[2.40.0] 22.7712 (2.62) 22.7712 (2.62) 22.7712 (2.62) 0.0000 (1.0) 22.7712 (2.62) 0.0000 (1.0) 0;0 0.0439 (0.38) 1 1 test_sharing_s3-push[2.40.0] 22.6426 (2.60) 22.6426 (2.60) 22.6426 (2.60) 0.0000 (1.0) 22.6426 (2.60) 0.0000 (1.0) 0;0 0.0442 (0.38) 1 1 test_sharing_s3-push[2.41.1] 12.1290 (1.39) 12.1290 (1.39) 12.1290 (1.39) 0.0000 (1.0) 12.1290 (1.39) 0.0000 (1.0) 0;0 0.0824 (0.72) 1 1 test_sharing_s3-push[2.41.1] 11.9747 (1.38) 11.9747 (1.38) 11.9747 (1.38) 0.0000 (1.0) 11.9747 (1.38) 0.0000 (1.0) 0;0 0.0835 (0.73) 1 1 test_sharing_s3-push[2.45.0] 8.9267 (1.03) 8.9267 (1.03) 8.9267 (1.03) 0.0000 (1.0) 8.9267 (1.03) 0.0000 (1.0) 0;0 0.1120 (0.98) 1 1 test_sharing_s3-push[2.45.0] 8.7056 (1.0) 8.7056 (1.0) 8.7056 (1.0) 0.0000 (1.0) 8.7056 (1.0) 0.0000 (1.0) 0;0 0.1149 (1.0) 1 1 test_sharing_s3-push[main] 9.3031 (1.07) 9.3031 (1.07) 9.3031 (1.07) 0.0000 (1.0) 9.3031 (1.07) 0.0000 (1.0) 0;0 0.1075 (0.94) 1 1 test_sharing_s3-push[main] 9.1163 (1.05) 9.1163 (1.05) 9.1163 (1.05) 0.0000 (1.0) 9.1163 (1.05) 0.0000 (1.0) 0;0 0.1097 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 14 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push-noop[2.11.0] 950.7320 (1.03) 950.7320 (1.03) 950.7320 (1.03) 0.0000 (1.0) 950.7320 (1.03) 0.0000 (1.0) 0;0 1.0518 (0.97) 1 1 test_sharing_s3-push-noop[2.11.0] 966.0960 (1.05) 966.0960 (1.05) 966.0960 (1.05) 0.0000 (1.0) 966.0960 (1.05) 0.0000 (1.0) 0;0 1.0351 (0.96) 1 1 test_sharing_s3-push-noop[2.18.1] 922.6630 (1.0) 922.6630 (1.0) 922.6630 (1.0) 0.0000 (1.0) 922.6630 (1.0) 0.0000 (1.0) 0;0 1.0838 (1.0) 1 1 test_sharing_s3-push-noop[2.18.1] 925.4935 (1.00) 925.4935 (1.00) 925.4935 (1.00) 0.0000 (1.0) 925.4935 (1.00) 0.0000 (1.0) 0;0 1.0805 (1.00) 1 1 test_sharing_s3-push-noop[2.39.0] 970.6274 (1.05) 970.6274 (1.05) 970.6274 (1.05) 0.0000 (1.0) 970.6274 (1.05) 0.0000 (1.0) 0;0 1.0303 (0.95) 1 1 test_sharing_s3-push-noop[2.39.0] 979.0332 (1.06) 979.0332 (1.06) 979.0332 (1.06) 0.0000 (1.0) 979.0332 (1.06) 0.0000 (1.0) 0;0 1.0214 (0.94) 1 1 test_sharing_s3-push-noop[2.40.0] 1,012.4785 (1.10) 1,012.4785 (1.10) 1,012.4785 (1.10) 0.0000 (1.0) 1,012.4785 (1.10) 0.0000 (1.0) 0;0 0.9877 (0.91) 1 1 test_sharing_s3-push-noop[2.40.0] 991.3527 (1.07) 991.3527 (1.07) 991.3527 (1.07) 0.0000 (1.0) 991.3527 (1.07) 0.0000 (1.0) 0;0 1.0087 (0.93) 1 1 test_sharing_s3-push-noop[2.41.1] 1,017.6168 (1.10) 1,017.6168 (1.10) 1,017.6168 (1.10) 0.0000 (1.0) 1,017.6168 (1.10) 0.0000 (1.0) 0;0 0.9827 (0.91) 1 1 test_sharing_s3-push-noop[2.41.1] 976.2755 (1.06) 976.2755 (1.06) 976.2755 (1.06) 0.0000 (1.0) 976.2755 (1.06) 0.0000 (1.0) 0;0 1.0243 (0.95) 1 1 test_sharing_s3-push-noop[2.45.0] 968.4304 (1.05) 968.4304 (1.05) 968.4304 (1.05) 0.0000 (1.0) 968.4304 (1.05) 0.0000 (1.0) 0;0 1.0326 (0.95) 1 1 test_sharing_s3-push-noop[2.45.0] 974.0055 (1.06) 974.0055 (1.06) 974.0055 (1.06) 0.0000 (1.0) 974.0055 (1.06) 0.0000 (1.0) 0;0 1.0267 (0.95) 1 1 test_sharing_s3-push-noop[main] 1,065.3159 (1.15) 1,065.3159 (1.15) 1,065.3159 (1.15) 0.0000 (1.0) 1,065.3159 (1.15) 0.0000 (1.0) 0;0 0.9387 (0.87) 1 1 test_sharing_s3-push-noop[main] 1,076.5444 (1.17) 1,076.5444 (1.17) 1,076.5444 (1.17) 0.0000 (1.0) 1,076.5444 (1.17) 0.0000 (1.0) 0;0 0.9289 (0.86) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.11.0] 10.0748 (1.46) 10.0748 (1.46) 10.0748 (1.46) 0.0000 (1.0) 10.0748 (1.46) 0.0000 (1.0) 0;0 0.0993 (0.69) 1 1 test_import_url-import-url[2.18.1] 8.8714 (1.28) 8.8714 (1.28) 8.8714 (1.28) 0.0000 (1.0) 8.8714 (1.28) 0.0000 (1.0) 0;0 0.1127 (0.78) 1 1 test_import_url-import-url[2.39.0] 8.7217 (1.26) 8.7217 (1.26) 8.7217 (1.26) 0.0000 (1.0) 8.7217 (1.26) 0.0000 (1.0) 0;0 0.1147 (0.79) 1 1 test_import_url-import-url[2.40.0] 8.7863 (1.27) 8.7863 (1.27) 8.7863 (1.27) 0.0000 (1.0) 8.7863 (1.27) 0.0000 (1.0) 0;0 0.1138 (0.79) 1 1 test_import_url-import-url[2.41.1] 8.6758 (1.26) 8.6758 (1.26) 8.6758 (1.26) 0.0000 (1.0) 8.6758 (1.26) 0.0000 (1.0) 0;0 0.1153 (0.80) 1 1 test_import_url-import-url[2.45.0] 7.4628 (1.08) 7.4628 (1.08) 7.4628 (1.08) 0.0000 (1.0) 7.4628 (1.08) 0.0000 (1.0) 0;0 0.1340 (0.93) 1 1 test_import_url-import-url[main] 6.9092 (1.0) 6.9092 (1.0) 6.9092 (1.0) 0.0000 (1.0) 6.9092 (1.0) 0.0000 (1.0) 0;0 0.1447 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.11.0] 2.5961 (1.66) 2.5961 (1.66) 2.5961 (1.66) 0.0000 (1.0) 2.5961 (1.66) 0.0000 (1.0) 0;0 0.3852 (0.60) 1 1 test_status-status[2.18.1] 1.5757 (1.01) 1.5757 (1.01) 1.5757 (1.01) 0.0000 (1.0) 1.5757 (1.01) 0.0000 (1.0) 0;0 0.6347 (0.99) 1 1 test_status-status[2.39.0] 1.5966 (1.02) 1.5966 (1.02) 1.5966 (1.02) 0.0000 (1.0) 1.5966 (1.02) 0.0000 (1.0) 0;0 0.6263 (0.98) 1 1 test_status-status[2.40.0] 1.6218 (1.04) 1.6218 (1.04) 1.6218 (1.04) 0.0000 (1.0) 1.6218 (1.04) 0.0000 (1.0) 0;0 0.6166 (0.97) 1 1 test_status-status[2.41.1] 1.6741 (1.07) 1.6741 (1.07) 1.6741 (1.07) 0.0000 (1.0) 1.6741 (1.07) 0.0000 (1.0) 0;0 0.5974 (0.94) 1 1 test_status-status[2.45.0] 1.5664 (1.0) 1.5664 (1.0) 1.5664 (1.0) 0.0000 (1.0) 1.5664 (1.0) 0.0000 (1.0) 0;0 0.6384 (1.0) 1 1 test_status-status[main] 1.7581 (1.12) 1.7581 (1.12) 1.7581 (1.12) 0.0000 (1.0) 1.7581 (1.12) 0.0000 (1.0) 0;0 0.5688 (0.89) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_status-status-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.11.0] 1.9147 (3.40) 1.9147 (3.40) 1.9147 (3.40) 0.0000 (1.0) 1.9147 (3.40) 0.0000 (1.0) 0;0 0.5223 (0.29) 1 1 test_status-status-changed[2.18.1] 0.5630 (1.0) 0.5630 (1.0) 0.5630 (1.0) 0.0000 (1.0) 0.5630 (1.0) 0.0000 (1.0) 0;0 1.7761 (1.0) 1 1 test_status-status-changed[2.39.0] 0.6265 (1.11) 0.6265 (1.11) 0.6265 (1.11) 0.0000 (1.0) 0.6265 (1.11) 0.0000 (1.0) 0;0 1.5961 (0.90) 1 1 test_status-status-changed[2.40.0] 0.6316 (1.12) 0.6316 (1.12) 0.6316 (1.12) 0.0000 (1.0) 0.6316 (1.12) 0.0000 (1.0) 0;0 1.5832 (0.89) 1 1 test_status-status-changed[2.41.1] 0.6468 (1.15) 0.6468 (1.15) 0.6468 (1.15) 0.0000 (1.0) 0.6468 (1.15) 0.0000 (1.0) 0;0 1.5461 (0.87) 1 1 test_status-status-changed[2.45.0] 0.6914 (1.23) 0.6914 (1.23) 0.6914 (1.23) 0.0000 (1.0) 0.6914 (1.23) 0.0000 (1.0) 0;0 1.4463 (0.81) 1 1 test_status-status-changed[main] 0.7667 (1.36) 0.7667 (1.36) 0.7667 (1.36) 0.0000 (1.0) 0.7667 (1.36) 0.0000 (1.0) 0;0 1.3043 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.11.0] 813.5234 (1.40) 813.5234 (1.40) 813.5234 (1.40) 0.0000 (1.0) 813.5234 (1.40) 0.0000 (1.0) 0;0 1.2292 (0.71) 1 1 test_status-status-changed-noop[2.18.1] 581.2760 (1.0) 581.2760 (1.0) 581.2760 (1.0) 0.0000 (1.0) 581.2760 (1.0) 0.0000 (1.0) 0;0 1.7204 (1.0) 1 1 test_status-status-changed-noop[2.39.0] 651.5146 (1.12) 651.5146 (1.12) 651.5146 (1.12) 0.0000 (1.0) 651.5146 (1.12) 0.0000 (1.0) 0;0 1.5349 (0.89) 1 1 test_status-status-changed-noop[2.40.0] 657.3434 (1.13) 657.3434 (1.13) 657.3434 (1.13) 0.0000 (1.0) 657.3434 (1.13) 0.0000 (1.0) 0;0 1.5213 (0.88) 1 1 test_status-status-changed-noop[2.41.1] 665.7988 (1.15) 665.7988 (1.15) 665.7988 (1.15) 0.0000 (1.0) 665.7988 (1.15) 0.0000 (1.0) 0;0 1.5020 (0.87) 1 1 test_status-status-changed-noop[2.45.0] 660.7526 (1.14) 660.7526 (1.14) 660.7526 (1.14) 0.0000 (1.0) 660.7526 (1.14) 0.0000 (1.0) 0;0 1.5134 (0.88) 1 1 test_status-status-changed-noop[main] 714.1781 (1.23) 714.1781 (1.23) 714.1781 (1.23) 0.0000 (1.0) 714.1781 (1.23) 0.0000 (1.0) 0;0 1.4002 (0.81) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.11.0] 535.4431 (1.0) 535.4431 (1.0) 535.4431 (1.0) 0.0000 (1.0) 535.4431 (1.0) 0.0000 (1.0) 0;0 1.8676 (1.0) 1 1 test_status-status-noop[2.18.1] 576.1897 (1.08) 576.1897 (1.08) 576.1897 (1.08) 0.0000 (1.0) 576.1897 (1.08) 0.0000 (1.0) 0;0 1.7355 (0.93) 1 1 test_status-status-noop[2.39.0] 644.0354 (1.20) 644.0354 (1.20) 644.0354 (1.20) 0.0000 (1.0) 644.0354 (1.20) 0.0000 (1.0) 0;0 1.5527 (0.83) 1 1 test_status-status-noop[2.40.0] 589.0183 (1.10) 589.0183 (1.10) 589.0183 (1.10) 0.0000 (1.0) 589.0183 (1.10) 0.0000 (1.0) 0;0 1.6977 (0.91) 1 1 test_status-status-noop[2.41.1] 646.1805 (1.21) 646.1805 (1.21) 646.1805 (1.21) 0.0000 (1.0) 646.1805 (1.21) 0.0000 (1.0) 0;0 1.5476 (0.83) 1 1 test_status-status-noop[2.45.0] 666.3745 (1.24) 666.3745 (1.24) 666.3745 (1.24) 0.0000 (1.0) 666.3745 (1.24) 0.0000 (1.0) 0;0 1.5007 (0.80) 1 1 test_status-status-noop[main] 802.1126 (1.50) 802.1126 (1.50) 802.1126 (1.50) 0.0000 (1.0) 802.1126 (1.50) 0.0000 (1.0) 0;0 1.2467 (0.67) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_pull-pull': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_pull-pull[2.11.0] 6.5354 (1.04) 6.5354 (1.04) 6.5354 (1.04) 0.0000 (1.0) 6.5354 (1.04) 0.0000 (1.0) 0;0 0.1530 (0.97) 1 1 test_pull-pull[2.18.1] 6.6507 (1.05) 6.6507 (1.05) 6.6507 (1.05) 0.0000 (1.0) 6.6507 (1.05) 0.0000 (1.0) 0;0 0.1504 (0.95) 1 1 test_pull-pull[2.39.0] 7.7634 (1.23) 7.7634 (1.23) 7.7634 (1.23) 0.0000 (1.0) 7.7634 (1.23) 0.0000 (1.0) 0;0 0.1288 (0.81) 1 1 test_pull-pull[2.40.0] 7.8280 (1.24) 7.8280 (1.24) 7.8280 (1.24) 0.0000 (1.0) 7.8280 (1.24) 0.0000 (1.0) 0;0 0.1277 (0.81) 1 1 test_pull-pull[2.41.1] 7.7542 (1.23) 7.7542 (1.23) 7.7542 (1.23) 0.0000 (1.0) 7.7542 (1.23) 0.0000 (1.0) 0;0 0.1290 (0.81) 1 1 test_pull-pull[2.45.0] 6.3472 (1.01) 6.3472 (1.01) 6.3472 (1.01) 0.0000 (1.0) 6.3472 (1.01) 0.0000 (1.0) 0;0 0.1576 (0.99) 1 1 test_pull-pull[main] 6.3095 (1.0) 6.3095 (1.0) 6.3095 (1.0) 0.0000 (1.0) 6.3095 (1.0) 0.0000 (1.0) 0;0 0.1585 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[2.11.0] 6.2798 (1.86) 6.2798 (1.86) 6.2798 (1.86) 0.0000 (1.0) 6.2798 (1.86) 0.0000 (1.0) 0;0 0.1592 (0.54) 1 1 test_add-add[2.18.1] 5.6055 (1.66) 5.6055 (1.66) 5.6055 (1.66) 0.0000 (1.0) 5.6055 (1.66) 0.0000 (1.0) 0;0 0.1784 (0.60) 1 1 test_add-add[2.39.0] 5.3320 (1.58) 5.3320 (1.58) 5.3320 (1.58) 0.0000 (1.0) 5.3320 (1.58) 0.0000 (1.0) 0;0 0.1875 (0.63) 1 1 test_add-add[2.40.0] 5.3570 (1.58) 5.3570 (1.58) 5.3570 (1.58) 0.0000 (1.0) 5.3570 (1.58) 0.0000 (1.0) 0;0 0.1867 (0.63) 1 1 test_add-add[2.41.1] 5.3685 (1.59) 5.3685 (1.59) 5.3685 (1.59) 0.0000 (1.0) 5.3685 (1.59) 0.0000 (1.0) 0;0 0.1863 (0.63) 1 1 test_add-add[2.45.0] 3.3814 (1.0) 3.3814 (1.0) 3.3814 (1.0) 0.0000 (1.0) 3.3814 (1.0) 0.0000 (1.0) 0;0 0.2957 (1.0) 1 1 test_add-add[main] 3.4748 (1.03) 3.4748 (1.03) 3.4748 (1.03) 0.0000 (1.0) 3.4748 (1.03) 0.0000 (1.0) 0;0 0.2878 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_init-init': 7 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.11.0] 449.7854 (1.0) 529.7854 (1.0) 476.3573 (1.0) 15.6081 (1.04) 474.3431 (1.0) 21.0953 (1.13) 25;3 2.0993 (1.0) 100 1 test_init-init[2.18.1] 459.9244 (1.02) 533.0792 (1.01) 494.4041 (1.04) 15.0784 (1.0) 494.6489 (1.04) 18.6624 (1.0) 31;1 2.0226 (0.96) 100 1 test_init-init[2.39.0] 526.4472 (1.17) 610.6844 (1.15) 566.0966 (1.19) 18.4517 (1.22) 563.7302 (1.19) 26.7459 (1.43) 35;0 1.7665 (0.84) 100 1 test_init-init[2.40.0] 531.6451 (1.18) 705.6839 (1.33) 571.0825 (1.20) 22.3847 (1.48) 568.4680 (1.20) 27.6343 (1.48) 21;1 1.7511 (0.83) 100 1 test_init-init[2.41.1] 524.0822 (1.17) 664.0257 (1.25) 572.7799 (1.20) 23.7806 (1.58) 570.3923 (1.20) 28.8954 (1.55) 27;2 1.7459 (0.83) 100 1 test_init-init[2.45.0] 517.0467 (1.15) 614.2400 (1.16) 565.9944 (1.19) 20.0893 (1.33) 564.7992 (1.19) 29.0404 (1.56) 32;0 1.7668 (0.84) 100 1 test_init-init[main] 625.6789 (1.39) 774.2448 (1.46) 695.4107 (1.46) 26.3455 (1.75) 694.0178 (1.46) 31.3876 (1.68) 32;3 1.4380 (0.69) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.11.0] 3.5697 (1.16) 3.5697 (1.16) 3.5697 (1.16) 0.0000 (1.0) 3.5697 (1.16) 0.0000 (1.0) 0;0 0.2801 (0.86) 1 1 test_push-push[2.18.1] 3.5000 (1.14) 3.5000 (1.14) 3.5000 (1.14) 0.0000 (1.0) 3.5000 (1.14) 0.0000 (1.0) 0;0 0.2857 (0.88) 1 1 test_push-push[2.39.0] 4.5307 (1.47) 4.5307 (1.47) 4.5307 (1.47) 0.0000 (1.0) 4.5307 (1.47) 0.0000 (1.0) 0;0 0.2207 (0.68) 1 1 test_push-push[2.40.0] 4.5386 (1.47) 4.5386 (1.47) 4.5386 (1.47) 0.0000 (1.0) 4.5386 (1.47) 0.0000 (1.0) 0;0 0.2203 (0.68) 1 1 test_push-push[2.41.1] 4.5016 (1.46) 4.5016 (1.46) 4.5016 (1.46) 0.0000 (1.0) 4.5016 (1.46) 0.0000 (1.0) 0;0 0.2221 (0.68) 1 1 test_push-push[2.45.0] 3.0775 (1.0) 3.0775 (1.0) 3.0775 (1.0) 0.0000 (1.0) 3.0775 (1.0) 0.0000 (1.0) 0;0 0.3249 (1.0) 1 1 test_push-push[main] 3.1394 (1.02) 3.1394 (1.02) 3.1394 (1.02) 0.0000 (1.0) 3.1394 (1.02) 0.0000 (1.0) 0;0 0.3185 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.11.0] 1.2679 (1.03) 1.2679 (1.03) 1.2679 (1.03) 0.0000 (1.0) 1.2679 (1.03) 0.0000 (1.0) 0;0 0.7887 (0.97) 1 1 test_checkout_hardlink-checkout[2.18.1] 1.2446 (1.01) 1.2446 (1.01) 1.2446 (1.01) 0.0000 (1.0) 1.2446 (1.01) 0.0000 (1.0) 0;0 0.8035 (0.99) 1 1 test_checkout_hardlink-checkout[2.39.0] 1.2303 (1.0) 1.2303 (1.0) 1.2303 (1.0) 0.0000 (1.0) 1.2303 (1.0) 0.0000 (1.0) 0;0 0.8128 (1.0) 1 1 test_checkout_hardlink-checkout[2.40.0] 1.2469 (1.01) 1.2469 (1.01) 1.2469 (1.01) 0.0000 (1.0) 1.2469 (1.01) 0.0000 (1.0) 0;0 0.8020 (0.99) 1 1 test_checkout_hardlink-checkout[2.41.1] 1.2402 (1.01) 1.2402 (1.01) 1.2402 (1.01) 0.0000 (1.0) 1.2402 (1.01) 0.0000 (1.0) 0;0 0.8063 (0.99) 1 1 test_checkout_hardlink-checkout[2.45.0] 1.5628 (1.27) 1.5628 (1.27) 1.5628 (1.27) 0.0000 (1.0) 1.5628 (1.27) 0.0000 (1.0) 0;0 0.6399 (0.79) 1 1 test_checkout_hardlink-checkout[main] 1.6403 (1.33) 1.6403 (1.33) 1.6403 (1.33) 0.0000 (1.0) 1.6403 (1.33) 0.0000 (1.0) 0;0 0.6096 (0.75) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.11.0] 508.5058 (1.0) 508.5058 (1.0) 508.5058 (1.0) 0.0000 (1.0) 508.5058 (1.0) 0.0000 (1.0) 0;0 1.9665 (1.0) 1 1 test_checkout_hardlink-checkout-noop[2.18.1] 555.9835 (1.09) 555.9835 (1.09) 555.9835 (1.09) 0.0000 (1.0) 555.9835 (1.09) 0.0000 (1.0) 0;0 1.7986 (0.91) 1 1 test_checkout_hardlink-checkout-noop[2.39.0] 580.0229 (1.14) 580.0229 (1.14) 580.0229 (1.14) 0.0000 (1.0) 580.0229 (1.14) 0.0000 (1.0) 0;0 1.7241 (0.88) 1 1 test_checkout_hardlink-checkout-noop[2.40.0] 586.2727 (1.15) 586.2727 (1.15) 586.2727 (1.15) 0.0000 (1.0) 586.2727 (1.15) 0.0000 (1.0) 0;0 1.7057 (0.87) 1 1 test_checkout_hardlink-checkout-noop[2.41.1] 590.3182 (1.16) 590.3182 (1.16) 590.3182 (1.16) 0.0000 (1.0) 590.3182 (1.16) 0.0000 (1.0) 0;0 1.6940 (0.86) 1 1 test_checkout_hardlink-checkout-noop[2.45.0] 600.3660 (1.18) 600.3660 (1.18) 600.3660 (1.18) 0.0000 (1.0) 600.3660 (1.18) 0.0000 (1.0) 0;0 1.6657 (0.85) 1 1 test_checkout_hardlink-checkout-noop[main] 677.1313 (1.33) 677.1313 (1.33) 677.1313 (1.33) 0.0000 (1.0) 677.1313 (1.33) 0.0000 (1.0) 0;0 1.4768 (0.75) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.11.0] 1.2877 (2.01) 1.2877 (2.01) 1.2877 (2.01) 0.0000 (1.0) 1.2877 (2.01) 0.0000 (1.0) 0;0 0.7766 (0.50) 1 1 test_checkout_hardlink-checkout-update[2.18.1] 0.6412 (1.0) 0.6412 (1.0) 0.6412 (1.0) 0.0000 (1.0) 0.6412 (1.0) 0.0000 (1.0) 0;0 1.5597 (1.0) 1 1 test_checkout_hardlink-checkout-update[2.39.0] 0.6541 (1.02) 0.6541 (1.02) 0.6541 (1.02) 0.0000 (1.0) 0.6541 (1.02) 0.0000 (1.0) 0;0 1.5287 (0.98) 1 1 test_checkout_hardlink-checkout-update[2.40.0] 0.6586 (1.03) 0.6586 (1.03) 0.6586 (1.03) 0.0000 (1.0) 0.6586 (1.03) 0.0000 (1.0) 0;0 1.5183 (0.97) 1 1 test_checkout_hardlink-checkout-update[2.41.1] 0.6541 (1.02) 0.6541 (1.02) 0.6541 (1.02) 0.0000 (1.0) 0.6541 (1.02) 0.0000 (1.0) 0;0 1.5288 (0.98) 1 1 test_checkout_hardlink-checkout-update[2.45.0] 0.6804 (1.06) 0.6804 (1.06) 0.6804 (1.06) 0.0000 (1.0) 0.6804 (1.06) 0.0000 (1.0) 0;0 1.4698 (0.94) 1 1 test_checkout_hardlink-checkout-update[main] 0.7443 (1.16) 0.7443 (1.16) 0.7443 (1.16) 0.0000 (1.0) 0.7443 (1.16) 0.0000 (1.0) 0;0 1.3435 (0.86) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.11.0] 9.1014 (1.25) 9.1014 (1.25) 9.1014 (1.25) 0.0000 (1.0) 9.1014 (1.25) 0.0000 (1.0) 0;0 0.1099 (0.80) 1 1 test_update-update[2.18.1] 8.1885 (1.13) 8.1885 (1.13) 8.1885 (1.13) 0.0000 (1.0) 8.1885 (1.13) 0.0000 (1.0) 0;0 0.1221 (0.89) 1 1 test_update-update[2.39.0] 7.3629 (1.02) 7.3629 (1.02) 7.3629 (1.02) 0.0000 (1.0) 7.3629 (1.02) 0.0000 (1.0) 0;0 0.1358 (0.99) 1 1 test_update-update[2.40.0] 7.4495 (1.03) 7.4495 (1.03) 7.4495 (1.03) 0.0000 (1.0) 7.4495 (1.03) 0.0000 (1.0) 0;0 0.1342 (0.97) 1 1 test_update-update[2.41.1] 7.2528 (1.0) 7.2528 (1.0) 7.2528 (1.0) 0.0000 (1.0) 7.2528 (1.0) 0.0000 (1.0) 0;0 0.1379 (1.0) 1 1 test_update-update[2.45.0] 7.5262 (1.04) 7.5262 (1.04) 7.5262 (1.04) 0.0000 (1.0) 7.5262 (1.04) 0.0000 (1.0) 0;0 0.1329 (0.96) 1 1 test_update-update[main] 7.7411 (1.07) 7.7411 (1.07) 7.7411 (1.07) 0.0000 (1.0) 7.7411 (1.07) 0.0000 (1.0) 0;0 0.1292 (0.94) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update-noop[2.11.0] 479.7082 (1.0) 479.7082 (1.0) 479.7082 (1.0) 0.0000 (1.0) 479.7082 (1.0) 0.0000 (1.0) 0;0 2.0846 (1.0) 1 1 test_update-update-noop[2.18.1] 635.3286 (1.32) 635.3286 (1.32) 635.3286 (1.32) 0.0000 (1.0) 635.3286 (1.32) 0.0000 (1.0) 0;0 1.5740 (0.76) 1 1 test_update-update-noop[2.39.0] 940.6714 (1.96) 940.6714 (1.96) 940.6714 (1.96) 0.0000 (1.0) 940.6714 (1.96) 0.0000 (1.0) 0;0 1.0631 (0.51) 1 1 test_update-update-noop[2.40.0] 943.0128 (1.97) 943.0128 (1.97) 943.0128 (1.97) 0.0000 (1.0) 943.0128 (1.97) 0.0000 (1.0) 0;0 1.0604 (0.51) 1 1 test_update-update-noop[2.41.1] 925.8362 (1.93) 925.8362 (1.93) 925.8362 (1.93) 0.0000 (1.0) 925.8362 (1.93) 0.0000 (1.0) 0;0 1.0801 (0.52) 1 1 test_update-update-noop[2.45.0] 1,055.0781 (2.20) 1,055.0781 (2.20) 1,055.0781 (2.20) 0.0000 (1.0) 1,055.0781 (2.20) 0.0000 (1.0) 0;0 0.9478 (0.45) 1 1 test_update-update-noop[main] 1,125.3307 (2.35) 1,125.3307 (2.35) 1,125.3307 (2.35) 0.0000 (1.0) 1,125.3307 (2.35) 0.0000 (1.0) 0;0 0.8886 (0.43) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.18.1] 655.9369 (1.0) 655.9369 (1.0) 655.9369 (1.0) 0.0000 (1.0) 655.9369 (1.0) 0.0000 (1.0) 0;0 1.5245 (1.0) 1 1 test_data_status-data-changed[2.39.0] 714.5611 (1.09) 714.5611 (1.09) 714.5611 (1.09) 0.0000 (1.0) 714.5611 (1.09) 0.0000 (1.0) 0;0 1.3995 (0.92) 1 1 test_data_status-data-changed[2.40.0] 709.4044 (1.08) 709.4044 (1.08) 709.4044 (1.08) 0.0000 (1.0) 709.4044 (1.08) 0.0000 (1.0) 0;0 1.4096 (0.92) 1 1 test_data_status-data-changed[2.41.1] 697.1730 (1.06) 697.1730 (1.06) 697.1730 (1.06) 0.0000 (1.0) 697.1730 (1.06) 0.0000 (1.0) 0;0 1.4344 (0.94) 1 1 test_data_status-data-changed[2.45.0] 803.5732 (1.23) 803.5732 (1.23) 803.5732 (1.23) 0.0000 (1.0) 803.5732 (1.23) 0.0000 (1.0) 0;0 1.2444 (0.82) 1 1 test_data_status-data-changed[main] 711.3987 (1.08) 711.3987 (1.08) 711.3987 (1.08) 0.0000 (1.0) 711.3987 (1.08) 0.0000 (1.0) 0;0 1.4057 (0.92) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.18.1] 659.6084 (1.0) 659.6084 (1.0) 659.6084 (1.0) 0.0000 (1.0) 659.6084 (1.0) 0.0000 (1.0) 0;0 1.5161 (1.0) 1 1 test_data_status-data-changed-noop[2.39.0] 708.7540 (1.07) 708.7540 (1.07) 708.7540 (1.07) 0.0000 (1.0) 708.7540 (1.07) 0.0000 (1.0) 0;0 1.4109 (0.93) 1 1 test_data_status-data-changed-noop[2.40.0] 710.8523 (1.08) 710.8523 (1.08) 710.8523 (1.08) 0.0000 (1.0) 710.8523 (1.08) 0.0000 (1.0) 0;0 1.4068 (0.93) 1 1 test_data_status-data-changed-noop[2.41.1] 702.6042 (1.07) 702.6042 (1.07) 702.6042 (1.07) 0.0000 (1.0) 702.6042 (1.07) 0.0000 (1.0) 0;0 1.4233 (0.94) 1 1 test_data_status-data-changed-noop[2.45.0] 678.9638 (1.03) 678.9638 (1.03) 678.9638 (1.03) 0.0000 (1.0) 678.9638 (1.03) 0.0000 (1.0) 0;0 1.4728 (0.97) 1 1 test_data_status-data-changed-noop[main] 703.5322 (1.07) 703.5322 (1.07) 703.5322 (1.07) 0.0000 (1.0) 703.5322 (1.07) 0.0000 (1.0) 0;0 1.4214 (0.94) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.18.1] 1.4357 (1.02) 1.4357 (1.02) 1.4357 (1.02) 0.0000 (1.0) 1.4357 (1.02) 0.0000 (1.0) 0;0 0.6965 (0.98) 1 1 test_data_status-data-new[2.39.0] 1.4843 (1.05) 1.4843 (1.05) 1.4843 (1.05) 0.0000 (1.0) 1.4843 (1.05) 0.0000 (1.0) 0;0 0.6737 (0.95) 1 1 test_data_status-data-new[2.40.0] 1.4906 (1.06) 1.4906 (1.06) 1.4906 (1.06) 0.0000 (1.0) 1.4906 (1.06) 0.0000 (1.0) 0;0 0.6709 (0.95) 1 1 test_data_status-data-new[2.41.1] 1.6448 (1.16) 1.6448 (1.16) 1.6448 (1.16) 0.0000 (1.0) 1.6448 (1.16) 0.0000 (1.0) 0;0 0.6080 (0.86) 1 1 test_data_status-data-new[2.45.0] 1.4128 (1.00) 1.4128 (1.00) 1.4128 (1.00) 0.0000 (1.0) 1.4128 (1.00) 0.0000 (1.0) 0;0 0.7078 (1.00) 1 1 test_data_status-data-new[main] 1.4123 (1.0) 1.4123 (1.0) 1.4123 (1.0) 0.0000 (1.0) 1.4123 (1.0) 0.0000 (1.0) 0;0 0.7081 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.18.1] 652.5730 (1.0) 652.5730 (1.0) 652.5730 (1.0) 0.0000 (1.0) 652.5730 (1.0) 0.0000 (1.0) 0;0 1.5324 (1.0) 1 1 test_data_status-data-noop[2.39.0] 702.7138 (1.08) 702.7138 (1.08) 702.7138 (1.08) 0.0000 (1.0) 702.7138 (1.08) 0.0000 (1.0) 0;0 1.4231 (0.93) 1 1 test_data_status-data-noop[2.40.0] 701.3393 (1.07) 701.3393 (1.07) 701.3393 (1.07) 0.0000 (1.0) 701.3393 (1.07) 0.0000 (1.0) 0;0 1.4258 (0.93) 1 1 test_data_status-data-noop[2.41.1] 693.0364 (1.06) 693.0364 (1.06) 693.0364 (1.06) 0.0000 (1.0) 693.0364 (1.06) 0.0000 (1.0) 0;0 1.4429 (0.94) 1 1 test_data_status-data-noop[2.45.0] 680.6154 (1.04) 680.6154 (1.04) 680.6154 (1.04) 0.0000 (1.0) 680.6154 (1.04) 0.0000 (1.0) 0;0 1.4693 (0.96) 1 1 test_data_status-data-noop[main] 702.4241 (1.08) 702.4241 (1.08) 702.4241 (1.08) 0.0000 (1.0) 702.4241 (1.08) 0.0000 (1.0) 0;0 1.4236 (0.93) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.11.0] 5.1570 (1.15) 5.1570 (1.15) 5.1570 (1.15) 0.0000 (1.0) 5.1570 (1.15) 0.0000 (1.0) 0;0 0.1939 (0.87) 1 1 test_exp_show-exp[2.18.1] 5.0345 (1.12) 5.0345 (1.12) 5.0345 (1.12) 0.0000 (1.0) 5.0345 (1.12) 0.0000 (1.0) 0;0 0.1986 (0.89) 1 1 test_exp_show-exp[2.39.0] 4.6367 (1.03) 4.6367 (1.03) 4.6367 (1.03) 0.0000 (1.0) 4.6367 (1.03) 0.0000 (1.0) 0;0 0.2157 (0.97) 1 1 test_exp_show-exp[2.40.0] 4.4930 (1.0) 4.4930 (1.0) 4.4930 (1.0) 0.0000 (1.0) 4.4930 (1.0) 0.0000 (1.0) 0;0 0.2226 (1.0) 1 1 test_exp_show-exp[2.41.1] 4.4983 (1.00) 4.4983 (1.00) 4.4983 (1.00) 0.0000 (1.0) 4.4983 (1.00) 0.0000 (1.0) 0;0 0.2223 (1.00) 1 1 test_exp_show-exp[2.45.0] 4.7385 (1.05) 4.7385 (1.05) 4.7385 (1.05) 0.0000 (1.0) 4.7385 (1.05) 0.0000 (1.0) 0;0 0.2110 (0.95) 1 1 test_exp_show-exp[main] 5.7543 (1.28) 5.7543 (1.28) 5.7543 (1.28) 0.0000 (1.0) 5.7543 (1.28) 0.0000 (1.0) 0;0 0.1738 (0.78) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------- benchmark 'test_partial_add_s3-add-partial-add': 14 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-add-partial-add[2.11.0] 5.7433 (1.93) 5.7433 (1.93) 5.7433 (1.93) 0.0000 (1.0) 5.7433 (1.93) 0.0000 (1.0) 0;0 0.1741 (0.52) 1 1 test_partial_add_s3-add-partial-add[2.11.0] 4.8634 (1.64) 4.8634 (1.64) 4.8634 (1.64) 0.0000 (1.0) 4.8634 (1.64) 0.0000 (1.0) 0;0 0.2056 (0.61) 1 1 test_partial_add_s3-add-partial-add[2.18.1] 6.4162 (2.16) 6.4162 (2.16) 6.4162 (2.16) 0.0000 (1.0) 6.4162 (2.16) 0.0000 (1.0) 0;0 0.1559 (0.46) 1 1 test_partial_add_s3-add-partial-add[2.18.1] 4.1783 (1.41) 4.1783 (1.41) 4.1783 (1.41) 0.0000 (1.0) 4.1783 (1.41) 0.0000 (1.0) 0;0 0.2393 (0.71) 1 1 test_partial_add_s3-add-partial-add[2.39.0] 4.2448 (1.43) 4.2448 (1.43) 4.2448 (1.43) 0.0000 (1.0) 4.2448 (1.43) 0.0000 (1.0) 0;0 0.2356 (0.70) 1 1 test_partial_add_s3-add-partial-add[2.39.0] 5.3431 (1.80) 5.3431 (1.80) 5.3431 (1.80) 0.0000 (1.0) 5.3431 (1.80) 0.0000 (1.0) 0;0 0.1872 (0.56) 1 1 test_partial_add_s3-add-partial-add[2.40.0] 4.7290 (1.59) 4.7290 (1.59) 4.7290 (1.59) 0.0000 (1.0) 4.7290 (1.59) 0.0000 (1.0) 0;0 0.2115 (0.63) 1 1 test_partial_add_s3-add-partial-add[2.40.0] 4.2829 (1.44) 4.2829 (1.44) 4.2829 (1.44) 0.0000 (1.0) 4.2829 (1.44) 0.0000 (1.0) 0;0 0.2335 (0.69) 1 1 test_partial_add_s3-add-partial-add[2.41.1] 2.9805 (1.00) 2.9805 (1.00) 2.9805 (1.00) 0.0000 (1.0) 2.9805 (1.00) 0.0000 (1.0) 0;0 0.3355 (1.00) 1 1 test_partial_add_s3-add-partial-add[2.41.1] 6.9451 (2.34) 6.9451 (2.34) 6.9451 (2.34) 0.0000 (1.0) 6.9451 (2.34) 0.0000 (1.0) 0;0 0.1440 (0.43) 1 1 test_partial_add_s3-add-partial-add[2.45.0] 3.5551 (1.20) 3.5551 (1.20) 3.5551 (1.20) 0.0000 (1.0) 3.5551 (1.20) 0.0000 (1.0) 0;0 0.2813 (0.84) 1 1 test_partial_add_s3-add-partial-add[2.45.0] 3.0177 (1.02) 3.0177 (1.02) 3.0177 (1.02) 0.0000 (1.0) 3.0177 (1.02) 0.0000 (1.0) 0;0 0.3314 (0.98) 1 1 test_partial_add_s3-add-partial-add[main] 2.9692 (1.0) 2.9692 (1.0) 2.9692 (1.0) 0.0000 (1.0) 2.9692 (1.0) 0.0000 (1.0) 0;0 0.3368 (1.0) 1 1 test_partial_add_s3-add-partial-add[main] 3.0136 (1.01) 3.0136 (1.01) 3.0136 (1.01) 0.0000 (1.0) 3.0136 (1.01) 0.0000 (1.0) 0;0 0.3318 (0.99) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_partial_add_s3-gc-cloud-noop': 14 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-gc-cloud-noop[2.11.0] 1.3796 (1.04) 1.3796 (1.04) 1.3796 (1.04) 0.0000 (1.0) 1.3796 (1.04) 0.0000 (1.0) 0;0 0.7248 (0.96) 1 1 test_partial_add_s3-gc-cloud-noop[2.11.0] 1.3300 (1.0) 1.3300 (1.0) 1.3300 (1.0) 0.0000 (1.0) 1.3300 (1.0) 0.0000 (1.0) 0;0 0.7519 (1.0) 1 1 test_partial_add_s3-gc-cloud-noop[2.18.1] 1.4083 (1.06) 1.4083 (1.06) 1.4083 (1.06) 0.0000 (1.0) 1.4083 (1.06) 0.0000 (1.0) 0;0 0.7101 (0.94) 1 1 test_partial_add_s3-gc-cloud-noop[2.18.1] 1.3655 (1.03) 1.3655 (1.03) 1.3655 (1.03) 0.0000 (1.0) 1.3655 (1.03) 0.0000 (1.0) 0;0 0.7323 (0.97) 1 1 test_partial_add_s3-gc-cloud-noop[2.39.0] 1.4100 (1.06) 1.4100 (1.06) 1.4100 (1.06) 0.0000 (1.0) 1.4100 (1.06) 0.0000 (1.0) 0;0 0.7092 (0.94) 1 1 test_partial_add_s3-gc-cloud-noop[2.39.0] 1.4175 (1.07) 1.4175 (1.07) 1.4175 (1.07) 0.0000 (1.0) 1.4175 (1.07) 0.0000 (1.0) 0;0 0.7055 (0.94) 1 1 test_partial_add_s3-gc-cloud-noop[2.40.0] 1.4138 (1.06) 1.4138 (1.06) 1.4138 (1.06) 0.0000 (1.0) 1.4138 (1.06) 0.0000 (1.0) 0;0 0.7073 (0.94) 1 1 test_partial_add_s3-gc-cloud-noop[2.40.0] 1.4191 (1.07) 1.4191 (1.07) 1.4191 (1.07) 0.0000 (1.0) 1.4191 (1.07) 0.0000 (1.0) 0;0 0.7047 (0.94) 1 1 test_partial_add_s3-gc-cloud-noop[2.41.1] 1.3765 (1.03) 1.3765 (1.03) 1.3765 (1.03) 0.0000 (1.0) 1.3765 (1.03) 0.0000 (1.0) 0;0 0.7265 (0.97) 1 1 test_partial_add_s3-gc-cloud-noop[2.41.1] 1.4135 (1.06) 1.4135 (1.06) 1.4135 (1.06) 0.0000 (1.0) 1.4135 (1.06) 0.0000 (1.0) 0;0 0.7074 (0.94) 1 1 test_partial_add_s3-gc-cloud-noop[2.45.0] 1.3903 (1.05) 1.3903 (1.05) 1.3903 (1.05) 0.0000 (1.0) 1.3903 (1.05) 0.0000 (1.0) 0;0 0.7193 (0.96) 1 1 test_partial_add_s3-gc-cloud-noop[2.45.0] 1.3603 (1.02) 1.3603 (1.02) 1.3603 (1.02) 0.0000 (1.0) 1.3603 (1.02) 0.0000 (1.0) 0;0 0.7352 (0.98) 1 1 test_partial_add_s3-gc-cloud-noop[main] 1.4862 (1.12) 1.4862 (1.12) 1.4862 (1.12) 0.0000 (1.0) 1.4862 (1.12) 0.0000 (1.0) 0;0 0.6729 (0.89) 1 1 test_partial_add_s3-gc-cloud-noop[main] 1.5461 (1.16) 1.5461 (1.16) 1.5461 (1.16) 0.0000 (1.0) 1.5461 (1.16) 0.0000 (1.0) 0;0 0.6468 (0.86) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_partial_add_s3-gc-noop': 14 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-gc-noop[2.11.0] 420.5238 (1.01) 420.5238 (1.01) 420.5238 (1.01) 0.0000 (1.0) 420.5238 (1.01) 0.0000 (1.0) 0;0 2.3780 (0.99) 1 1 test_partial_add_s3-gc-noop[2.11.0] 416.2523 (1.0) 416.2523 (1.0) 416.2523 (1.0) 0.0000 (1.0) 416.2523 (1.0) 0.0000 (1.0) 0;0 2.4024 (1.0) 1 1 test_partial_add_s3-gc-noop[2.18.1] 460.4844 (1.11) 460.4844 (1.11) 460.4844 (1.11) 0.0000 (1.0) 460.4844 (1.11) 0.0000 (1.0) 0;0 2.1716 (0.90) 1 1 test_partial_add_s3-gc-noop[2.18.1] 463.3355 (1.11) 463.3355 (1.11) 463.3355 (1.11) 0.0000 (1.0) 463.3355 (1.11) 0.0000 (1.0) 0;0 2.1583 (0.90) 1 1 test_partial_add_s3-gc-noop[2.39.0] 484.5178 (1.16) 484.5178 (1.16) 484.5178 (1.16) 0.0000 (1.0) 484.5178 (1.16) 0.0000 (1.0) 0;0 2.0639 (0.86) 1 1 test_partial_add_s3-gc-noop[2.39.0] 493.0113 (1.18) 493.0113 (1.18) 493.0113 (1.18) 0.0000 (1.0) 493.0113 (1.18) 0.0000 (1.0) 0;0 2.0284 (0.84) 1 1 test_partial_add_s3-gc-noop[2.40.0] 487.3665 (1.17) 487.3665 (1.17) 487.3665 (1.17) 0.0000 (1.0) 487.3665 (1.17) 0.0000 (1.0) 0;0 2.0518 (0.85) 1 1 test_partial_add_s3-gc-noop[2.40.0] 485.8237 (1.17) 485.8237 (1.17) 485.8237 (1.17) 0.0000 (1.0) 485.8237 (1.17) 0.0000 (1.0) 0;0 2.0584 (0.86) 1 1 test_partial_add_s3-gc-noop[2.41.1] 479.9806 (1.15) 479.9806 (1.15) 479.9806 (1.15) 0.0000 (1.0) 479.9806 (1.15) 0.0000 (1.0) 0;0 2.0834 (0.87) 1 1 test_partial_add_s3-gc-noop[2.41.1] 489.8512 (1.18) 489.8512 (1.18) 489.8512 (1.18) 0.0000 (1.0) 489.8512 (1.18) 0.0000 (1.0) 0;0 2.0414 (0.85) 1 1 test_partial_add_s3-gc-noop[2.45.0] 483.0724 (1.16) 483.0724 (1.16) 483.0724 (1.16) 0.0000 (1.0) 483.0724 (1.16) 0.0000 (1.0) 0;0 2.0701 (0.86) 1 1 test_partial_add_s3-gc-noop[2.45.0] 473.9292 (1.14) 473.9292 (1.14) 473.9292 (1.14) 0.0000 (1.0) 473.9292 (1.14) 0.0000 (1.0) 0;0 2.1100 (0.88) 1 1 test_partial_add_s3-gc-noop[main] 556.1666 (1.34) 556.1666 (1.34) 556.1666 (1.34) 0.0000 (1.0) 556.1666 (1.34) 0.0000 (1.0) 0;0 1.7980 (0.75) 1 1 test_partial_add_s3-gc-noop[main] 557.7727 (1.34) 557.7727 (1.34) 557.7727 (1.34) 0.0000 (1.0) 557.7727 (1.34) 0.0000 (1.0) 0;0 1.7928 (0.75) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_partial_add_s3-push-partial-add': 14 tests ------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-push-partial-add[2.11.0] 10.3211 (10.50) 10.3211 (10.50) 10.3211 (10.50) 0.0000 (1.0) 10.3211 (10.50) 0.0000 (1.0) 0;0 0.0969 (0.10) 1 1 test_partial_add_s3-push-partial-add[2.11.0] 1.0225 (1.04) 1.0225 (1.04) 1.0225 (1.04) 0.0000 (1.0) 1.0225 (1.04) 0.0000 (1.0) 0;0 0.9780 (0.96) 1 1 test_partial_add_s3-push-partial-add[2.18.1] 20.4799 (20.83) 20.4799 (20.83) 20.4799 (20.83) 0.0000 (1.0) 20.4799 (20.83) 0.0000 (1.0) 0;0 0.0488 (0.05) 1 1 test_partial_add_s3-push-partial-add[2.18.1] 0.9832 (1.0) 0.9832 (1.0) 0.9832 (1.0) 0.0000 (1.0) 0.9832 (1.0) 0.0000 (1.0) 0;0 1.0171 (1.0) 1 1 test_partial_add_s3-push-partial-add[2.39.0] 11.2394 (11.43) 11.2394 (11.43) 11.2394 (11.43) 0.0000 (1.0) 11.2394 (11.43) 0.0000 (1.0) 0;0 0.0890 (0.09) 1 1 test_partial_add_s3-push-partial-add[2.39.0] 22.5600 (22.95) 22.5600 (22.95) 22.5600 (22.95) 0.0000 (1.0) 22.5600 (22.95) 0.0000 (1.0) 0;0 0.0443 (0.04) 1 1 test_partial_add_s3-push-partial-add[2.40.0] 11.0149 (11.20) 11.0149 (11.20) 11.0149 (11.20) 0.0000 (1.0) 11.0149 (11.20) 0.0000 (1.0) 0;0 0.0908 (0.09) 1 1 test_partial_add_s3-push-partial-add[2.40.0] 11.1117 (11.30) 11.1117 (11.30) 11.1117 (11.30) 0.0000 (1.0) 11.1117 (11.30) 0.0000 (1.0) 0;0 0.0900 (0.09) 1 1 test_partial_add_s3-push-partial-add[2.41.1] 1.0245 (1.04) 1.0245 (1.04) 1.0245 (1.04) 0.0000 (1.0) 1.0245 (1.04) 0.0000 (1.0) 0;0 0.9761 (0.96) 1 1 test_partial_add_s3-push-partial-add[2.41.1] 12.0609 (12.27) 12.0609 (12.27) 12.0609 (12.27) 0.0000 (1.0) 12.0609 (12.27) 0.0000 (1.0) 0;0 0.0829 (0.08) 1 1 test_partial_add_s3-push-partial-add[2.45.0] 9.1793 (9.34) 9.1793 (9.34) 9.1793 (9.34) 0.0000 (1.0) 9.1793 (9.34) 0.0000 (1.0) 0;0 0.1089 (0.11) 1 1 test_partial_add_s3-push-partial-add[2.45.0] 1.0105 (1.03) 1.0105 (1.03) 1.0105 (1.03) 0.0000 (1.0) 1.0105 (1.03) 0.0000 (1.0) 0;0 0.9896 (0.97) 1 1 test_partial_add_s3-push-partial-add[main] 5.5958 (5.69) 5.5958 (5.69) 5.5958 (5.69) 0.0000 (1.0) 5.5958 (5.69) 0.0000 (1.0) 0;0 0.1787 (0.18) 1 1 test_partial_add_s3-push-partial-add[main] 5.5022 (5.60) 5.5022 (5.60) 5.5022 (5.60) 0.0000 (1.0) 5.5022 (5.60) 0.0000 (1.0) 0;0 0.1817 (0.18) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-add': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-add[2.11.0] 573.0694 (1.08) 573.0694 (1.08) 573.0694 (1.08) 0.0000 (1.0) 573.0694 (1.08) 0.0000 (1.0) 0;0 1.7450 (0.93) 1 1 test_partial_remove_s3-add[2.18.1] 2,349.8917 (4.42) 2,349.8917 (4.42) 2,349.8917 (4.42) 0.0000 (1.0) 2,349.8917 (4.42) 0.0000 (1.0) 0;0 0.4256 (0.23) 1 1 test_partial_remove_s3-add[2.39.0] 1,740.3266 (3.27) 1,740.3266 (3.27) 1,740.3266 (3.27) 0.0000 (1.0) 1,740.3266 (3.27) 0.0000 (1.0) 0;0 0.5746 (0.31) 1 1 test_partial_remove_s3-add[2.40.0] 1,798.3578 (3.38) 1,798.3578 (3.38) 1,798.3578 (3.38) 0.0000 (1.0) 1,798.3578 (3.38) 0.0000 (1.0) 0;0 0.5561 (0.30) 1 1 test_partial_remove_s3-add[2.41.1] 1,774.7270 (3.34) 1,774.7270 (3.34) 1,774.7270 (3.34) 0.0000 (1.0) 1,774.7270 (3.34) 0.0000 (1.0) 0;0 0.5635 (0.30) 1 1 test_partial_remove_s3-add[2.45.0] 531.9618 (1.0) 531.9618 (1.0) 531.9618 (1.0) 0.0000 (1.0) 531.9618 (1.0) 0.0000 (1.0) 0;0 1.8798 (1.0) 1 1 test_partial_remove_s3-add[main] 1,515.5197 (2.85) 1,515.5197 (2.85) 1,515.5197 (2.85) 0.0000 (1.0) 1,515.5197 (2.85) 0.0000 (1.0) 0;0 0.6598 (0.35) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-gc[2.11.0] 457.9739 (1.0) 457.9739 (1.0) 457.9739 (1.0) 0.0000 (1.0) 457.9739 (1.0) 0.0000 (1.0) 0;0 2.1835 (1.0) 1 1 test_partial_remove_s3-gc[2.18.1] 463.5790 (1.01) 463.5790 (1.01) 463.5790 (1.01) 0.0000 (1.0) 463.5790 (1.01) 0.0000 (1.0) 0;0 2.1571 (0.99) 1 1 test_partial_remove_s3-gc[2.39.0] 496.3677 (1.08) 496.3677 (1.08) 496.3677 (1.08) 0.0000 (1.0) 496.3677 (1.08) 0.0000 (1.0) 0;0 2.0146 (0.92) 1 1 test_partial_remove_s3-gc[2.40.0] 488.0583 (1.07) 488.0583 (1.07) 488.0583 (1.07) 0.0000 (1.0) 488.0583 (1.07) 0.0000 (1.0) 0;0 2.0489 (0.94) 1 1 test_partial_remove_s3-gc[2.41.1] 488.4721 (1.07) 488.4721 (1.07) 488.4721 (1.07) 0.0000 (1.0) 488.4721 (1.07) 0.0000 (1.0) 0;0 2.0472 (0.94) 1 1 test_partial_remove_s3-gc[2.45.0] 482.0921 (1.05) 482.0921 (1.05) 482.0921 (1.05) 0.0000 (1.0) 482.0921 (1.05) 0.0000 (1.0) 0;0 2.0743 (0.95) 1 1 test_partial_remove_s3-gc[main] 572.9763 (1.25) 572.9763 (1.25) 572.9763 (1.25) 0.0000 (1.0) 572.9763 (1.25) 0.0000 (1.0) 0;0 1.7453 (0.80) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-gc-cloud': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-gc-cloud[2.11.0] 26.6796 (17.59) 26.6796 (17.59) 26.6796 (17.59) 0.0000 (1.0) 26.6796 (17.59) 0.0000 (1.0) 0;0 0.0375 (0.06) 1 1 test_partial_remove_s3-gc-cloud[2.18.1] 14.3664 (9.47) 14.3664 (9.47) 14.3664 (9.47) 0.0000 (1.0) 14.3664 (9.47) 0.0000 (1.0) 0;0 0.0696 (0.11) 1 1 test_partial_remove_s3-gc-cloud[2.39.0] 14.2209 (9.37) 14.2209 (9.37) 14.2209 (9.37) 0.0000 (1.0) 14.2209 (9.37) 0.0000 (1.0) 0;0 0.0703 (0.11) 1 1 test_partial_remove_s3-gc-cloud[2.40.0] 13.7324 (9.05) 13.7324 (9.05) 13.7324 (9.05) 0.0000 (1.0) 13.7324 (9.05) 0.0000 (1.0) 0;0 0.0728 (0.11) 1 1 test_partial_remove_s3-gc-cloud[2.41.1] 13.6441 (8.99) 13.6441 (8.99) 13.6441 (8.99) 0.0000 (1.0) 13.6441 (8.99) 0.0000 (1.0) 0;0 0.0733 (0.11) 1 1 test_partial_remove_s3-gc-cloud[2.45.0] 1.5171 (1.0) 1.5171 (1.0) 1.5171 (1.0) 0.0000 (1.0) 1.5171 (1.0) 0.0000 (1.0) 0;0 0.6592 (1.0) 1 1 test_partial_remove_s3-gc-cloud[main] 1.5808 (1.04) 1.5808 (1.04) 1.5808 (1.04) 0.0000 (1.0) 1.5808 (1.04) 0.0000 (1.0) 0;0 0.6326 (0.96) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-push': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_partial_remove_s3-push[2.11.0] 903.1297 (1.0) 903.1297 (1.0) 903.1297 (1.0) 0.0000 (1.0) 903.1297 (1.0) 0.0000 (1.0) 0;0 1.1073 (1.0) 1 1 test_partial_remove_s3-push[2.18.1] 1,372.4161 (1.52) 1,372.4161 (1.52) 1,372.4161 (1.52) 0.0000 (1.0) 1,372.4161 (1.52) 0.0000 (1.0) 0;0 0.7286 (0.66) 1 1 test_partial_remove_s3-push[2.39.0] 1,388.5935 (1.54) 1,388.5935 (1.54) 1,388.5935 (1.54) 0.0000 (1.0) 1,388.5935 (1.54) 0.0000 (1.0) 0;0 0.7202 (0.65) 1 1 test_partial_remove_s3-push[2.40.0] 1,392.1368 (1.54) 1,392.1368 (1.54) 1,392.1368 (1.54) 0.0000 (1.0) 1,392.1368 (1.54) 0.0000 (1.0) 0;0 0.7183 (0.65) 1 1 test_partial_remove_s3-push[2.41.1] 1,387.4803 (1.54) 1,387.4803 (1.54) 1,387.4803 (1.54) 0.0000 (1.0) 1,387.4803 (1.54) 0.0000 (1.0) 0;0 0.7207 (0.65) 1 1 test_partial_remove_s3-push[2.45.0] 930.1842 (1.03) 930.1842 (1.03) 930.1842 (1.03) 0.0000 (1.0) 930.1842 (1.03) 0.0000 (1.0) 0;0 1.0751 (0.97) 1 1 test_partial_remove_s3-push[main] 1,174.9678 (1.30) 1,174.9678 (1.30) 1,174.9678 (1.30) 0.0000 (1.0) 1,174.9678 (1.30) 0.0000 (1.0) 0;0 0.8511 (0.77) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.11.0] 6.5332 (1.87) 6.5332 (1.87) 6.5332 (1.87) 0.0000 (1.0) 6.5332 (1.87) 0.0000 (1.0) 0;0 0.1531 (0.54) 1 1 test_sharing_s3-add[2.18.1] 5.6185 (1.61) 5.6185 (1.61) 5.6185 (1.61) 0.0000 (1.0) 5.6185 (1.61) 0.0000 (1.0) 0;0 0.1780 (0.62) 1 1 test_sharing_s3-add[2.39.0] 5.3504 (1.53) 5.3504 (1.53) 5.3504 (1.53) 0.0000 (1.0) 5.3504 (1.53) 0.0000 (1.0) 0;0 0.1869 (0.65) 1 1 test_sharing_s3-add[2.40.0] 5.3859 (1.54) 5.3859 (1.54) 5.3859 (1.54) 0.0000 (1.0) 5.3859 (1.54) 0.0000 (1.0) 0;0 0.1857 (0.65) 1 1 test_sharing_s3-add[2.41.1] 5.3181 (1.52) 5.3181 (1.52) 5.3181 (1.52) 0.0000 (1.0) 5.3181 (1.52) 0.0000 (1.0) 0;0 0.1880 (0.66) 1 1 test_sharing_s3-add[2.45.0] 3.4980 (1.0) 3.4980 (1.0) 3.4980 (1.0) 0.0000 (1.0) 3.4980 (1.0) 0.0000 (1.0) 0;0 0.2859 (1.0) 1 1 test_sharing_s3-add[main] 3.5367 (1.01) 3.5367 (1.01) 3.5367 (1.01) 0.0000 (1.0) 3.5367 (1.01) 0.0000 (1.0) 0;0 0.2827 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.11.0] 3.2099 (1.46) 3.2099 (1.46) 3.2099 (1.46) 0.0000 (1.0) 3.2099 (1.46) 0.0000 (1.0) 0;0 0.3115 (0.68) 1 1 test_sharing_s3-add-noop[2.18.1] 3.4457 (1.57) 3.4457 (1.57) 3.4457 (1.57) 0.0000 (1.0) 3.4457 (1.57) 0.0000 (1.0) 0;0 0.2902 (0.64) 1 1 test_sharing_s3-add-noop[2.39.0] 2.1974 (1.00) 2.1974 (1.00) 2.1974 (1.00) 0.0000 (1.0) 2.1974 (1.00) 0.0000 (1.0) 0;0 0.4551 (1.00) 1 1 test_sharing_s3-add-noop[2.40.0] 2.1934 (1.0) 2.1934 (1.0) 2.1934 (1.0) 0.0000 (1.0) 2.1934 (1.0) 0.0000 (1.0) 0;0 0.4559 (1.0) 1 1 test_sharing_s3-add-noop[2.41.1] 2.1985 (1.00) 2.1985 (1.00) 2.1985 (1.00) 0.0000 (1.0) 2.1985 (1.00) 0.0000 (1.0) 0;0 0.4548 (1.00) 1 1 test_sharing_s3-add-noop[2.45.0] 2.3778 (1.08) 2.3778 (1.08) 2.3778 (1.08) 0.0000 (1.0) 2.3778 (1.08) 0.0000 (1.0) 0;0 0.4206 (0.92) 1 1 test_sharing_s3-add-noop[main] 2.3528 (1.07) 2.3528 (1.07) 2.3528 (1.07) 0.0000 (1.0) 2.3528 (1.07) 0.0000 (1.0) 0;0 0.4250 (0.93) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.11.0] 479.4013 (1.0) 479.4013 (1.0) 479.4013 (1.0) 0.0000 (1.0) 479.4013 (1.0) 0.0000 (1.0) 0;0 2.0859 (1.0) 1 1 test_sharing_s3-checkout-noop[2.18.1] 550.1780 (1.15) 550.1780 (1.15) 550.1780 (1.15) 0.0000 (1.0) 550.1780 (1.15) 0.0000 (1.0) 0;0 1.8176 (0.87) 1 1 test_sharing_s3-checkout-noop[2.39.0] 566.2925 (1.18) 566.2925 (1.18) 566.2925 (1.18) 0.0000 (1.0) 566.2925 (1.18) 0.0000 (1.0) 0;0 1.7659 (0.85) 1 1 test_sharing_s3-checkout-noop[2.40.0] 560.5645 (1.17) 560.5645 (1.17) 560.5645 (1.17) 0.0000 (1.0) 560.5645 (1.17) 0.0000 (1.0) 0;0 1.7839 (0.86) 1 1 test_sharing_s3-checkout-noop[2.41.1] 560.5793 (1.17) 560.5793 (1.17) 560.5793 (1.17) 0.0000 (1.0) 560.5793 (1.17) 0.0000 (1.0) 0;0 1.7839 (0.86) 1 1 test_sharing_s3-checkout-noop[2.45.0] 580.1589 (1.21) 580.1589 (1.21) 580.1589 (1.21) 0.0000 (1.0) 580.1589 (1.21) 0.0000 (1.0) 0;0 1.7237 (0.83) 1 1 test_sharing_s3-checkout-noop[main] 662.6351 (1.38) 662.6351 (1.38) 662.6351 (1.38) 0.0000 (1.0) 662.6351 (1.38) 0.0000 (1.0) 0;0 1.5091 (0.72) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.11.0] 14.6771 (1.19) 14.6771 (1.19) 14.6771 (1.19) 0.0000 (1.0) 14.6771 (1.19) 0.0000 (1.0) 0;0 0.0681 (0.84) 1 1 test_sharing_s3-pull[2.18.1] 15.0055 (1.22) 15.0055 (1.22) 15.0055 (1.22) 0.0000 (1.0) 15.0055 (1.22) 0.0000 (1.0) 0;0 0.0666 (0.82) 1 1 test_sharing_s3-pull[2.39.0] 14.6799 (1.19) 14.6799 (1.19) 14.6799 (1.19) 0.0000 (1.0) 14.6799 (1.19) 0.0000 (1.0) 0;0 0.0681 (0.84) 1 1 test_sharing_s3-pull[2.40.0] 14.5375 (1.18) 14.5375 (1.18) 14.5375 (1.18) 0.0000 (1.0) 14.5375 (1.18) 0.0000 (1.0) 0;0 0.0688 (0.85) 1 1 test_sharing_s3-pull[2.41.1] 14.6481 (1.19) 14.6481 (1.19) 14.6481 (1.19) 0.0000 (1.0) 14.6481 (1.19) 0.0000 (1.0) 0;0 0.0683 (0.84) 1 1 test_sharing_s3-pull[2.45.0] 12.2888 (1.0) 12.2888 (1.0) 12.2888 (1.0) 0.0000 (1.0) 12.2888 (1.0) 0.0000 (1.0) 0;0 0.0814 (1.0) 1 1 test_sharing_s3-pull[main] 12.4553 (1.01) 12.4553 (1.01) 12.4553 (1.01) 0.0000 (1.0) 12.4553 (1.01) 0.0000 (1.0) 0;0 0.0803 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.11.0] 709.5857 (1.0) 709.5857 (1.0) 709.5857 (1.0) 0.0000 (1.0) 709.5857 (1.0) 0.0000 (1.0) 0;0 1.4093 (1.0) 1 1 test_sharing_s3-pull-noop[2.18.1] 787.5495 (1.11) 787.5495 (1.11) 787.5495 (1.11) 0.0000 (1.0) 787.5495 (1.11) 0.0000 (1.0) 0;0 1.2698 (0.90) 1 1 test_sharing_s3-pull-noop[2.39.0] 783.3048 (1.10) 783.3048 (1.10) 783.3048 (1.10) 0.0000 (1.0) 783.3048 (1.10) 0.0000 (1.0) 0;0 1.2766 (0.91) 1 1 test_sharing_s3-pull-noop[2.40.0] 782.2569 (1.10) 782.2569 (1.10) 782.2569 (1.10) 0.0000 (1.0) 782.2569 (1.10) 0.0000 (1.0) 0;0 1.2784 (0.91) 1 1 test_sharing_s3-pull-noop[2.41.1] 776.2882 (1.09) 776.2882 (1.09) 776.2882 (1.09) 0.0000 (1.0) 776.2882 (1.09) 0.0000 (1.0) 0;0 1.2882 (0.91) 1 1 test_sharing_s3-pull-noop[2.45.0] 797.1638 (1.12) 797.1638 (1.12) 797.1638 (1.12) 0.0000 (1.0) 797.1638 (1.12) 0.0000 (1.0) 0;0 1.2544 (0.89) 1 1 test_sharing_s3-pull-noop[main] 890.7111 (1.26) 890.7111 (1.26) 890.7111 (1.26) 0.0000 (1.0) 890.7111 (1.26) 0.0000 (1.0) 0;0 1.1227 (0.80) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.11.0] 21.1670 (2.39) 21.1670 (2.39) 21.1670 (2.39) 0.0000 (1.0) 21.1670 (2.39) 0.0000 (1.0) 0;0 0.0472 (0.42) 1 1 test_sharing_s3-push[2.18.1] 21.6134 (2.44) 21.6134 (2.44) 21.6134 (2.44) 0.0000 (1.0) 21.6134 (2.44) 0.0000 (1.0) 0;0 0.0463 (0.41) 1 1 test_sharing_s3-push[2.39.0] 22.1431 (2.50) 22.1431 (2.50) 22.1431 (2.50) 0.0000 (1.0) 22.1431 (2.50) 0.0000 (1.0) 0;0 0.0452 (0.40) 1 1 test_sharing_s3-push[2.40.0] 22.0559 (2.49) 22.0559 (2.49) 22.0559 (2.49) 0.0000 (1.0) 22.0559 (2.49) 0.0000 (1.0) 0;0 0.0453 (0.40) 1 1 test_sharing_s3-push[2.41.1] 11.9745 (1.35) 11.9745 (1.35) 11.9745 (1.35) 0.0000 (1.0) 11.9745 (1.35) 0.0000 (1.0) 0;0 0.0835 (0.74) 1 1 test_sharing_s3-push[2.45.0] 8.8592 (1.0) 8.8592 (1.0) 8.8592 (1.0) 0.0000 (1.0) 8.8592 (1.0) 0.0000 (1.0) 0;0 0.1129 (1.0) 1 1 test_sharing_s3-push[main] 9.2732 (1.05) 9.2732 (1.05) 9.2732 (1.05) 0.0000 (1.0) 9.2732 (1.05) 0.0000 (1.0) 0;0 0.1078 (0.96) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push-noop[2.11.0] 971.9797 (1.01) 971.9797 (1.01) 971.9797 (1.01) 0.0000 (1.0) 971.9797 (1.01) 0.0000 (1.0) 0;0 1.0288 (0.99) 1 1 test_sharing_s3-push-noop[2.18.1] 959.5460 (1.0) 959.5460 (1.0) 959.5460 (1.0) 0.0000 (1.0) 959.5460 (1.0) 0.0000 (1.0) 0;0 1.0422 (1.0) 1 1 test_sharing_s3-push-noop[2.39.0] 982.3864 (1.02) 982.3864 (1.02) 982.3864 (1.02) 0.0000 (1.0) 982.3864 (1.02) 0.0000 (1.0) 0;0 1.0179 (0.98) 1 1 test_sharing_s3-push-noop[2.40.0] 977.6899 (1.02) 977.6899 (1.02) 977.6899 (1.02) 0.0000 (1.0) 977.6899 (1.02) 0.0000 (1.0) 0;0 1.0228 (0.98) 1 1 test_sharing_s3-push-noop[2.41.1] 980.6851 (1.02) 980.6851 (1.02) 980.6851 (1.02) 0.0000 (1.0) 980.6851 (1.02) 0.0000 (1.0) 0;0 1.0197 (0.98) 1 1 test_sharing_s3-push-noop[2.45.0] 969.6006 (1.01) 969.6006 (1.01) 969.6006 (1.01) 0.0000 (1.0) 969.6006 (1.01) 0.0000 (1.0) 0;0 1.0314 (0.99) 1 1 test_sharing_s3-push-noop[main] 1,073.4631 (1.12) 1,073.4631 (1.12) 1,073.4631 (1.12) 0.0000 (1.0) 1,073.4631 (1.12) 0.0000 (1.0) 0;0 0.9316 (0.89) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.11.0] 410.3371 (1.10) 410.3371 (1.10) 410.3371 (1.10) 0.0000 (1.0) 410.3371 (1.10) 0.0000 (1.0) 0;0 2.4370 (0.91) 1 1 test_list-list[2.18.1] 372.7417 (1.0) 372.7417 (1.0) 372.7417 (1.0) 0.0000 (1.0) 372.7417 (1.0) 0.0000 (1.0) 0;0 2.6828 (1.0) 1 1 test_list-list[2.39.0] 403.5977 (1.08) 403.5977 (1.08) 403.5977 (1.08) 0.0000 (1.0) 403.5977 (1.08) 0.0000 (1.0) 0;0 2.4777 (0.92) 1 1 test_list-list[2.40.0] 398.3298 (1.07) 398.3298 (1.07) 398.3298 (1.07) 0.0000 (1.0) 398.3298 (1.07) 0.0000 (1.0) 0;0 2.5105 (0.94) 1 1 test_list-list[2.41.1] 404.6876 (1.09) 404.6876 (1.09) 404.6876 (1.09) 0.0000 (1.0) 404.6876 (1.09) 0.0000 (1.0) 0;0 2.4710 (0.92) 1 1 test_list-list[2.45.0] 418.1469 (1.12) 418.1469 (1.12) 418.1469 (1.12) 0.0000 (1.0) 418.1469 (1.12) 0.0000 (1.0) 0;0 2.3915 (0.89) 1 1 test_list-list[main] 498.9276 (1.34) 498.9276 (1.34) 498.9276 (1.34) 0.0000 (1.0) 498.9276 (1.34) 0.0000 (1.0) 0;0 2.0043 (0.75) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.11.0] 400.4526 (1.11) 400.4526 (1.11) 400.4526 (1.11) 0.0000 (1.0) 400.4526 (1.11) 0.0000 (1.0) 0;0 2.4972 (0.90) 1 1 test_list-list-dvc-only[2.18.1] 360.1622 (1.0) 360.1622 (1.0) 360.1622 (1.0) 0.0000 (1.0) 360.1622 (1.0) 0.0000 (1.0) 0;0 2.7765 (1.0) 1 1 test_list-list-dvc-only[2.39.0] 389.2227 (1.08) 389.2227 (1.08) 389.2227 (1.08) 0.0000 (1.0) 389.2227 (1.08) 0.0000 (1.0) 0;0 2.5692 (0.93) 1 1 test_list-list-dvc-only[2.40.0] 385.7607 (1.07) 385.7607 (1.07) 385.7607 (1.07) 0.0000 (1.0) 385.7607 (1.07) 0.0000 (1.0) 0;0 2.5923 (0.93) 1 1 test_list-list-dvc-only[2.41.1] 392.8908 (1.09) 392.8908 (1.09) 392.8908 (1.09) 0.0000 (1.0) 392.8908 (1.09) 0.0000 (1.0) 0;0 2.5452 (0.92) 1 1 test_list-list-dvc-only[2.45.0] 400.7344 (1.11) 400.7344 (1.11) 400.7344 (1.11) 0.0000 (1.0) 400.7344 (1.11) 0.0000 (1.0) 0;0 2.4954 (0.90) 1 1 test_list-list-dvc-only[main] 493.1531 (1.37) 493.1531 (1.37) 493.1531 (1.37) 0.0000 (1.0) 493.1531 (1.37) 0.0000 (1.0) 0;0 2.0278 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.11.0] 1.6582 (3.62) 1.6582 (3.62) 1.6582 (3.62) 0.0000 (1.0) 1.6582 (3.62) 0.0000 (1.0) 0;0 0.6030 (0.28) 1 1 test_list-list-recursive[2.18.1] 2.3741 (5.18) 2.3741 (5.18) 2.3741 (5.18) 0.0000 (1.0) 2.3741 (5.18) 0.0000 (1.0) 0;0 0.4212 (0.19) 1 1 test_list-list-recursive[2.39.0] 0.7688 (1.68) 0.7688 (1.68) 0.7688 (1.68) 0.0000 (1.0) 0.7688 (1.68) 0.0000 (1.0) 0;0 1.3008 (0.60) 1 1 test_list-list-recursive[2.40.0] 0.4583 (1.00) 0.4583 (1.00) 0.4583 (1.00) 0.0000 (1.0) 0.4583 (1.00) 0.0000 (1.0) 0;0 2.1818 (1.00) 1 1 test_list-list-recursive[2.41.1] 0.4580 (1.0) 0.4580 (1.0) 0.4580 (1.0) 0.0000 (1.0) 0.4580 (1.0) 0.0000 (1.0) 0;0 2.1836 (1.0) 1 1 test_list-list-recursive[2.45.0] 0.4622 (1.01) 0.4622 (1.01) 0.4622 (1.01) 0.0000 (1.0) 0.4622 (1.01) 0.0000 (1.0) 0;0 2.1637 (0.99) 1 1 test_list-list-recursive[main] 0.5864 (1.28) 0.5864 (1.28) 0.5864 (1.28) 0.0000 (1.0) 0.5864 (1.28) 0.0000 (1.0) 0;0 1.7053 (0.78) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.11.0] 393.9676 (1.01) 393.9676 (1.01) 393.9676 (1.01) 0.0000 (1.0) 393.9676 (1.01) 0.0000 (1.0) 0;0 2.5383 (0.99) 1 1 test_list-list-shallow[2.18.1] 389.2023 (1.0) 389.2023 (1.0) 389.2023 (1.0) 0.0000 (1.0) 389.2023 (1.0) 0.0000 (1.0) 0;0 2.5694 (1.0) 1 1 test_list-list-shallow[2.39.0] 522.3154 (1.34) 522.3154 (1.34) 522.3154 (1.34) 0.0000 (1.0) 522.3154 (1.34) 0.0000 (1.0) 0;0 1.9146 (0.75) 1 1 test_list-list-shallow[2.40.0] 417.5630 (1.07) 417.5630 (1.07) 417.5630 (1.07) 0.0000 (1.0) 417.5630 (1.07) 0.0000 (1.0) 0;0 2.3948 (0.93) 1 1 test_list-list-shallow[2.41.1] 419.2905 (1.08) 419.2905 (1.08) 419.2905 (1.08) 0.0000 (1.0) 419.2905 (1.08) 0.0000 (1.0) 0;0 2.3850 (0.93) 1 1 test_list-list-shallow[2.45.0] 429.5624 (1.10) 429.5624 (1.10) 429.5624 (1.10) 0.0000 (1.0) 429.5624 (1.10) 0.0000 (1.0) 0;0 2.3280 (0.91) 1 1 test_list-list-shallow[main] 492.9630 (1.27) 492.9630 (1.27) 492.9630 (1.27) 0.0000 (1.0) 492.9630 (1.27) 0.0000 (1.0) 0;0 2.0285 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.11.0] 140.1614 (1.0) 163.3839 (1.10) 142.3767 (1.0) 2.5923 (4.65) 142.1296 (1.0) 1.1557 (1.80) 2;2 7.0236 (1.0) 100 1 test_help---help[2.18.1] 145.0724 (1.04) 148.9899 (1.00) 146.3427 (1.03) 0.5577 (1.0) 146.3265 (1.03) 0.6430 (1.0) 28;1 6.8333 (0.97) 100 1 test_help---help[2.39.0] 184.6249 (1.32) 192.3585 (1.29) 186.1892 (1.31) 0.9125 (1.64) 186.1519 (1.31) 0.8398 (1.31) 18;2 5.3709 (0.76) 100 1 test_help---help[2.40.0] 184.3167 (1.32) 187.4243 (1.26) 185.8352 (1.31) 0.7078 (1.27) 185.7872 (1.31) 1.0502 (1.63) 38;0 5.3811 (0.77) 100 1 test_help---help[2.41.1] 184.7686 (1.32) 196.3852 (1.32) 186.4322 (1.31) 1.2667 (2.27) 186.3683 (1.31) 0.8334 (1.30) 12;5 5.3639 (0.76) 100 1 test_help---help[2.45.0] 145.2850 (1.04) 148.6697 (1.0) 146.8060 (1.03) 0.6139 (1.10) 146.8279 (1.03) 0.8635 (1.34) 28;1 6.8117 (0.97) 100 1 test_help---help[main] 146.9551 (1.05) 150.8581 (1.01) 149.1740 (1.05) 0.7848 (1.41) 149.1864 (1.05) 1.1513 (1.79) 32;0 6.7036 (0.95) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.11.0] 2.1047 (1.20) 2.1047 (1.20) 2.1047 (1.20) 0.0000 (1.0) 2.1047 (1.20) 0.0000 (1.0) 0;0 0.4751 (0.83) 1 1 test_diff-diff[2.18.1] 1.7479 (1.0) 1.7479 (1.0) 1.7479 (1.0) 0.0000 (1.0) 1.7479 (1.0) 0.0000 (1.0) 0;0 0.5721 (1.0) 1 1 test_diff-diff[2.39.0] 1.8001 (1.03) 1.8001 (1.03) 1.8001 (1.03) 0.0000 (1.0) 1.8001 (1.03) 0.0000 (1.0) 0;0 0.5555 (0.97) 1 1 test_diff-diff[2.40.0] 1.8267 (1.05) 1.8267 (1.05) 1.8267 (1.05) 0.0000 (1.0) 1.8267 (1.05) 0.0000 (1.0) 0;0 0.5474 (0.96) 1 1 test_diff-diff[2.41.1] 1.8068 (1.03) 1.8068 (1.03) 1.8068 (1.03) 0.0000 (1.0) 1.8068 (1.03) 0.0000 (1.0) 0;0 0.5535 (0.97) 1 1 test_diff-diff[2.45.0] 1.7887 (1.02) 1.7887 (1.02) 1.7887 (1.02) 0.0000 (1.0) 1.7887 (1.02) 0.0000 (1.0) 0;0 0.5591 (0.98) 1 1 test_diff-diff[main] 1.7819 (1.02) 1.7819 (1.02) 1.7819 (1.02) 0.0000 (1.0) 1.7819 (1.02) 0.0000 (1.0) 0;0 0.5612 (0.98) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.11.0] 1.3979 (1.73) 1.3979 (1.73) 1.3979 (1.73) 0.0000 (1.0) 1.3979 (1.73) 0.0000 (1.0) 0;0 0.7154 (0.58) 1 1 test_diff-diff-changed[2.18.1] 0.8080 (1.0) 0.8080 (1.0) 0.8080 (1.0) 0.0000 (1.0) 0.8080 (1.0) 0.0000 (1.0) 0;0 1.2376 (1.0) 1 1 test_diff-diff-changed[2.39.0] 0.8314 (1.03) 0.8314 (1.03) 0.8314 (1.03) 0.0000 (1.0) 0.8314 (1.03) 0.0000 (1.0) 0;0 1.2028 (0.97) 1 1 test_diff-diff-changed[2.40.0] 0.8355 (1.03) 0.8355 (1.03) 0.8355 (1.03) 0.0000 (1.0) 0.8355 (1.03) 0.0000 (1.0) 0;0 1.1968 (0.97) 1 1 test_diff-diff-changed[2.41.1] 0.8250 (1.02) 0.8250 (1.02) 0.8250 (1.02) 0.0000 (1.0) 0.8250 (1.02) 0.0000 (1.0) 0;0 1.2121 (0.98) 1 1 test_diff-diff-changed[2.45.0] 0.8417 (1.04) 0.8417 (1.04) 0.8417 (1.04) 0.0000 (1.0) 0.8417 (1.04) 0.0000 (1.0) 0;0 1.1881 (0.96) 1 1 test_diff-diff-changed[main] 0.9777 (1.21) 0.9777 (1.21) 0.9777 (1.21) 0.0000 (1.0) 0.9777 (1.21) 0.0000 (1.0) 0;0 1.0229 (0.83) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.11.0] 608.2457 (1.0) 608.2457 (1.0) 608.2457 (1.0) 0.0000 (1.0) 608.2457 (1.0) 0.0000 (1.0) 0;0 1.6441 (1.0) 1 1 test_diff-diff-changed-noop[2.18.1] 815.7719 (1.34) 815.7719 (1.34) 815.7719 (1.34) 0.0000 (1.0) 815.7719 (1.34) 0.0000 (1.0) 0;0 1.2258 (0.75) 1 1 test_diff-diff-changed-noop[2.39.0] 826.4430 (1.36) 826.4430 (1.36) 826.4430 (1.36) 0.0000 (1.0) 826.4430 (1.36) 0.0000 (1.0) 0;0 1.2100 (0.74) 1 1 test_diff-diff-changed-noop[2.40.0] 846.7063 (1.39) 846.7063 (1.39) 846.7063 (1.39) 0.0000 (1.0) 846.7063 (1.39) 0.0000 (1.0) 0;0 1.1810 (0.72) 1 1 test_diff-diff-changed-noop[2.41.1] 835.1577 (1.37) 835.1577 (1.37) 835.1577 (1.37) 0.0000 (1.0) 835.1577 (1.37) 0.0000 (1.0) 0;0 1.1974 (0.73) 1 1 test_diff-diff-changed-noop[2.45.0] 878.0676 (1.44) 878.0676 (1.44) 878.0676 (1.44) 0.0000 (1.0) 878.0676 (1.44) 0.0000 (1.0) 0;0 1.1389 (0.69) 1 1 test_diff-diff-changed-noop[main] 917.4392 (1.51) 917.4392 (1.51) 917.4392 (1.51) 0.0000 (1.0) 917.4392 (1.51) 0.0000 (1.0) 0;0 1.0900 (0.66) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.11.0] 548.6878 (1.0) 548.6878 (1.0) 548.6878 (1.0) 0.0000 (1.0) 548.6878 (1.0) 0.0000 (1.0) 0;0 1.8225 (1.0) 1 1 test_diff-diff-noop[2.18.1] 729.0880 (1.33) 729.0880 (1.33) 729.0880 (1.33) 0.0000 (1.0) 729.0880 (1.33) 0.0000 (1.0) 0;0 1.3716 (0.75) 1 1 test_diff-diff-noop[2.39.0] 790.1822 (1.44) 790.1822 (1.44) 790.1822 (1.44) 0.0000 (1.0) 790.1822 (1.44) 0.0000 (1.0) 0;0 1.2655 (0.69) 1 1 test_diff-diff-noop[2.40.0] 792.5471 (1.44) 792.5471 (1.44) 792.5471 (1.44) 0.0000 (1.0) 792.5471 (1.44) 0.0000 (1.0) 0;0 1.2618 (0.69) 1 1 test_diff-diff-noop[2.41.1] 784.0274 (1.43) 784.0274 (1.43) 784.0274 (1.43) 0.0000 (1.0) 784.0274 (1.43) 0.0000 (1.0) 0;0 1.2755 (0.70) 1 1 test_diff-diff-noop[2.45.0] 816.6760 (1.49) 816.6760 (1.49) 816.6760 (1.49) 0.0000 (1.0) 816.6760 (1.49) 0.0000 (1.0) 0;0 1.2245 (0.67) 1 1 test_diff-diff-noop[main] 857.2091 (1.56) 857.2091 (1.56) 857.2091 (1.56) 0.0000 (1.0) 857.2091 (1.56) 0.0000 (1.0) 0;0 1.1666 (0.64) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add_s3-add-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-add-partial-add[2.11.0] 8.0062 (2.01) 8.0062 (2.01) 8.0062 (2.01) 0.0000 (1.0) 8.0062 (2.01) 0.0000 (1.0) 0;0 0.1249 (0.50) 1 1 test_partial_add_s3-add-partial-add[2.18.1] 6.5530 (1.65) 6.5530 (1.65) 6.5530 (1.65) 0.0000 (1.0) 6.5530 (1.65) 0.0000 (1.0) 0;0 0.1526 (0.61) 1 1 test_partial_add_s3-add-partial-add[2.39.0] 3.9785 (1.0) 3.9785 (1.0) 3.9785 (1.0) 0.0000 (1.0) 3.9785 (1.0) 0.0000 (1.0) 0;0 0.2514 (1.0) 1 1 test_partial_add_s3-add-partial-add[2.40.0] 7.3482 (1.85) 7.3482 (1.85) 7.3482 (1.85) 0.0000 (1.0) 7.3482 (1.85) 0.0000 (1.0) 0;0 0.1361 (0.54) 1 1 test_partial_add_s3-add-partial-add[2.41.1] 7.0448 (1.77) 7.0448 (1.77) 7.0448 (1.77) 0.0000 (1.0) 7.0448 (1.77) 0.0000 (1.0) 0;0 0.1419 (0.56) 1 1 test_partial_add_s3-add-partial-add[2.45.0] 4.8874 (1.23) 4.8874 (1.23) 4.8874 (1.23) 0.0000 (1.0) 4.8874 (1.23) 0.0000 (1.0) 0;0 0.2046 (0.81) 1 1 test_partial_add_s3-add-partial-add[main] 4.8794 (1.23) 4.8794 (1.23) 4.8794 (1.23) 0.0000 (1.0) 4.8794 (1.23) 0.0000 (1.0) 0;0 0.2049 (0.82) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add_s3-gc-cloud-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-gc-cloud-noop[2.11.0] 1.7256 (1.03) 1.7256 (1.03) 1.7256 (1.03) 0.0000 (1.0) 1.7256 (1.03) 0.0000 (1.0) 0;0 0.5795 (0.97) 1 1 test_partial_add_s3-gc-cloud-noop[2.18.1] 1.6755 (1.0) 1.6755 (1.0) 1.6755 (1.0) 0.0000 (1.0) 1.6755 (1.0) 0.0000 (1.0) 0;0 0.5969 (1.0) 1 1 test_partial_add_s3-gc-cloud-noop[2.39.0] 1.6907 (1.01) 1.6907 (1.01) 1.6907 (1.01) 0.0000 (1.0) 1.6907 (1.01) 0.0000 (1.0) 0;0 0.5915 (0.99) 1 1 test_partial_add_s3-gc-cloud-noop[2.40.0] 1.7533 (1.05) 1.7533 (1.05) 1.7533 (1.05) 0.0000 (1.0) 1.7533 (1.05) 0.0000 (1.0) 0;0 0.5703 (0.96) 1 1 test_partial_add_s3-gc-cloud-noop[2.41.1] 1.7084 (1.02) 1.7084 (1.02) 1.7084 (1.02) 0.0000 (1.0) 1.7084 (1.02) 0.0000 (1.0) 0;0 0.5853 (0.98) 1 1 test_partial_add_s3-gc-cloud-noop[2.45.0] 1.8102 (1.08) 1.8102 (1.08) 1.8102 (1.08) 0.0000 (1.0) 1.8102 (1.08) 0.0000 (1.0) 0;0 0.5524 (0.93) 1 1 test_partial_add_s3-gc-cloud-noop[main] 1.8173 (1.08) 1.8173 (1.08) 1.8173 (1.08) 0.0000 (1.0) 1.8173 (1.08) 0.0000 (1.0) 0;0 0.5503 (0.92) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add_s3-gc-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-gc-noop[2.11.0] 531.8492 (1.0) 531.8492 (1.0) 531.8492 (1.0) 0.0000 (1.0) 531.8492 (1.0) 0.0000 (1.0) 0;0 1.8802 (1.0) 1 1 test_partial_add_s3-gc-noop[2.18.1] 562.8992 (1.06) 562.8992 (1.06) 562.8992 (1.06) 0.0000 (1.0) 562.8992 (1.06) 0.0000 (1.0) 0;0 1.7765 (0.94) 1 1 test_partial_add_s3-gc-noop[2.39.0] 583.6856 (1.10) 583.6856 (1.10) 583.6856 (1.10) 0.0000 (1.0) 583.6856 (1.10) 0.0000 (1.0) 0;0 1.7133 (0.91) 1 1 test_partial_add_s3-gc-noop[2.40.0] 606.7217 (1.14) 606.7217 (1.14) 606.7217 (1.14) 0.0000 (1.0) 606.7217 (1.14) 0.0000 (1.0) 0;0 1.6482 (0.88) 1 1 test_partial_add_s3-gc-noop[2.41.1] 678.3369 (1.28) 678.3369 (1.28) 678.3369 (1.28) 0.0000 (1.0) 678.3369 (1.28) 0.0000 (1.0) 0;0 1.4742 (0.78) 1 1 test_partial_add_s3-gc-noop[2.45.0] 618.9077 (1.16) 618.9077 (1.16) 618.9077 (1.16) 0.0000 (1.0) 618.9077 (1.16) 0.0000 (1.0) 0;0 1.6157 (0.86) 1 1 test_partial_add_s3-gc-noop[main] 692.5555 (1.30) 692.5555 (1.30) 692.5555 (1.30) 0.0000 (1.0) 692.5555 (1.30) 0.0000 (1.0) 0;0 1.4439 (0.77) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_partial_add_s3-push-partial-add': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-push-partial-add[2.11.0] 13.9122 (11.45) 13.9122 (11.45) 13.9122 (11.45) 0.0000 (1.0) 13.9122 (11.45) 0.0000 (1.0) 0;0 0.0719 (0.09) 1 1 test_partial_add_s3-push-partial-add[2.18.1] 12.5503 (10.33) 12.5503 (10.33) 12.5503 (10.33) 0.0000 (1.0) 12.5503 (10.33) 0.0000 (1.0) 0;0 0.0797 (0.10) 1 1 test_partial_add_s3-push-partial-add[2.39.0] 1.2148 (1.0) 1.2148 (1.0) 1.2148 (1.0) 0.0000 (1.0) 1.2148 (1.0) 0.0000 (1.0) 0;0 0.8232 (1.0) 1 1 test_partial_add_s3-push-partial-add[2.40.0] 28.5823 (23.53) 28.5823 (23.53) 28.5823 (23.53) 0.0000 (1.0) 28.5823 (23.53) 0.0000 (1.0) 0;0 0.0350 (0.04) 1 1 test_partial_add_s3-push-partial-add[2.41.1] 14.3843 (11.84) 14.3843 (11.84) 14.3843 (11.84) 0.0000 (1.0) 14.3843 (11.84) 0.0000 (1.0) 0;0 0.0695 (0.08) 1 1 test_partial_add_s3-push-partial-add[2.45.0] 11.6031 (9.55) 11.6031 (9.55) 11.6031 (9.55) 0.0000 (1.0) 11.6031 (9.55) 0.0000 (1.0) 0;0 0.0862 (0.10) 1 1 test_partial_add_s3-push-partial-add[main] 11.2022 (9.22) 11.2022 (9.22) 11.2022 (9.22) 0.0000 (1.0) 11.2022 (9.22) 0.0000 (1.0) 0;0 0.0893 (0.11) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove_s3-add': 14 tests ----------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-add[2.11.0] 3.6043 (5.44) 3.6043 (5.44) 3.6043 (5.44) 0.0000 (1.0) 3.6043 (5.44) 0.0000 (1.0) 0;0 0.2774 (0.18) 1 1 test_partial_remove_s3-add[2.11.0] 3.7033 (5.59) 3.7033 (5.59) 3.7033 (5.59) 0.0000 (1.0) 3.7033 (5.59) 0.0000 (1.0) 0;0 0.2700 (0.18) 1 1 test_partial_remove_s3-add[2.18.1] 3.0224 (4.56) 3.0224 (4.56) 3.0224 (4.56) 0.0000 (1.0) 3.0224 (4.56) 0.0000 (1.0) 0;0 0.3309 (0.22) 1 1 test_partial_remove_s3-add[2.18.1] 0.6621 (1.0) 0.6621 (1.0) 0.6621 (1.0) 0.0000 (1.0) 0.6621 (1.0) 0.0000 (1.0) 0;0 1.5103 (1.0) 1 1 test_partial_remove_s3-add[2.39.0] 0.6813 (1.03) 0.6813 (1.03) 0.6813 (1.03) 0.0000 (1.0) 0.6813 (1.03) 0.0000 (1.0) 0;0 1.4678 (0.97) 1 1 test_partial_remove_s3-add[2.39.0] 0.6807 (1.03) 0.6807 (1.03) 0.6807 (1.03) 0.0000 (1.0) 0.6807 (1.03) 0.0000 (1.0) 0;0 1.4692 (0.97) 1 1 test_partial_remove_s3-add[2.40.0] 3.9910 (6.03) 3.9910 (6.03) 3.9910 (6.03) 0.0000 (1.0) 3.9910 (6.03) 0.0000 (1.0) 0;0 0.2506 (0.17) 1 1 test_partial_remove_s3-add[2.40.0] 2.3998 (3.62) 2.3998 (3.62) 2.3998 (3.62) 0.0000 (1.0) 2.3998 (3.62) 0.0000 (1.0) 0;0 0.4167 (0.28) 1 1 test_partial_remove_s3-add[2.41.1] 3.8920 (5.88) 3.8920 (5.88) 3.8920 (5.88) 0.0000 (1.0) 3.8920 (5.88) 0.0000 (1.0) 0;0 0.2569 (0.17) 1 1 test_partial_remove_s3-add[2.41.1] 2.3064 (3.48) 2.3064 (3.48) 2.3064 (3.48) 0.0000 (1.0) 2.3064 (3.48) 0.0000 (1.0) 0;0 0.4336 (0.29) 1 1 test_partial_remove_s3-add[2.45.0] 2.3971 (3.62) 2.3971 (3.62) 2.3971 (3.62) 0.0000 (1.0) 2.3971 (3.62) 0.0000 (1.0) 0;0 0.4172 (0.28) 1 1 test_partial_remove_s3-add[2.45.0] 2.3219 (3.51) 2.3219 (3.51) 2.3219 (3.51) 0.0000 (1.0) 2.3219 (3.51) 0.0000 (1.0) 0;0 0.4307 (0.29) 1 1 test_partial_remove_s3-add[main] 0.7745 (1.17) 0.7745 (1.17) 0.7745 (1.17) 0.0000 (1.0) 0.7745 (1.17) 0.0000 (1.0) 0;0 1.2911 (0.85) 1 1 test_partial_remove_s3-add[main] 0.8088 (1.22) 0.8088 (1.22) 0.8088 (1.22) 0.0000 (1.0) 0.8088 (1.22) 0.0000 (1.0) 0;0 1.2363 (0.82) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-gc': 14 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-gc[2.11.0] 540.4861 (1.0) 540.4861 (1.0) 540.4861 (1.0) 0.0000 (1.0) 540.4861 (1.0) 0.0000 (1.0) 0;0 1.8502 (1.0) 1 1 test_partial_remove_s3-gc[2.11.0] 546.8913 (1.01) 546.8913 (1.01) 546.8913 (1.01) 0.0000 (1.0) 546.8913 (1.01) 0.0000 (1.0) 0;0 1.8285 (0.99) 1 1 test_partial_remove_s3-gc[2.18.1] 558.3484 (1.03) 558.3484 (1.03) 558.3484 (1.03) 0.0000 (1.0) 558.3484 (1.03) 0.0000 (1.0) 0;0 1.7910 (0.97) 1 1 test_partial_remove_s3-gc[2.18.1] 588.5528 (1.09) 588.5528 (1.09) 588.5528 (1.09) 0.0000 (1.0) 588.5528 (1.09) 0.0000 (1.0) 0;0 1.6991 (0.92) 1 1 test_partial_remove_s3-gc[2.39.0] 614.1327 (1.14) 614.1327 (1.14) 614.1327 (1.14) 0.0000 (1.0) 614.1327 (1.14) 0.0000 (1.0) 0;0 1.6283 (0.88) 1 1 test_partial_remove_s3-gc[2.39.0] 632.3981 (1.17) 632.3981 (1.17) 632.3981 (1.17) 0.0000 (1.0) 632.3981 (1.17) 0.0000 (1.0) 0;0 1.5813 (0.85) 1 1 test_partial_remove_s3-gc[2.40.0] 591.1294 (1.09) 591.1294 (1.09) 591.1294 (1.09) 0.0000 (1.0) 591.1294 (1.09) 0.0000 (1.0) 0;0 1.6917 (0.91) 1 1 test_partial_remove_s3-gc[2.40.0] 608.3343 (1.13) 608.3343 (1.13) 608.3343 (1.13) 0.0000 (1.0) 608.3343 (1.13) 0.0000 (1.0) 0;0 1.6438 (0.89) 1 1 test_partial_remove_s3-gc[2.41.1] 579.4791 (1.07) 579.4791 (1.07) 579.4791 (1.07) 0.0000 (1.0) 579.4791 (1.07) 0.0000 (1.0) 0;0 1.7257 (0.93) 1 1 test_partial_remove_s3-gc[2.41.1] 654.4171 (1.21) 654.4171 (1.21) 654.4171 (1.21) 0.0000 (1.0) 654.4171 (1.21) 0.0000 (1.0) 0;0 1.5281 (0.83) 1 1 test_partial_remove_s3-gc[2.45.0] 618.7999 (1.14) 618.7999 (1.14) 618.7999 (1.14) 0.0000 (1.0) 618.7999 (1.14) 0.0000 (1.0) 0;0 1.6160 (0.87) 1 1 test_partial_remove_s3-gc[2.45.0] 598.2829 (1.11) 598.2829 (1.11) 598.2829 (1.11) 0.0000 (1.0) 598.2829 (1.11) 0.0000 (1.0) 0;0 1.6715 (0.90) 1 1 test_partial_remove_s3-gc[main] 729.0323 (1.35) 729.0323 (1.35) 729.0323 (1.35) 0.0000 (1.0) 729.0323 (1.35) 0.0000 (1.0) 0;0 1.3717 (0.74) 1 1 test_partial_remove_s3-gc[main] 689.4565 (1.28) 689.4565 (1.28) 689.4565 (1.28) 0.0000 (1.0) 689.4565 (1.28) 0.0000 (1.0) 0;0 1.4504 (0.78) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-gc-cloud': 14 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-gc-cloud[2.11.0] 18.4745 (11.12) 18.4745 (11.12) 18.4745 (11.12) 0.0000 (1.0) 18.4745 (11.12) 0.0000 (1.0) 0;0 0.0541 (0.09) 1 1 test_partial_remove_s3-gc-cloud[2.11.0] 20.6747 (12.44) 20.6747 (12.44) 20.6747 (12.44) 0.0000 (1.0) 20.6747 (12.44) 0.0000 (1.0) 0;0 0.0484 (0.08) 1 1 test_partial_remove_s3-gc-cloud[2.18.1] 17.8741 (10.76) 17.8741 (10.76) 17.8741 (10.76) 0.0000 (1.0) 17.8741 (10.76) 0.0000 (1.0) 0;0 0.0559 (0.09) 1 1 test_partial_remove_s3-gc-cloud[2.18.1] 35.9252 (21.62) 35.9252 (21.62) 35.9252 (21.62) 0.0000 (1.0) 35.9252 (21.62) 0.0000 (1.0) 0;0 0.0278 (0.05) 1 1 test_partial_remove_s3-gc-cloud[2.39.0] 33.7637 (20.32) 33.7637 (20.32) 33.7637 (20.32) 0.0000 (1.0) 33.7637 (20.32) 0.0000 (1.0) 0;0 0.0296 (0.05) 1 1 test_partial_remove_s3-gc-cloud[2.39.0] 33.8310 (20.36) 33.8310 (20.36) 33.8310 (20.36) 0.0000 (1.0) 33.8310 (20.36) 0.0000 (1.0) 0;0 0.0296 (0.05) 1 1 test_partial_remove_s3-gc-cloud[2.40.0] 1.8962 (1.14) 1.8962 (1.14) 1.8962 (1.14) 0.0000 (1.0) 1.8962 (1.14) 0.0000 (1.0) 0;0 0.5274 (0.88) 1 1 test_partial_remove_s3-gc-cloud[2.40.0] 17.9240 (10.79) 17.9240 (10.79) 17.9240 (10.79) 0.0000 (1.0) 17.9240 (10.79) 0.0000 (1.0) 0;0 0.0558 (0.09) 1 1 test_partial_remove_s3-gc-cloud[2.41.1] 1.6614 (1.0) 1.6614 (1.0) 1.6614 (1.0) 0.0000 (1.0) 1.6614 (1.0) 0.0000 (1.0) 0;0 0.6019 (1.0) 1 1 test_partial_remove_s3-gc-cloud[2.41.1] 18.6679 (11.24) 18.6679 (11.24) 18.6679 (11.24) 0.0000 (1.0) 18.6679 (11.24) 0.0000 (1.0) 0;0 0.0536 (0.09) 1 1 test_partial_remove_s3-gc-cloud[2.45.0] 1.8559 (1.12) 1.8559 (1.12) 1.8559 (1.12) 0.0000 (1.0) 1.8559 (1.12) 0.0000 (1.0) 0;0 0.5388 (0.90) 1 1 test_partial_remove_s3-gc-cloud[2.45.0] 1.7540 (1.06) 1.7540 (1.06) 1.7540 (1.06) 0.0000 (1.0) 1.7540 (1.06) 0.0000 (1.0) 0;0 0.5701 (0.95) 1 1 test_partial_remove_s3-gc-cloud[main] 2.0290 (1.22) 2.0290 (1.22) 2.0290 (1.22) 0.0000 (1.0) 2.0290 (1.22) 0.0000 (1.0) 0;0 0.4928 (0.82) 1 1 test_partial_remove_s3-gc-cloud[main] 1.9734 (1.19) 1.9734 (1.19) 1.9734 (1.19) 0.0000 (1.0) 1.9734 (1.19) 0.0000 (1.0) 0;0 0.5068 (0.84) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------- benchmark 'test_partial_remove_s3-push': 14 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-push[2.11.0] 1.7582 (1.54) 1.7582 (1.54) 1.7582 (1.54) 0.0000 (1.0) 1.7582 (1.54) 0.0000 (1.0) 0;0 0.5688 (0.65) 1 1 test_partial_remove_s3-push[2.11.0] 1.6810 (1.47) 1.6810 (1.47) 1.6810 (1.47) 0.0000 (1.0) 1.6810 (1.47) 0.0000 (1.0) 0;0 0.5949 (0.68) 1 1 test_partial_remove_s3-push[2.18.1] 1.7146 (1.50) 1.7146 (1.50) 1.7146 (1.50) 0.0000 (1.0) 1.7146 (1.50) 0.0000 (1.0) 0;0 0.5832 (0.67) 1 1 test_partial_remove_s3-push[2.18.1] 1.1451 (1.0) 1.1451 (1.0) 1.1451 (1.0) 0.0000 (1.0) 1.1451 (1.0) 0.0000 (1.0) 0;0 0.8733 (1.0) 1 1 test_partial_remove_s3-push[2.39.0] 1.1849 (1.03) 1.1849 (1.03) 1.1849 (1.03) 0.0000 (1.0) 1.1849 (1.03) 0.0000 (1.0) 0;0 0.8439 (0.97) 1 1 test_partial_remove_s3-push[2.39.0] 1.1703 (1.02) 1.1703 (1.02) 1.1703 (1.02) 0.0000 (1.0) 1.1703 (1.02) 0.0000 (1.0) 0;0 0.8545 (0.98) 1 1 test_partial_remove_s3-push[2.40.0] 1.2484 (1.09) 1.2484 (1.09) 1.2484 (1.09) 0.0000 (1.0) 1.2484 (1.09) 0.0000 (1.0) 0;0 0.8010 (0.92) 1 1 test_partial_remove_s3-push[2.40.0] 1.6920 (1.48) 1.6920 (1.48) 1.6920 (1.48) 0.0000 (1.0) 1.6920 (1.48) 0.0000 (1.0) 0;0 0.5910 (0.68) 1 1 test_partial_remove_s3-push[2.41.1] 1.3758 (1.20) 1.3758 (1.20) 1.3758 (1.20) 0.0000 (1.0) 1.3758 (1.20) 0.0000 (1.0) 0;0 0.7268 (0.83) 1 1 test_partial_remove_s3-push[2.41.1] 1.7060 (1.49) 1.7060 (1.49) 1.7060 (1.49) 0.0000 (1.0) 1.7060 (1.49) 0.0000 (1.0) 0;0 0.5862 (0.67) 1 1 test_partial_remove_s3-push[2.45.0] 1.7209 (1.50) 1.7209 (1.50) 1.7209 (1.50) 0.0000 (1.0) 1.7209 (1.50) 0.0000 (1.0) 0;0 0.5811 (0.67) 1 1 test_partial_remove_s3-push[2.45.0] 1.6684 (1.46) 1.6684 (1.46) 1.6684 (1.46) 0.0000 (1.0) 1.6684 (1.46) 0.0000 (1.0) 0;0 0.5994 (0.69) 1 1 test_partial_remove_s3-push[main] 1.3408 (1.17) 1.3408 (1.17) 1.3408 (1.17) 0.0000 (1.0) 1.3408 (1.17) 0.0000 (1.0) 0;0 0.7458 (0.85) 1 1 test_partial_remove_s3-push[main] 1.3190 (1.15) 1.3190 (1.15) 1.3190 (1.15) 0.0000 (1.0) 1.3190 (1.15) 0.0000 (1.0) 0;0 0.7581 (0.87) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.11.0] 9.0785 (1.95) 9.0785 (1.95) 9.0785 (1.95) 0.0000 (1.0) 9.0785 (1.95) 0.0000 (1.0) 0;0 0.1102 (0.51) 1 1 test_sharing_s3-add[2.18.1] 7.8753 (1.69) 7.8753 (1.69) 7.8753 (1.69) 0.0000 (1.0) 7.8753 (1.69) 0.0000 (1.0) 0;0 0.1270 (0.59) 1 1 test_sharing_s3-add[2.39.0] 7.1103 (1.53) 7.1103 (1.53) 7.1103 (1.53) 0.0000 (1.0) 7.1103 (1.53) 0.0000 (1.0) 0;0 0.1406 (0.66) 1 1 test_sharing_s3-add[2.40.0] 7.2716 (1.56) 7.2716 (1.56) 7.2716 (1.56) 0.0000 (1.0) 7.2716 (1.56) 0.0000 (1.0) 0;0 0.1375 (0.64) 1 1 test_sharing_s3-add[2.41.1] 7.0106 (1.50) 7.0106 (1.50) 7.0106 (1.50) 0.0000 (1.0) 7.0106 (1.50) 0.0000 (1.0) 0;0 0.1426 (0.67) 1 1 test_sharing_s3-add[2.45.0] 4.6625 (1.0) 4.6625 (1.0) 4.6625 (1.0) 0.0000 (1.0) 4.6625 (1.0) 0.0000 (1.0) 0;0 0.2145 (1.0) 1 1 test_sharing_s3-add[main] 4.8716 (1.04) 4.8716 (1.04) 4.8716 (1.04) 0.0000 (1.0) 4.8716 (1.04) 0.0000 (1.0) 0;0 0.2053 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.11.0] 4.1634 (1.42) 4.1634 (1.42) 4.1634 (1.42) 0.0000 (1.0) 4.1634 (1.42) 0.0000 (1.0) 0;0 0.2402 (0.71) 1 1 test_sharing_s3-add-noop[2.18.1] 4.4123 (1.50) 4.4123 (1.50) 4.4123 (1.50) 0.0000 (1.0) 4.4123 (1.50) 0.0000 (1.0) 0;0 0.2266 (0.67) 1 1 test_sharing_s3-add-noop[2.39.0] 2.9387 (1.0) 2.9387 (1.0) 2.9387 (1.0) 0.0000 (1.0) 2.9387 (1.0) 0.0000 (1.0) 0;0 0.3403 (1.0) 1 1 test_sharing_s3-add-noop[2.40.0] 3.0245 (1.03) 3.0245 (1.03) 3.0245 (1.03) 0.0000 (1.0) 3.0245 (1.03) 0.0000 (1.0) 0;0 0.3306 (0.97) 1 1 test_sharing_s3-add-noop[2.41.1] 2.9494 (1.00) 2.9494 (1.00) 2.9494 (1.00) 0.0000 (1.0) 2.9494 (1.00) 0.0000 (1.0) 0;0 0.3390 (1.00) 1 1 test_sharing_s3-add-noop[2.45.0] 3.0425 (1.04) 3.0425 (1.04) 3.0425 (1.04) 0.0000 (1.0) 3.0425 (1.04) 0.0000 (1.0) 0;0 0.3287 (0.97) 1 1 test_sharing_s3-add-noop[main] 3.0706 (1.04) 3.0706 (1.04) 3.0706 (1.04) 0.0000 (1.0) 3.0706 (1.04) 0.0000 (1.0) 0;0 0.3257 (0.96) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.11.0] 609.0455 (1.0) 609.0455 (1.0) 609.0455 (1.0) 0.0000 (1.0) 609.0455 (1.0) 0.0000 (1.0) 0;0 1.6419 (1.0) 1 1 test_sharing_s3-checkout-noop[2.18.1] 701.3387 (1.15) 701.3387 (1.15) 701.3387 (1.15) 0.0000 (1.0) 701.3387 (1.15) 0.0000 (1.0) 0;0 1.4258 (0.87) 1 1 test_sharing_s3-checkout-noop[2.39.0] 725.2909 (1.19) 725.2909 (1.19) 725.2909 (1.19) 0.0000 (1.0) 725.2909 (1.19) 0.0000 (1.0) 0;0 1.3788 (0.84) 1 1 test_sharing_s3-checkout-noop[2.40.0] 705.6414 (1.16) 705.6414 (1.16) 705.6414 (1.16) 0.0000 (1.0) 705.6414 (1.16) 0.0000 (1.0) 0;0 1.4172 (0.86) 1 1 test_sharing_s3-checkout-noop[2.41.1] 708.5673 (1.16) 708.5673 (1.16) 708.5673 (1.16) 0.0000 (1.0) 708.5673 (1.16) 0.0000 (1.0) 0;0 1.4113 (0.86) 1 1 test_sharing_s3-checkout-noop[2.45.0] 747.4496 (1.23) 747.4496 (1.23) 747.4496 (1.23) 0.0000 (1.0) 747.4496 (1.23) 0.0000 (1.0) 0;0 1.3379 (0.81) 1 1 test_sharing_s3-checkout-noop[main] 821.1991 (1.35) 821.1991 (1.35) 821.1991 (1.35) 0.0000 (1.0) 821.1991 (1.35) 0.0000 (1.0) 0;0 1.2177 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.11.0] 18.7199 (1.22) 18.7199 (1.22) 18.7199 (1.22) 0.0000 (1.0) 18.7199 (1.22) 0.0000 (1.0) 0;0 0.0534 (0.82) 1 1 test_sharing_s3-pull[2.18.1] 18.7008 (1.22) 18.7008 (1.22) 18.7008 (1.22) 0.0000 (1.0) 18.7008 (1.22) 0.0000 (1.0) 0;0 0.0535 (0.82) 1 1 test_sharing_s3-pull[2.39.0] 19.2712 (1.26) 19.2712 (1.26) 19.2712 (1.26) 0.0000 (1.0) 19.2712 (1.26) 0.0000 (1.0) 0;0 0.0519 (0.80) 1 1 test_sharing_s3-pull[2.40.0] 19.1846 (1.25) 19.1846 (1.25) 19.1846 (1.25) 0.0000 (1.0) 19.1846 (1.25) 0.0000 (1.0) 0;0 0.0521 (0.80) 1 1 test_sharing_s3-pull[2.41.1] 18.3912 (1.20) 18.3912 (1.20) 18.3912 (1.20) 0.0000 (1.0) 18.3912 (1.20) 0.0000 (1.0) 0;0 0.0544 (0.83) 1 1 test_sharing_s3-pull[2.45.0] 15.3325 (1.0) 15.3325 (1.0) 15.3325 (1.0) 0.0000 (1.0) 15.3325 (1.0) 0.0000 (1.0) 0;0 0.0652 (1.0) 1 1 test_sharing_s3-pull[main] 15.8364 (1.03) 15.8364 (1.03) 15.8364 (1.03) 0.0000 (1.0) 15.8364 (1.03) 0.0000 (1.0) 0;0 0.0631 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.11.0] 930.9976 (1.0) 930.9976 (1.0) 930.9976 (1.0) 0.0000 (1.0) 930.9976 (1.0) 0.0000 (1.0) 0;0 1.0741 (1.0) 1 1 test_sharing_s3-pull-noop[2.18.1] 982.9124 (1.06) 982.9124 (1.06) 982.9124 (1.06) 0.0000 (1.0) 982.9124 (1.06) 0.0000 (1.0) 0;0 1.0174 (0.95) 1 1 test_sharing_s3-pull-noop[2.39.0] 988.5243 (1.06) 988.5243 (1.06) 988.5243 (1.06) 0.0000 (1.0) 988.5243 (1.06) 0.0000 (1.0) 0;0 1.0116 (0.94) 1 1 test_sharing_s3-pull-noop[2.40.0] 1,001.4490 (1.08) 1,001.4490 (1.08) 1,001.4490 (1.08) 0.0000 (1.0) 1,001.4490 (1.08) 0.0000 (1.0) 0;0 0.9986 (0.93) 1 1 test_sharing_s3-pull-noop[2.41.1] 995.5063 (1.07) 995.5063 (1.07) 995.5063 (1.07) 0.0000 (1.0) 995.5063 (1.07) 0.0000 (1.0) 0;0 1.0045 (0.94) 1 1 test_sharing_s3-pull-noop[2.45.0] 1,045.1515 (1.12) 1,045.1515 (1.12) 1,045.1515 (1.12) 0.0000 (1.0) 1,045.1515 (1.12) 0.0000 (1.0) 0;0 0.9568 (0.89) 1 1 test_sharing_s3-pull-noop[main] 1,143.2093 (1.23) 1,143.2093 (1.23) 1,143.2093 (1.23) 0.0000 (1.0) 1,143.2093 (1.23) 0.0000 (1.0) 0;0 0.8747 (0.81) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.11.0] 26.9057 (2.34) 26.9057 (2.34) 26.9057 (2.34) 0.0000 (1.0) 26.9057 (2.34) 0.0000 (1.0) 0;0 0.0372 (0.43) 1 1 test_sharing_s3-push[2.18.1] 28.4545 (2.48) 28.4545 (2.48) 28.4545 (2.48) 0.0000 (1.0) 28.4545 (2.48) 0.0000 (1.0) 0;0 0.0351 (0.40) 1 1 test_sharing_s3-push[2.39.0] 28.9396 (2.52) 28.9396 (2.52) 28.9396 (2.52) 0.0000 (1.0) 28.9396 (2.52) 0.0000 (1.0) 0;0 0.0346 (0.40) 1 1 test_sharing_s3-push[2.40.0] 28.9429 (2.52) 28.9429 (2.52) 28.9429 (2.52) 0.0000 (1.0) 28.9429 (2.52) 0.0000 (1.0) 0;0 0.0346 (0.40) 1 1 test_sharing_s3-push[2.41.1] 14.2388 (1.24) 14.2388 (1.24) 14.2388 (1.24) 0.0000 (1.0) 14.2388 (1.24) 0.0000 (1.0) 0;0 0.0702 (0.81) 1 1 test_sharing_s3-push[2.45.0] 11.4842 (1.0) 11.4842 (1.0) 11.4842 (1.0) 0.0000 (1.0) 11.4842 (1.0) 0.0000 (1.0) 0;0 0.0871 (1.0) 1 1 test_sharing_s3-push[main] 11.6355 (1.01) 11.6355 (1.01) 11.6355 (1.01) 0.0000 (1.0) 11.6355 (1.01) 0.0000 (1.0) 0;0 0.0859 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-push-noop[2.11.0] 1.1695 (1.01) 1.1695 (1.01) 1.1695 (1.01) 0.0000 (1.0) 1.1695 (1.01) 0.0000 (1.0) 0;0 0.8550 (0.99) 1 1 test_sharing_s3-push-noop[2.18.1] 1.1602 (1.0) 1.1602 (1.0) 1.1602 (1.0) 0.0000 (1.0) 1.1602 (1.0) 0.0000 (1.0) 0;0 0.8619 (1.0) 1 1 test_sharing_s3-push-noop[2.39.0] 1.2097 (1.04) 1.2097 (1.04) 1.2097 (1.04) 0.0000 (1.0) 1.2097 (1.04) 0.0000 (1.0) 0;0 0.8267 (0.96) 1 1 test_sharing_s3-push-noop[2.40.0] 1.2588 (1.08) 1.2588 (1.08) 1.2588 (1.08) 0.0000 (1.0) 1.2588 (1.08) 0.0000 (1.0) 0;0 0.7944 (0.92) 1 1 test_sharing_s3-push-noop[2.41.1] 1.2032 (1.04) 1.2032 (1.04) 1.2032 (1.04) 0.0000 (1.0) 1.2032 (1.04) 0.0000 (1.0) 0;0 0.8311 (0.96) 1 1 test_sharing_s3-push-noop[2.45.0] 1.1822 (1.02) 1.1822 (1.02) 1.1822 (1.02) 0.0000 (1.0) 1.1822 (1.02) 0.0000 (1.0) 0;0 0.8459 (0.98) 1 1 test_sharing_s3-push-noop[main] 1.3941 (1.20) 1.3941 (1.20) 1.3941 (1.20) 0.0000 (1.0) 1.3941 (1.20) 0.0000 (1.0) 0;0 0.7173 (0.83) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.11.0] 3.7782 (1.01) 3.7782 (1.01) 3.7782 (1.01) 0.0000 (1.0) 3.7782 (1.01) 0.0000 (1.0) 0;0 0.2647 (0.99) 1 1 test_checkout_copy-checkout[2.18.1] 3.7465 (1.0) 3.7465 (1.0) 3.7465 (1.0) 0.0000 (1.0) 3.7465 (1.0) 0.0000 (1.0) 0;0 0.2669 (1.0) 1 1 test_checkout_copy-checkout[2.39.0] 3.8679 (1.03) 3.8679 (1.03) 3.8679 (1.03) 0.0000 (1.0) 3.8679 (1.03) 0.0000 (1.0) 0;0 0.2585 (0.97) 1 1 test_checkout_copy-checkout[2.40.0] 3.9551 (1.06) 3.9551 (1.06) 3.9551 (1.06) 0.0000 (1.0) 3.9551 (1.06) 0.0000 (1.0) 0;0 0.2528 (0.95) 1 1 test_checkout_copy-checkout[2.41.1] 3.8770 (1.03) 3.8770 (1.03) 3.8770 (1.03) 0.0000 (1.0) 3.8770 (1.03) 0.0000 (1.0) 0;0 0.2579 (0.97) 1 1 test_checkout_copy-checkout[2.45.0] 4.1483 (1.11) 4.1483 (1.11) 4.1483 (1.11) 0.0000 (1.0) 4.1483 (1.11) 0.0000 (1.0) 0;0 0.2411 (0.90) 1 1 test_checkout_copy-checkout[main] 4.1938 (1.12) 4.1938 (1.12) 4.1938 (1.12) 0.0000 (1.0) 4.1938 (1.12) 0.0000 (1.0) 0;0 0.2384 (0.89) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.11.0] 584.9633 (1.0) 584.9633 (1.0) 584.9633 (1.0) 0.0000 (1.0) 584.9633 (1.0) 0.0000 (1.0) 0;0 1.7095 (1.0) 1 1 test_checkout_copy-checkout-noop[2.18.1] 677.5603 (1.16) 677.5603 (1.16) 677.5603 (1.16) 0.0000 (1.0) 677.5603 (1.16) 0.0000 (1.0) 0;0 1.4759 (0.86) 1 1 test_checkout_copy-checkout-noop[2.39.0] 714.8585 (1.22) 714.8585 (1.22) 714.8585 (1.22) 0.0000 (1.0) 714.8585 (1.22) 0.0000 (1.0) 0;0 1.3989 (0.82) 1 1 test_checkout_copy-checkout-noop[2.40.0] 755.7092 (1.29) 755.7092 (1.29) 755.7092 (1.29) 0.0000 (1.0) 755.7092 (1.29) 0.0000 (1.0) 0;0 1.3233 (0.77) 1 1 test_checkout_copy-checkout-noop[2.41.1] 683.6639 (1.17) 683.6639 (1.17) 683.6639 (1.17) 0.0000 (1.0) 683.6639 (1.17) 0.0000 (1.0) 0;0 1.4627 (0.86) 1 1 test_checkout_copy-checkout-noop[2.45.0] 723.6421 (1.24) 723.6421 (1.24) 723.6421 (1.24) 0.0000 (1.0) 723.6421 (1.24) 0.0000 (1.0) 0;0 1.3819 (0.81) 1 1 test_checkout_copy-checkout-noop[main] 806.7107 (1.38) 806.7107 (1.38) 806.7107 (1.38) 0.0000 (1.0) 806.7107 (1.38) 0.0000 (1.0) 0;0 1.2396 (0.73) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.11.0] 1.5611 (2.04) 1.5611 (2.04) 1.5611 (2.04) 0.0000 (1.0) 1.5611 (2.04) 0.0000 (1.0) 0;0 0.6406 (0.49) 1 1 test_checkout_copy-checkout-update[2.18.1] 0.7639 (1.0) 0.7639 (1.0) 0.7639 (1.0) 0.0000 (1.0) 0.7639 (1.0) 0.0000 (1.0) 0;0 1.3090 (1.0) 1 1 test_checkout_copy-checkout-update[2.39.0] 0.7715 (1.01) 0.7715 (1.01) 0.7715 (1.01) 0.0000 (1.0) 0.7715 (1.01) 0.0000 (1.0) 0;0 1.2961 (0.99) 1 1 test_checkout_copy-checkout-update[2.40.0] 0.8303 (1.09) 0.8303 (1.09) 0.8303 (1.09) 0.0000 (1.0) 0.8303 (1.09) 0.0000 (1.0) 0;0 1.2043 (0.92) 1 1 test_checkout_copy-checkout-update[2.41.1] 0.7808 (1.02) 0.7808 (1.02) 0.7808 (1.02) 0.0000 (1.0) 0.7808 (1.02) 0.0000 (1.0) 0;0 1.2807 (0.98) 1 1 test_checkout_copy-checkout-update[2.45.0] 0.8437 (1.10) 0.8437 (1.10) 0.8437 (1.10) 0.0000 (1.0) 0.8437 (1.10) 0.0000 (1.0) 0;0 1.1853 (0.91) 1 1 test_checkout_copy-checkout-update[main] 0.8762 (1.15) 0.8762 (1.15) 0.8762 (1.15) 0.0000 (1.0) 0.8762 (1.15) 0.0000 (1.0) 0;0 1.1413 (0.87) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.11.0] 16.7832 (1.45) 16.7832 (1.45) 16.7832 (1.45) 0.0000 (1.0) 16.7832 (1.45) 0.0000 (1.0) 0;0 0.0596 (0.69) 1 1 test_import-import[2.18.1] 16.0937 (1.39) 16.0937 (1.39) 16.0937 (1.39) 0.0000 (1.0) 16.0937 (1.39) 0.0000 (1.0) 0;0 0.0621 (0.72) 1 1 test_import-import[2.39.0] 14.0720 (1.21) 14.0720 (1.21) 14.0720 (1.21) 0.0000 (1.0) 14.0720 (1.21) 0.0000 (1.0) 0;0 0.0711 (0.83) 1 1 test_import-import[2.40.0] 14.4543 (1.24) 14.4543 (1.24) 14.4543 (1.24) 0.0000 (1.0) 14.4543 (1.24) 0.0000 (1.0) 0;0 0.0692 (0.80) 1 1 test_import-import[2.41.1] 14.3507 (1.24) 14.3507 (1.24) 14.3507 (1.24) 0.0000 (1.0) 14.3507 (1.24) 0.0000 (1.0) 0;0 0.0697 (0.81) 1 1 test_import-import[2.45.0] 11.6120 (1.0) 11.6120 (1.0) 11.6120 (1.0) 0.0000 (1.0) 11.6120 (1.0) 0.0000 (1.0) 0;0 0.0861 (1.0) 1 1 test_import-import[main] 12.2903 (1.06) 12.2903 (1.06) 12.2903 (1.06) 0.0000 (1.0) 12.2903 (1.06) 0.0000 (1.0) 0;0 0.0814 (0.94) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.11.0] 2.9070 (5.11) 2.9070 (5.11) 2.9070 (5.11) 0.0000 (1.0) 2.9070 (5.11) 0.0000 (1.0) 0;0 0.3440 (0.20) 1 1 test_partial_remove-add[2.18.1] 2.3425 (4.12) 2.3425 (4.12) 2.3425 (4.12) 0.0000 (1.0) 2.3425 (4.12) 0.0000 (1.0) 0;0 0.4269 (0.24) 1 1 test_partial_remove-add[2.39.0] 0.5687 (1.0) 0.5687 (1.0) 0.5687 (1.0) 0.0000 (1.0) 0.5687 (1.0) 0.0000 (1.0) 0;0 1.7583 (1.0) 1 1 test_partial_remove-add[2.40.0] 1.7954 (3.16) 1.7954 (3.16) 1.7954 (3.16) 0.0000 (1.0) 1.7954 (3.16) 0.0000 (1.0) 0;0 0.5570 (0.32) 1 1 test_partial_remove-add[2.41.1] 3.0665 (5.39) 3.0665 (5.39) 3.0665 (5.39) 0.0000 (1.0) 3.0665 (5.39) 0.0000 (1.0) 0;0 0.3261 (0.19) 1 1 test_partial_remove-add[2.45.0] 1.7825 (3.13) 1.7825 (3.13) 1.7825 (3.13) 0.0000 (1.0) 1.7825 (3.13) 0.0000 (1.0) 0;0 0.5610 (0.32) 1 1 test_partial_remove-add[main] 1.5251 (2.68) 1.5251 (2.68) 1.5251 (2.68) 0.0000 (1.0) 1.5251 (2.68) 0.0000 (1.0) 0;0 0.6557 (0.37) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.11.0] 442.0532 (1.0) 442.0532 (1.0) 442.0532 (1.0) 0.0000 (1.0) 442.0532 (1.0) 0.0000 (1.0) 0;0 2.2622 (1.0) 1 1 test_partial_remove-gc[2.18.1] 469.3564 (1.06) 469.3564 (1.06) 469.3564 (1.06) 0.0000 (1.0) 469.3564 (1.06) 0.0000 (1.0) 0;0 2.1306 (0.94) 1 1 test_partial_remove-gc[2.39.0] 516.9620 (1.17) 516.9620 (1.17) 516.9620 (1.17) 0.0000 (1.0) 516.9620 (1.17) 0.0000 (1.0) 0;0 1.9344 (0.86) 1 1 test_partial_remove-gc[2.40.0] 528.6511 (1.20) 528.6511 (1.20) 528.6511 (1.20) 0.0000 (1.0) 528.6511 (1.20) 0.0000 (1.0) 0;0 1.8916 (0.84) 1 1 test_partial_remove-gc[2.41.1] 503.0243 (1.14) 503.0243 (1.14) 503.0243 (1.14) 0.0000 (1.0) 503.0243 (1.14) 0.0000 (1.0) 0;0 1.9880 (0.88) 1 1 test_partial_remove-gc[2.45.0] 496.5581 (1.12) 496.5581 (1.12) 496.5581 (1.12) 0.0000 (1.0) 496.5581 (1.12) 0.0000 (1.0) 0;0 2.0139 (0.89) 1 1 test_partial_remove-gc[main] 572.6989 (1.30) 572.6989 (1.30) 572.6989 (1.30) 0.0000 (1.0) 572.6989 (1.30) 0.0000 (1.0) 0;0 1.7461 (0.77) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.11.0] 473.3671 (1.0) 473.3671 (1.0) 473.3671 (1.0) 0.0000 (1.0) 473.3671 (1.0) 0.0000 (1.0) 0;0 2.1125 (1.0) 1 1 test_partial_remove-gc-cloud[2.18.1] 504.1913 (1.07) 504.1913 (1.07) 504.1913 (1.07) 0.0000 (1.0) 504.1913 (1.07) 0.0000 (1.0) 0;0 1.9834 (0.94) 1 1 test_partial_remove-gc-cloud[2.39.0] 529.9060 (1.12) 529.9060 (1.12) 529.9060 (1.12) 0.0000 (1.0) 529.9060 (1.12) 0.0000 (1.0) 0;0 1.8871 (0.89) 1 1 test_partial_remove-gc-cloud[2.40.0] 554.7244 (1.17) 554.7244 (1.17) 554.7244 (1.17) 0.0000 (1.0) 554.7244 (1.17) 0.0000 (1.0) 0;0 1.8027 (0.85) 1 1 test_partial_remove-gc-cloud[2.41.1] 524.4767 (1.11) 524.4767 (1.11) 524.4767 (1.11) 0.0000 (1.0) 524.4767 (1.11) 0.0000 (1.0) 0;0 1.9067 (0.90) 1 1 test_partial_remove-gc-cloud[2.45.0] 526.2084 (1.11) 526.2084 (1.11) 526.2084 (1.11) 0.0000 (1.0) 526.2084 (1.11) 0.0000 (1.0) 0;0 1.9004 (0.90) 1 1 test_partial_remove-gc-cloud[main] 624.5138 (1.32) 624.5138 (1.32) 624.5138 (1.32) 0.0000 (1.0) 624.5138 (1.32) 0.0000 (1.0) 0;0 1.6012 (0.76) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.11.0] 441.3530 (1.07) 441.3530 (1.07) 441.3530 (1.07) 0.0000 (1.0) 441.3530 (1.07) 0.0000 (1.0) 0;0 2.2658 (0.94) 1 1 test_partial_remove-push[2.18.1] 447.0428 (1.08) 447.0428 (1.08) 447.0428 (1.08) 0.0000 (1.0) 447.0428 (1.08) 0.0000 (1.0) 0;0 2.2369 (0.93) 1 1 test_partial_remove-push[2.39.0] 413.7221 (1.0) 413.7221 (1.0) 413.7221 (1.0) 0.0000 (1.0) 413.7221 (1.0) 0.0000 (1.0) 0;0 2.4171 (1.0) 1 1 test_partial_remove-push[2.40.0] 502.7580 (1.22) 502.7580 (1.22) 502.7580 (1.22) 0.0000 (1.0) 502.7580 (1.22) 0.0000 (1.0) 0;0 1.9890 (0.82) 1 1 test_partial_remove-push[2.41.1] 500.1500 (1.21) 500.1500 (1.21) 500.1500 (1.21) 0.0000 (1.0) 500.1500 (1.21) 0.0000 (1.0) 0;0 1.9994 (0.83) 1 1 test_partial_remove-push[2.45.0] 481.2635 (1.16) 481.2635 (1.16) 481.2635 (1.16) 0.0000 (1.0) 481.2635 (1.16) 0.0000 (1.0) 0;0 2.0779 (0.86) 1 1 test_partial_remove-push[main] 594.0853 (1.44) 594.0853 (1.44) 594.0853 (1.44) 0.0000 (1.0) 594.0853 (1.44) 0.0000 (1.0) 0;0 1.6833 (0.70) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial-add[2.11.0] 8.9490 (2.25) 8.9490 (2.25) 8.9490 (2.25) 0.0000 (1.0) 8.9490 (2.25) 0.0000 (1.0) 0;0 0.1117 (0.44) 1 1 test_partial_add-add-partial-add[2.18.1] 5.3141 (1.34) 5.3141 (1.34) 5.3141 (1.34) 0.0000 (1.0) 5.3141 (1.34) 0.0000 (1.0) 0;0 0.1882 (0.75) 1 1 test_partial_add-add-partial-add[2.39.0] 7.2597 (1.83) 7.2597 (1.83) 7.2597 (1.83) 0.0000 (1.0) 7.2597 (1.83) 0.0000 (1.0) 0;0 0.1377 (0.55) 1 1 test_partial_add-add-partial-add[2.40.0] 4.0185 (1.01) 4.0185 (1.01) 4.0185 (1.01) 0.0000 (1.0) 4.0185 (1.01) 0.0000 (1.0) 0;0 0.2489 (0.99) 1 1 test_partial_add-add-partial-add[2.41.1] 5.6581 (1.43) 5.6581 (1.43) 5.6581 (1.43) 0.0000 (1.0) 5.6581 (1.43) 0.0000 (1.0) 0;0 0.1767 (0.70) 1 1 test_partial_add-add-partial-add[2.45.0] 4.8245 (1.22) 4.8245 (1.22) 4.8245 (1.22) 0.0000 (1.0) 4.8245 (1.22) 0.0000 (1.0) 0;0 0.2073 (0.82) 1 1 test_partial_add-add-partial-add[main] 3.9706 (1.0) 3.9706 (1.0) 3.9706 (1.0) 0.0000 (1.0) 3.9706 (1.0) 0.0000 (1.0) 0;0 0.2519 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.11.0] 592.5701 (1.0) 592.5701 (1.0) 592.5701 (1.0) 0.0000 (1.0) 592.5701 (1.0) 0.0000 (1.0) 0;0 1.6876 (1.0) 1 1 test_partial_add-gc-cloud-noop[2.18.1] 637.8871 (1.08) 637.8871 (1.08) 637.8871 (1.08) 0.0000 (1.0) 637.8871 (1.08) 0.0000 (1.0) 0;0 1.5677 (0.93) 1 1 test_partial_add-gc-cloud-noop[2.39.0] 692.3855 (1.17) 692.3855 (1.17) 692.3855 (1.17) 0.0000 (1.0) 692.3855 (1.17) 0.0000 (1.0) 0;0 1.4443 (0.86) 1 1 test_partial_add-gc-cloud-noop[2.40.0] 635.1922 (1.07) 635.1922 (1.07) 635.1922 (1.07) 0.0000 (1.0) 635.1922 (1.07) 0.0000 (1.0) 0;0 1.5743 (0.93) 1 1 test_partial_add-gc-cloud-noop[2.41.1] 705.2675 (1.19) 705.2675 (1.19) 705.2675 (1.19) 0.0000 (1.0) 705.2675 (1.19) 0.0000 (1.0) 0;0 1.4179 (0.84) 1 1 test_partial_add-gc-cloud-noop[2.45.0] 664.5346 (1.12) 664.5346 (1.12) 664.5346 (1.12) 0.0000 (1.0) 664.5346 (1.12) 0.0000 (1.0) 0;0 1.5048 (0.89) 1 1 test_partial_add-gc-cloud-noop[main] 794.6686 (1.34) 794.6686 (1.34) 794.6686 (1.34) 0.0000 (1.0) 794.6686 (1.34) 0.0000 (1.0) 0;0 1.2584 (0.75) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.11.0] 509.8568 (1.0) 509.8568 (1.0) 509.8568 (1.0) 0.0000 (1.0) 509.8568 (1.0) 0.0000 (1.0) 0;0 1.9613 (1.0) 1 1 test_partial_add-gc-noop[2.18.1] 554.9512 (1.09) 554.9512 (1.09) 554.9512 (1.09) 0.0000 (1.0) 554.9512 (1.09) 0.0000 (1.0) 0;0 1.8020 (0.92) 1 1 test_partial_add-gc-noop[2.39.0] 606.8579 (1.19) 606.8579 (1.19) 606.8579 (1.19) 0.0000 (1.0) 606.8579 (1.19) 0.0000 (1.0) 0;0 1.6478 (0.84) 1 1 test_partial_add-gc-noop[2.40.0] 592.4991 (1.16) 592.4991 (1.16) 592.4991 (1.16) 0.0000 (1.0) 592.4991 (1.16) 0.0000 (1.0) 0;0 1.6878 (0.86) 1 1 test_partial_add-gc-noop[2.41.1] 610.1780 (1.20) 610.1780 (1.20) 610.1780 (1.20) 0.0000 (1.0) 610.1780 (1.20) 0.0000 (1.0) 0;0 1.6389 (0.84) 1 1 test_partial_add-gc-noop[2.45.0] 600.2341 (1.18) 600.2341 (1.18) 600.2341 (1.18) 0.0000 (1.0) 600.2341 (1.18) 0.0000 (1.0) 0;0 1.6660 (0.85) 1 1 test_partial_add-gc-noop[main] 691.3276 (1.36) 691.3276 (1.36) 691.3276 (1.36) 0.0000 (1.0) 691.3276 (1.36) 0.0000 (1.0) 0;0 1.4465 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial-add[2.11.0] 5.0046 (8.79) 5.0046 (8.79) 5.0046 (8.79) 0.0000 (1.0) 5.0046 (8.79) 0.0000 (1.0) 0;0 0.1998 (0.11) 1 1 test_partial_add-push-partial-add[2.18.1] 0.5696 (1.0) 0.5696 (1.0) 0.5696 (1.0) 0.0000 (1.0) 0.5696 (1.0) 0.0000 (1.0) 0;0 1.7556 (1.0) 1 1 test_partial_add-push-partial-add[2.39.0] 6.4053 (11.25) 6.4053 (11.25) 6.4053 (11.25) 0.0000 (1.0) 6.4053 (11.25) 0.0000 (1.0) 0;0 0.1561 (0.09) 1 1 test_partial_add-push-partial-add[2.40.0] 0.6584 (1.16) 0.6584 (1.16) 0.6584 (1.16) 0.0000 (1.0) 0.6584 (1.16) 0.0000 (1.0) 0;0 1.5188 (0.87) 1 1 test_partial_add-push-partial-add[2.41.1] 3.5559 (6.24) 3.5559 (6.24) 3.5559 (6.24) 0.0000 (1.0) 3.5559 (6.24) 0.0000 (1.0) 0;0 0.2812 (0.16) 1 1 test_partial_add-push-partial-add[2.45.0] 4.5390 (7.97) 4.5390 (7.97) 4.5390 (7.97) 0.0000 (1.0) 4.5390 (7.97) 0.0000 (1.0) 0;0 0.2203 (0.13) 1 1 test_partial_add-push-partial-add[main] 2.5297 (4.44) 2.5297 (4.44) 2.5297 (4.44) 0.0000 (1.0) 2.5297 (4.44) 0.0000 (1.0) 0;0 0.3953 (0.23) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 year ago 
github-actions[bot]
commented
1 year ago