Closed pmrowla closed 1 year ago
Sat May 6 04:05:07 UTC 2023 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.39.0] 1.2206 (1.23) 1.2276 (1.22) 1.2229 (1.22) 0.0027 (1.0) 1.2223 (1.22) 0.0023 (1.0) 1;1 0.8177 (0.82) 5 3 test_plots-plots-diff[2.40.0] 1.1836 (1.19) 1.1977 (1.19) 1.1902 (1.19) 0.0057 (2.09) 1.1891 (1.19) 0.0091 (3.88) 2;0 0.8402 (0.84) 5 3 test_plots-plots-diff[2.41.1] 1.1735 (1.18) 1.2045 (1.19) 1.1905 (1.19) 0.0123 (4.56) 1.1949 (1.19) 0.0185 (7.94) 2;0 0.8400 (0.84) 5 3 test_plots-plots-diff[2.45.0] 1.0519 (1.06) 1.0760 (1.07) 1.0642 (1.06) 0.0086 (3.18) 1.0650 (1.06) 0.0084 (3.61) 2;0 0.9396 (0.94) 5 3 test_plots-plots-diff[main] 0.9961 (1.0) 1.0102 (1.0) 1.0031 (1.0) 0.0051 (1.87) 1.0035 (1.0) 0.0052 (2.24) 2;0 0.9969 (1.0) 5 3 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.39.0] 2.1936 (1.68) 2.2242 (1.66) 2.2031 (1.66) 0.0126 (1.66) 2.1981 (1.66) 0.0151 (2.20) 1;0 0.4539 (0.60) 5 3 test_plots-plots-diff-json[2.40.0] 2.1154 (1.62) 2.1446 (1.60) 2.1260 (1.60) 0.0117 (1.55) 2.1248 (1.60) 0.0160 (2.33) 1;0 0.4704 (0.63) 5 3 test_plots-plots-diff-json[2.41.1] 2.1122 (1.61) 2.1351 (1.59) 2.1236 (1.60) 0.0095 (1.26) 2.1266 (1.60) 0.0155 (2.25) 2;0 0.4709 (0.63) 5 3 test_plots-plots-diff-json[2.45.0] 1.9005 (1.45) 1.9205 (1.43) 1.9133 (1.44) 0.0075 (1.0) 1.9149 (1.44) 0.0069 (1.0) 1;0 0.5227 (0.69) 5 3 test_plots-plots-diff-json[main] 1.3090 (1.0) 1.3433 (1.0) 1.3292 (1.0) 0.0137 (1.81) 1.3275 (1.0) 0.0194 (2.82) 2;0 0.7523 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_plots-plots-show[2.39.0] 813.0341 (1.09) 836.5857 (1.09) 824.3603 (1.09) 8.5155 (1.15) 822.7653 (1.09) 9.1620 (1.12) 2;0 1.2131 (0.92) 5 3 test_plots-plots-show[2.40.0] 777.9963 (1.04) 796.7426 (1.04) 784.3556 (1.04) 7.3824 (1.0) 783.2189 (1.03) 8.1827 (1.0) 1;0 1.2749 (0.96) 5 3 test_plots-plots-show[2.41.1] 770.1835 (1.03) 791.2322 (1.03) 779.7620 (1.03) 8.2925 (1.12) 777.1248 (1.03) 12.3390 (1.51) 2;0 1.2824 (0.97) 5 3 test_plots-plots-show[2.45.0] 748.7689 (1.0) 768.0452 (1.0) 756.8983 (1.0) 8.0434 (1.09) 756.8982 (1.0) 13.2972 (1.63) 2;0 1.3212 (1.0) 5 3 test_plots-plots-show[main] 823.0801 (1.10) 849.3654 (1.11) 833.7014 (1.10) 10.8701 (1.47) 836.0913 (1.10) 16.1250 (1.97) 1;0 1.1995 (0.91) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.39.0] 1.3406 (1.34) 1.3677 (1.34) 1.3540 (1.34) 0.0101 (1.33) 1.3522 (1.34) 0.0135 (1.06) 2;0 0.7385 (0.75) 5 3 test_plots-plots-show-json[2.40.0] 1.3147 (1.31) 1.3404 (1.31) 1.3274 (1.31) 0.0102 (1.33) 1.3277 (1.31) 0.0161 (1.26) 2;0 0.7534 (0.76) 5 3 test_plots-plots-show-json[2.41.1] 1.3023 (1.30) 1.3265 (1.30) 1.3161 (1.30) 0.0103 (1.35) 1.3198 (1.30) 0.0172 (1.35) 2;0 0.7598 (0.77) 5 3 test_plots-plots-show-json[2.45.0] 1.2039 (1.20) 1.2297 (1.20) 1.2169 (1.20) 0.0101 (1.32) 1.2193 (1.21) 0.0152 (1.19) 2;0 0.8218 (0.83) 5 3 test_plots-plots-show-json[main] 1.0033 (1.0) 1.0219 (1.0) 1.0119 (1.0) 0.0076 (1.0) 1.0118 (1.0) 0.0128 (1.0) 2;0 0.9883 (1.0) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.18.1] 1.1965 (1.0) 1.1965 (1.0) 1.1965 (1.0) 0.0000 (1.0) 1.1965 (1.0) 0.0000 (1.0) 0;0 0.8358 (1.0) 1 1 test_data_status_all_flags-data-changed[2.39.0] 1.2489 (1.04) 1.2489 (1.04) 1.2489 (1.04) 0.0000 (1.0) 1.2489 (1.04) 0.0000 (1.0) 0;0 0.8007 (0.96) 1 1 test_data_status_all_flags-data-changed[2.40.0] 1.2343 (1.03) 1.2343 (1.03) 1.2343 (1.03) 0.0000 (1.0) 1.2343 (1.03) 0.0000 (1.0) 0;0 0.8102 (0.97) 1 1 test_data_status_all_flags-data-changed[2.41.1] 1.2374 (1.03) 1.2374 (1.03) 1.2374 (1.03) 0.0000 (1.0) 1.2374 (1.03) 0.0000 (1.0) 0;0 0.8082 (0.97) 1 1 test_data_status_all_flags-data-changed[2.45.0] 1.2507 (1.05) 1.2507 (1.05) 1.2507 (1.05) 0.0000 (1.0) 1.2507 (1.05) 0.0000 (1.0) 0;0 0.7995 (0.96) 1 1 test_data_status_all_flags-data-changed[main] 1.2516 (1.05) 1.2516 (1.05) 1.2516 (1.05) 0.0000 (1.0) 1.2516 (1.05) 0.0000 (1.0) 0;0 0.7990 (0.96) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.18.1] 1.1937 (1.0) 1.1937 (1.0) 1.1937 (1.0) 0.0000 (1.0) 1.1937 (1.0) 0.0000 (1.0) 0;0 0.8377 (1.0) 1 1 test_data_status_all_flags-data-changed-noop[2.39.0] 1.2458 (1.04) 1.2458 (1.04) 1.2458 (1.04) 0.0000 (1.0) 1.2458 (1.04) 0.0000 (1.0) 0;0 0.8027 (0.96) 1 1 test_data_status_all_flags-data-changed-noop[2.40.0] 1.2295 (1.03) 1.2295 (1.03) 1.2295 (1.03) 0.0000 (1.0) 1.2295 (1.03) 0.0000 (1.0) 0;0 0.8133 (0.97) 1 1 test_data_status_all_flags-data-changed-noop[2.41.1] 1.2270 (1.03) 1.2270 (1.03) 1.2270 (1.03) 0.0000 (1.0) 1.2270 (1.03) 0.0000 (1.0) 0;0 0.8150 (0.97) 1 1 test_data_status_all_flags-data-changed-noop[2.45.0] 1.2127 (1.02) 1.2127 (1.02) 1.2127 (1.02) 0.0000 (1.0) 1.2127 (1.02) 0.0000 (1.0) 0;0 0.8246 (0.98) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.2425 (1.04) 1.2425 (1.04) 1.2425 (1.04) 0.0000 (1.0) 1.2425 (1.04) 0.0000 (1.0) 0;0 0.8048 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.18.1] 2.0247 (1.03) 2.0247 (1.03) 2.0247 (1.03) 0.0000 (1.0) 2.0247 (1.03) 0.0000 (1.0) 0;0 0.4939 (0.97) 1 1 test_data_status_all_flags-data-new[2.39.0] 2.0269 (1.03) 2.0269 (1.03) 2.0269 (1.03) 0.0000 (1.0) 2.0269 (1.03) 0.0000 (1.0) 0;0 0.4934 (0.97) 1 1 test_data_status_all_flags-data-new[2.40.0] 2.0155 (1.03) 2.0155 (1.03) 2.0155 (1.03) 0.0000 (1.0) 2.0155 (1.03) 0.0000 (1.0) 0;0 0.4961 (0.97) 1 1 test_data_status_all_flags-data-new[2.41.1] 2.0184 (1.03) 2.0184 (1.03) 2.0184 (1.03) 0.0000 (1.0) 2.0184 (1.03) 0.0000 (1.0) 0;0 0.4954 (0.97) 1 1 test_data_status_all_flags-data-new[2.45.0] 1.9643 (1.0) 1.9643 (1.0) 1.9643 (1.0) 0.0000 (1.0) 1.9643 (1.0) 0.0000 (1.0) 0;0 0.5091 (1.0) 1 1 test_data_status_all_flags-data-new[main] 2.0321 (1.03) 2.0321 (1.03) 2.0321 (1.03) 0.0000 (1.0) 2.0321 (1.03) 0.0000 (1.0) 0;0 0.4921 (0.97) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.18.1] 1.1528 (1.0) 1.1528 (1.0) 1.1528 (1.0) 0.0000 (1.0) 1.1528 (1.0) 0.0000 (1.0) 0;0 0.8674 (1.0) 1 1 test_data_status_all_flags-data-noop[2.39.0] 1.1903 (1.03) 1.1903 (1.03) 1.1903 (1.03) 0.0000 (1.0) 1.1903 (1.03) 0.0000 (1.0) 0;0 0.8401 (0.97) 1 1 test_data_status_all_flags-data-noop[2.40.0] 1.1782 (1.02) 1.1782 (1.02) 1.1782 (1.02) 0.0000 (1.0) 1.1782 (1.02) 0.0000 (1.0) 0;0 0.8487 (0.98) 1 1 test_data_status_all_flags-data-noop[2.41.1] 1.1622 (1.01) 1.1622 (1.01) 1.1622 (1.01) 0.0000 (1.0) 1.1622 (1.01) 0.0000 (1.0) 0;0 0.8604 (0.99) 1 1 test_data_status_all_flags-data-noop[2.45.0] 1.1626 (1.01) 1.1626 (1.01) 1.1626 (1.01) 0.0000 (1.0) 1.1626 (1.01) 0.0000 (1.0) 0;0 0.8602 (0.99) 1 1 test_data_status_all_flags-data-noop[main] 1.2151 (1.05) 1.2151 (1.05) 1.2151 (1.05) 0.0000 (1.0) 1.2151 (1.05) 0.0000 (1.0) 0;0 0.8230 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.11.0] 6.8902 (1.80) 6.8902 (1.80) 6.8902 (1.80) 0.0000 (1.0) 6.8902 (1.80) 0.0000 (1.0) 0;0 0.1451 (0.56) 1 1 test_sharing-add[2.18.1] 6.3856 (1.66) 6.3856 (1.66) 6.3856 (1.66) 0.0000 (1.0) 6.3856 (1.66) 0.0000 (1.0) 0;0 0.1566 (0.60) 1 1 test_sharing-add[2.39.0] 5.8734 (1.53) 5.8734 (1.53) 5.8734 (1.53) 0.0000 (1.0) 5.8734 (1.53) 0.0000 (1.0) 0;0 0.1703 (0.65) 1 1 test_sharing-add[2.40.0] 6.0202 (1.57) 6.0202 (1.57) 6.0202 (1.57) 0.0000 (1.0) 6.0202 (1.57) 0.0000 (1.0) 0;0 0.1661 (0.64) 1 1 test_sharing-add[2.41.1] 5.8775 (1.53) 5.8775 (1.53) 5.8775 (1.53) 0.0000 (1.0) 5.8775 (1.53) 0.0000 (1.0) 0;0 0.1701 (0.65) 1 1 test_sharing-add[2.45.0] 3.8372 (1.0) 3.8372 (1.0) 3.8372 (1.0) 0.0000 (1.0) 3.8372 (1.0) 0.0000 (1.0) 0;0 0.2606 (1.0) 1 1 test_sharing-add[main] 3.9934 (1.04) 3.9934 (1.04) 3.9934 (1.04) 0.0000 (1.0) 3.9934 (1.04) 0.0000 (1.0) 0;0 0.2504 (0.96) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.11.0] 3.4096 (1.41) 3.4096 (1.41) 3.4096 (1.41) 0.0000 (1.0) 3.4096 (1.41) 0.0000 (1.0) 0;0 0.2933 (0.71) 1 1 test_sharing-add-noop[2.18.1] 3.6488 (1.51) 3.6488 (1.51) 3.6488 (1.51) 0.0000 (1.0) 3.6488 (1.51) 0.0000 (1.0) 0;0 0.2741 (0.66) 1 1 test_sharing-add-noop[2.39.0] 2.4611 (1.02) 2.4611 (1.02) 2.4611 (1.02) 0.0000 (1.0) 2.4611 (1.02) 0.0000 (1.0) 0;0 0.4063 (0.98) 1 1 test_sharing-add-noop[2.40.0] 2.5285 (1.05) 2.5285 (1.05) 2.5285 (1.05) 0.0000 (1.0) 2.5285 (1.05) 0.0000 (1.0) 0;0 0.3955 (0.95) 1 1 test_sharing-add-noop[2.41.1] 2.4112 (1.0) 2.4112 (1.0) 2.4112 (1.0) 0.0000 (1.0) 2.4112 (1.0) 0.0000 (1.0) 0;0 0.4147 (1.0) 1 1 test_sharing-add-noop[2.45.0] 2.5739 (1.07) 2.5739 (1.07) 2.5739 (1.07) 0.0000 (1.0) 2.5739 (1.07) 0.0000 (1.0) 0;0 0.3885 (0.94) 1 1 test_sharing-add-noop[main] 2.6058 (1.08) 2.6058 (1.08) 2.6058 (1.08) 0.0000 (1.0) 2.6058 (1.08) 0.0000 (1.0) 0;0 0.3838 (0.93) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.11.0] 491.0736 (1.0) 491.0736 (1.0) 491.0736 (1.0) 0.0000 (1.0) 491.0736 (1.0) 0.0000 (1.0) 0;0 2.0364 (1.0) 1 1 test_sharing-checkout-noop[2.18.1] 564.1391 (1.15) 564.1391 (1.15) 564.1391 (1.15) 0.0000 (1.0) 564.1391 (1.15) 0.0000 (1.0) 0;0 1.7726 (0.87) 1 1 test_sharing-checkout-noop[2.39.0] 601.2093 (1.22) 601.2093 (1.22) 601.2093 (1.22) 0.0000 (1.0) 601.2093 (1.22) 0.0000 (1.0) 0;0 1.6633 (0.82) 1 1 test_sharing-checkout-noop[2.40.0] 579.4483 (1.18) 579.4483 (1.18) 579.4483 (1.18) 0.0000 (1.0) 579.4483 (1.18) 0.0000 (1.0) 0;0 1.7258 (0.85) 1 1 test_sharing-checkout-noop[2.41.1] 575.0918 (1.17) 575.0918 (1.17) 575.0918 (1.17) 0.0000 (1.0) 575.0918 (1.17) 0.0000 (1.0) 0;0 1.7389 (0.85) 1 1 test_sharing-checkout-noop[2.45.0] 611.1796 (1.24) 611.1796 (1.24) 611.1796 (1.24) 0.0000 (1.0) 611.1796 (1.24) 0.0000 (1.0) 0;0 1.6362 (0.80) 1 1 test_sharing-checkout-noop[main] 678.2602 (1.38) 678.2602 (1.38) 678.2602 (1.38) 0.0000 (1.0) 678.2602 (1.38) 0.0000 (1.0) 0;0 1.4744 (0.72) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-pull': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[2.11.0] 7.0877 (1.05) 7.0877 (1.05) 7.0877 (1.05) 0.0000 (1.0) 7.0877 (1.05) 0.0000 (1.0) 0;0 0.1411 (0.95) 1 1 test_sharing-pull[2.18.1] 7.1641 (1.06) 7.1641 (1.06) 7.1641 (1.06) 0.0000 (1.0) 7.1641 (1.06) 0.0000 (1.0) 0;0 0.1396 (0.94) 1 1 test_sharing-pull[2.39.0] 8.4384 (1.25) 8.4384 (1.25) 8.4384 (1.25) 0.0000 (1.0) 8.4384 (1.25) 0.0000 (1.0) 0;0 0.1185 (0.80) 1 1 test_sharing-pull[2.40.0] 8.4945 (1.26) 8.4945 (1.26) 8.4945 (1.26) 0.0000 (1.0) 8.4945 (1.26) 0.0000 (1.0) 0;0 0.1177 (0.79) 1 1 test_sharing-pull[2.41.1] 8.4026 (1.25) 8.4026 (1.25) 8.4026 (1.25) 0.0000 (1.0) 8.4026 (1.25) 0.0000 (1.0) 0;0 0.1190 (0.80) 1 1 test_sharing-pull[2.45.0] 6.7420 (1.0) 6.7420 (1.0) 6.7420 (1.0) 0.0000 (1.0) 6.7420 (1.0) 0.0000 (1.0) 0;0 0.1483 (1.0) 1 1 test_sharing-pull[main] 6.8353 (1.01) 6.8353 (1.01) 6.8353 (1.01) 0.0000 (1.0) 6.8353 (1.01) 0.0000 (1.0) 0;0 0.1463 (0.99) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[2.11.0] 518.4468 (1.0) 518.4468 (1.0) 518.4468 (1.0) 0.0000 (1.0) 518.4468 (1.0) 0.0000 (1.0) 0;0 1.9288 (1.0) 1 1 test_sharing-pull-noop[2.18.1] 604.0704 (1.17) 604.0704 (1.17) 604.0704 (1.17) 0.0000 (1.0) 604.0704 (1.17) 0.0000 (1.0) 0;0 1.6554 (0.86) 1 1 test_sharing-pull-noop[2.39.0] 624.6353 (1.20) 624.6353 (1.20) 624.6353 (1.20) 0.0000 (1.0) 624.6353 (1.20) 0.0000 (1.0) 0;0 1.6009 (0.83) 1 1 test_sharing-pull-noop[2.40.0] 619.2364 (1.19) 619.2364 (1.19) 619.2364 (1.19) 0.0000 (1.0) 619.2364 (1.19) 0.0000 (1.0) 0;0 1.6149 (0.84) 1 1 test_sharing-pull-noop[2.41.1] 609.6880 (1.18) 609.6880 (1.18) 609.6880 (1.18) 0.0000 (1.0) 609.6880 (1.18) 0.0000 (1.0) 0;0 1.6402 (0.85) 1 1 test_sharing-pull-noop[2.45.0] 659.6184 (1.27) 659.6184 (1.27) 659.6184 (1.27) 0.0000 (1.0) 659.6184 (1.27) 0.0000 (1.0) 0;0 1.5160 (0.79) 1 1 test_sharing-pull-noop[main] 722.5816 (1.39) 722.5816 (1.39) 722.5816 (1.39) 0.0000 (1.0) 722.5816 (1.39) 0.0000 (1.0) 0;0 1.3839 (0.72) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.11.0] 3.8715 (1.15) 3.8715 (1.15) 3.8715 (1.15) 0.0000 (1.0) 3.8715 (1.15) 0.0000 (1.0) 0;0 0.2583 (0.87) 1 1 test_sharing-push[2.18.1] 3.8840 (1.16) 3.8840 (1.16) 3.8840 (1.16) 0.0000 (1.0) 3.8840 (1.16) 0.0000 (1.0) 0;0 0.2575 (0.87) 1 1 test_sharing-push[2.39.0] 4.9221 (1.46) 4.9221 (1.46) 4.9221 (1.46) 0.0000 (1.0) 4.9221 (1.46) 0.0000 (1.0) 0;0 0.2032 (0.68) 1 1 test_sharing-push[2.40.0] 5.1117 (1.52) 5.1117 (1.52) 5.1117 (1.52) 0.0000 (1.0) 5.1117 (1.52) 0.0000 (1.0) 0;0 0.1956 (0.66) 1 1 test_sharing-push[2.41.1] 4.8577 (1.45) 4.8577 (1.45) 4.8577 (1.45) 0.0000 (1.0) 4.8577 (1.45) 0.0000 (1.0) 0;0 0.2059 (0.69) 1 1 test_sharing-push[2.45.0] 3.3609 (1.0) 3.3609 (1.0) 3.3609 (1.0) 0.0000 (1.0) 3.3609 (1.0) 0.0000 (1.0) 0;0 0.2975 (1.0) 1 1 test_sharing-push[main] 3.4663 (1.03) 3.4663 (1.03) 3.4663 (1.03) 0.0000 (1.0) 3.4663 (1.03) 0.0000 (1.0) 0;0 0.2885 (0.97) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.11.0] 431.0590 (1.0) 431.0590 (1.0) 431.0590 (1.0) 0.0000 (1.0) 431.0590 (1.0) 0.0000 (1.0) 0;0 2.3199 (1.0) 1 1 test_sharing-push-noop[2.18.1] 432.9762 (1.00) 432.9762 (1.00) 432.9762 (1.00) 0.0000 (1.0) 432.9762 (1.00) 0.0000 (1.0) 0;0 2.3096 (1.00) 1 1 test_sharing-push-noop[2.39.0] 462.8668 (1.07) 462.8668 (1.07) 462.8668 (1.07) 0.0000 (1.0) 462.8668 (1.07) 0.0000 (1.0) 0;0 2.1604 (0.93) 1 1 test_sharing-push-noop[2.40.0] 500.8439 (1.16) 500.8439 (1.16) 500.8439 (1.16) 0.0000 (1.0) 500.8439 (1.16) 0.0000 (1.0) 0;0 1.9966 (0.86) 1 1 test_sharing-push-noop[2.41.1] 468.7595 (1.09) 468.7595 (1.09) 468.7595 (1.09) 0.0000 (1.0) 468.7595 (1.09) 0.0000 (1.0) 0;0 2.1333 (0.92) 1 1 test_sharing-push-noop[2.45.0] 483.4534 (1.12) 483.4534 (1.12) 483.4534 (1.12) 0.0000 (1.0) 483.4534 (1.12) 0.0000 (1.0) 0;0 2.0685 (0.89) 1 1 test_sharing-push-noop[main] 563.4025 (1.31) 563.4025 (1.31) 563.4025 (1.31) 0.0000 (1.0) 563.4025 (1.31) 0.0000 (1.0) 0;0 1.7749 (0.77) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.11.0] 4.9177 (1.39) 4.9177 (1.39) 4.9177 (1.39) 0.0000 (1.0) 4.9177 (1.39) 0.0000 (1.0) 0;0 0.2033 (0.72) 1 1 test_get-get[2.18.1] 4.5427 (1.28) 4.5427 (1.28) 4.5427 (1.28) 0.0000 (1.0) 4.5427 (1.28) 0.0000 (1.0) 0;0 0.2201 (0.78) 1 1 test_get-get[2.39.0] 3.6552 (1.03) 3.6552 (1.03) 3.6552 (1.03) 0.0000 (1.0) 3.6552 (1.03) 0.0000 (1.0) 0;0 0.2736 (0.97) 1 1 test_get-get[2.40.0] 3.5627 (1.01) 3.5627 (1.01) 3.5627 (1.01) 0.0000 (1.0) 3.5627 (1.01) 0.0000 (1.0) 0;0 0.2807 (0.99) 1 1 test_get-get[2.41.1] 3.5439 (1.0) 3.5439 (1.0) 3.5439 (1.0) 0.0000 (1.0) 3.5439 (1.0) 0.0000 (1.0) 0;0 0.2822 (1.0) 1 1 test_get-get[2.45.0] 3.6126 (1.02) 3.6126 (1.02) 3.6126 (1.02) 0.0000 (1.0) 3.6126 (1.02) 0.0000 (1.0) 0;0 0.2768 (0.98) 1 1 test_get-get[main] 4.9639 (1.40) 4.9639 (1.40) 4.9639 (1.40) 0.0000 (1.0) 4.9639 (1.40) 0.0000 (1.0) 0;0 0.2015 (0.71) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.11.0] 1.2883 (1.05) 1.2883 (1.05) 1.2883 (1.05) 0.0000 (1.0) 1.2883 (1.05) 0.0000 (1.0) 0;0 0.7762 (0.95) 1 1 test_checkout_symlink-checkout[2.18.1] 1.2281 (1.0) 1.2281 (1.0) 1.2281 (1.0) 0.0000 (1.0) 1.2281 (1.0) 0.0000 (1.0) 0;0 0.8142 (1.0) 1 1 test_checkout_symlink-checkout[2.39.0] 1.3944 (1.14) 1.3944 (1.14) 1.3944 (1.14) 0.0000 (1.0) 1.3944 (1.14) 0.0000 (1.0) 0;0 0.7172 (0.88) 1 1 test_checkout_symlink-checkout[2.40.0] 1.2978 (1.06) 1.2978 (1.06) 1.2978 (1.06) 0.0000 (1.0) 1.2978 (1.06) 0.0000 (1.0) 0;0 0.7705 (0.95) 1 1 test_checkout_symlink-checkout[2.41.1] 1.2645 (1.03) 1.2645 (1.03) 1.2645 (1.03) 0.0000 (1.0) 1.2645 (1.03) 0.0000 (1.0) 0;0 0.7909 (0.97) 1 1 test_checkout_symlink-checkout[2.45.0] 2.1712 (1.77) 2.1712 (1.77) 2.1712 (1.77) 0.0000 (1.0) 2.1712 (1.77) 0.0000 (1.0) 0;0 0.4606 (0.57) 1 1 test_checkout_symlink-checkout[main] 1.5376 (1.25) 1.5376 (1.25) 1.5376 (1.25) 0.0000 (1.0) 1.5376 (1.25) 0.0000 (1.0) 0;0 0.6504 (0.80) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.11.0] 502.2160 (1.0) 502.2160 (1.0) 502.2160 (1.0) 0.0000 (1.0) 502.2160 (1.0) 0.0000 (1.0) 0;0 1.9912 (1.0) 1 1 test_checkout_symlink-checkout-noop[2.18.1] 549.4166 (1.09) 549.4166 (1.09) 549.4166 (1.09) 0.0000 (1.0) 549.4166 (1.09) 0.0000 (1.0) 0;0 1.8201 (0.91) 1 1 test_checkout_symlink-checkout-noop[2.39.0] 567.5745 (1.13) 567.5745 (1.13) 567.5745 (1.13) 0.0000 (1.0) 567.5745 (1.13) 0.0000 (1.0) 0;0 1.7619 (0.88) 1 1 test_checkout_symlink-checkout-noop[2.40.0] 569.1313 (1.13) 569.1313 (1.13) 569.1313 (1.13) 0.0000 (1.0) 569.1313 (1.13) 0.0000 (1.0) 0;0 1.7571 (0.88) 1 1 test_checkout_symlink-checkout-noop[2.41.1] 752.4023 (1.50) 752.4023 (1.50) 752.4023 (1.50) 0.0000 (1.0) 752.4023 (1.50) 0.0000 (1.0) 0;0 1.3291 (0.67) 1 1 test_checkout_symlink-checkout-noop[2.45.0] 611.0160 (1.22) 611.0160 (1.22) 611.0160 (1.22) 0.0000 (1.0) 611.0160 (1.22) 0.0000 (1.0) 0;0 1.6366 (0.82) 1 1 test_checkout_symlink-checkout-noop[main] 675.8598 (1.35) 675.8598 (1.35) 675.8598 (1.35) 0.0000 (1.0) 675.8598 (1.35) 0.0000 (1.0) 0;0 1.4796 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-update[2.11.0] 1.3466 (2.08) 1.3466 (2.08) 1.3466 (2.08) 0.0000 (1.0) 1.3466 (2.08) 0.0000 (1.0) 0;0 0.7426 (0.48) 1 1 test_checkout_symlink-checkout-update[2.18.1] 0.6470 (1.0) 0.6470 (1.0) 0.6470 (1.0) 0.0000 (1.0) 0.6470 (1.0) 0.0000 (1.0) 0;0 1.5457 (1.0) 1 1 test_checkout_symlink-checkout-update[2.39.0] 0.6673 (1.03) 0.6673 (1.03) 0.6673 (1.03) 0.0000 (1.0) 0.6673 (1.03) 0.0000 (1.0) 0;0 1.4987 (0.97) 1 1 test_checkout_symlink-checkout-update[2.40.0] 0.6698 (1.04) 0.6698 (1.04) 0.6698 (1.04) 0.0000 (1.0) 0.6698 (1.04) 0.0000 (1.0) 0;0 1.4929 (0.97) 1 1 test_checkout_symlink-checkout-update[2.41.1] 0.6682 (1.03) 0.6682 (1.03) 0.6682 (1.03) 0.0000 (1.0) 0.6682 (1.03) 0.0000 (1.0) 0;0 1.4966 (0.97) 1 1 test_checkout_symlink-checkout-update[2.45.0] 0.7129 (1.10) 0.7129 (1.10) 0.7129 (1.10) 0.0000 (1.0) 0.7129 (1.10) 0.0000 (1.0) 0;0 1.4026 (0.91) 1 1 test_checkout_symlink-checkout-update[main] 0.7744 (1.20) 0.7744 (1.20) 0.7744 (1.20) 0.0000 (1.0) 0.7744 (1.20) 0.0000 (1.0) 0;0 1.2913 (0.84) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.11.0] 423.5382 (1.0) 423.5382 (1.0) 423.5382 (1.0) 0.0000 (1.0) 423.5382 (1.0) 0.0000 (1.0) 0;0 2.3611 (1.0) 1 1 test_gc-gc[2.18.1] 436.0106 (1.03) 436.0106 (1.03) 436.0106 (1.03) 0.0000 (1.0) 436.0106 (1.03) 0.0000 (1.0) 0;0 2.2935 (0.97) 1 1 test_gc-gc[2.39.0] 473.0696 (1.12) 473.0696 (1.12) 473.0696 (1.12) 0.0000 (1.0) 473.0696 (1.12) 0.0000 (1.0) 0;0 2.1139 (0.90) 1 1 test_gc-gc[2.40.0] 471.5381 (1.11) 471.5381 (1.11) 471.5381 (1.11) 0.0000 (1.0) 471.5381 (1.11) 0.0000 (1.0) 0;0 2.1207 (0.90) 1 1 test_gc-gc[2.41.1] 480.4713 (1.13) 480.4713 (1.13) 480.4713 (1.13) 0.0000 (1.0) 480.4713 (1.13) 0.0000 (1.0) 0;0 2.0813 (0.88) 1 1 test_gc-gc[2.45.0] 475.6612 (1.12) 475.6612 (1.12) 475.6612 (1.12) 0.0000 (1.0) 475.6612 (1.12) 0.0000 (1.0) 0;0 2.1023 (0.89) 1 1 test_gc-gc[main] 525.0848 (1.24) 525.0848 (1.24) 525.0848 (1.24) 0.0000 (1.0) 525.0848 (1.24) 0.0000 (1.0) 0;0 1.9045 (0.81) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.11.0] 2.9564 (1.0) 2.9564 (1.0) 2.9564 (1.0) 0.0000 (1.0) 2.9564 (1.0) 0.0000 (1.0) 0;0 0.3383 (1.0) 1 1 test_get_url-get-url[2.18.1] 3.0136 (1.02) 3.0136 (1.02) 3.0136 (1.02) 0.0000 (1.0) 3.0136 (1.02) 0.0000 (1.0) 0;0 0.3318 (0.98) 1 1 test_get_url-get-url[2.39.0] 2.9905 (1.01) 2.9905 (1.01) 2.9905 (1.01) 0.0000 (1.0) 2.9905 (1.01) 0.0000 (1.0) 0;0 0.3344 (0.99) 1 1 test_get_url-get-url[2.40.0] 2.9965 (1.01) 2.9965 (1.01) 2.9965 (1.01) 0.0000 (1.0) 2.9965 (1.01) 0.0000 (1.0) 0;0 0.3337 (0.99) 1 1 test_get_url-get-url[2.41.1] 2.9936 (1.01) 2.9936 (1.01) 2.9936 (1.01) 0.0000 (1.0) 2.9936 (1.01) 0.0000 (1.0) 0;0 0.3341 (0.99) 1 1 test_get_url-get-url[2.45.0] 3.0002 (1.01) 3.0002 (1.01) 3.0002 (1.01) 0.0000 (1.0) 3.0002 (1.01) 0.0000 (1.0) 0;0 0.3333 (0.99) 1 1 test_get_url-get-url[main] 3.0923 (1.05) 3.0923 (1.05) 3.0923 (1.05) 0.0000 (1.0) 3.0923 (1.05) 0.0000 (1.0) 0;0 0.3234 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.11.0] 8.5778 (1.90) 8.5778 (1.90) 8.5778 (1.90) 0.0000 (1.0) 8.5778 (1.90) 0.0000 (1.0) 0;0 0.1166 (0.53) 1 1 test_sharing_s3-add[2.18.1] 7.1942 (1.59) 7.1942 (1.59) 7.1942 (1.59) 0.0000 (1.0) 7.1942 (1.59) 0.0000 (1.0) 0;0 0.1390 (0.63) 1 1 test_sharing_s3-add[2.39.0] 6.8194 (1.51) 6.8194 (1.51) 6.8194 (1.51) 0.0000 (1.0) 6.8194 (1.51) 0.0000 (1.0) 0;0 0.1466 (0.66) 1 1 test_sharing_s3-add[2.40.0] 7.1786 (1.59) 7.1786 (1.59) 7.1786 (1.59) 0.0000 (1.0) 7.1786 (1.59) 0.0000 (1.0) 0;0 0.1393 (0.63) 1 1 test_sharing_s3-add[2.41.1] 6.9126 (1.53) 6.9126 (1.53) 6.9126 (1.53) 0.0000 (1.0) 6.9126 (1.53) 0.0000 (1.0) 0;0 0.1447 (0.65) 1 1 test_sharing_s3-add[2.45.0] 4.5193 (1.0) 4.5193 (1.0) 4.5193 (1.0) 0.0000 (1.0) 4.5193 (1.0) 0.0000 (1.0) 0;0 0.2213 (1.0) 1 1 test_sharing_s3-add[main] 4.5697 (1.01) 4.5697 (1.01) 4.5697 (1.01) 0.0000 (1.0) 4.5697 (1.01) 0.0000 (1.0) 0;0 0.2188 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.11.0] 3.9995 (1.43) 3.9995 (1.43) 3.9995 (1.43) 0.0000 (1.0) 3.9995 (1.43) 0.0000 (1.0) 0;0 0.2500 (0.70) 1 1 test_sharing_s3-add-noop[2.18.1] 4.1514 (1.48) 4.1514 (1.48) 4.1514 (1.48) 0.0000 (1.0) 4.1514 (1.48) 0.0000 (1.0) 0;0 0.2409 (0.67) 1 1 test_sharing_s3-add-noop[2.39.0] 2.8010 (1.0) 2.8010 (1.0) 2.8010 (1.0) 0.0000 (1.0) 2.8010 (1.0) 0.0000 (1.0) 0;0 0.3570 (1.0) 1 1 test_sharing_s3-add-noop[2.40.0] 2.8092 (1.00) 2.8092 (1.00) 2.8092 (1.00) 0.0000 (1.0) 2.8092 (1.00) 0.0000 (1.0) 0;0 0.3560 (1.00) 1 1 test_sharing_s3-add-noop[2.41.1] 2.8911 (1.03) 2.8911 (1.03) 2.8911 (1.03) 0.0000 (1.0) 2.8911 (1.03) 0.0000 (1.0) 0;0 0.3459 (0.97) 1 1 test_sharing_s3-add-noop[2.45.0] 2.9648 (1.06) 2.9648 (1.06) 2.9648 (1.06) 0.0000 (1.0) 2.9648 (1.06) 0.0000 (1.0) 0;0 0.3373 (0.94) 1 1 test_sharing_s3-add-noop[main] 2.9574 (1.06) 2.9574 (1.06) 2.9574 (1.06) 0.0000 (1.0) 2.9574 (1.06) 0.0000 (1.0) 0;0 0.3381 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.11.0] 562.2599 (1.0) 562.2599 (1.0) 562.2599 (1.0) 0.0000 (1.0) 562.2599 (1.0) 0.0000 (1.0) 0;0 1.7785 (1.0) 1 1 test_sharing_s3-checkout-noop[2.18.1] 653.4981 (1.16) 653.4981 (1.16) 653.4981 (1.16) 0.0000 (1.0) 653.4981 (1.16) 0.0000 (1.0) 0;0 1.5302 (0.86) 1 1 test_sharing_s3-checkout-noop[2.39.0] 674.6182 (1.20) 674.6182 (1.20) 674.6182 (1.20) 0.0000 (1.0) 674.6182 (1.20) 0.0000 (1.0) 0;0 1.4823 (0.83) 1 1 test_sharing_s3-checkout-noop[2.40.0] 664.1451 (1.18) 664.1451 (1.18) 664.1451 (1.18) 0.0000 (1.0) 664.1451 (1.18) 0.0000 (1.0) 0;0 1.5057 (0.85) 1 1 test_sharing_s3-checkout-noop[2.41.1] 681.5706 (1.21) 681.5706 (1.21) 681.5706 (1.21) 0.0000 (1.0) 681.5706 (1.21) 0.0000 (1.0) 0;0 1.4672 (0.82) 1 1 test_sharing_s3-checkout-noop[2.45.0] 690.9473 (1.23) 690.9473 (1.23) 690.9473 (1.23) 0.0000 (1.0) 690.9473 (1.23) 0.0000 (1.0) 0;0 1.4473 (0.81) 1 1 test_sharing_s3-checkout-noop[main] 770.6754 (1.37) 770.6754 (1.37) 770.6754 (1.37) 0.0000 (1.0) 770.6754 (1.37) 0.0000 (1.0) 0;0 1.2976 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.11.0] 17.2237 (1.17) 17.2237 (1.17) 17.2237 (1.17) 0.0000 (1.0) 17.2237 (1.17) 0.0000 (1.0) 0;0 0.0581 (0.86) 1 1 test_sharing_s3-pull[2.18.1] 17.5096 (1.19) 17.5096 (1.19) 17.5096 (1.19) 0.0000 (1.0) 17.5096 (1.19) 0.0000 (1.0) 0;0 0.0571 (0.84) 1 1 test_sharing_s3-pull[2.39.0] 17.5323 (1.19) 17.5323 (1.19) 17.5323 (1.19) 0.0000 (1.0) 17.5323 (1.19) 0.0000 (1.0) 0;0 0.0570 (0.84) 1 1 test_sharing_s3-pull[2.40.0] 17.2689 (1.17) 17.2689 (1.17) 17.2689 (1.17) 0.0000 (1.0) 17.2689 (1.17) 0.0000 (1.0) 0;0 0.0579 (0.85) 1 1 test_sharing_s3-pull[2.41.1] 17.5562 (1.19) 17.5562 (1.19) 17.5562 (1.19) 0.0000 (1.0) 17.5562 (1.19) 0.0000 (1.0) 0;0 0.0570 (0.84) 1 1 test_sharing_s3-pull[2.45.0] 14.7833 (1.00) 14.7833 (1.00) 14.7833 (1.00) 0.0000 (1.0) 14.7833 (1.00) 0.0000 (1.0) 0;0 0.0676 (1.00) 1 1 test_sharing_s3-pull[main] 14.7588 (1.0) 14.7588 (1.0) 14.7588 (1.0) 0.0000 (1.0) 14.7588 (1.0) 0.0000 (1.0) 0;0 0.0678 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.11.0] 838.2567 (1.0) 838.2567 (1.0) 838.2567 (1.0) 0.0000 (1.0) 838.2567 (1.0) 0.0000 (1.0) 0;0 1.1930 (1.0) 1 1 test_sharing_s3-pull-noop[2.18.1] 928.0955 (1.11) 928.0955 (1.11) 928.0955 (1.11) 0.0000 (1.0) 928.0955 (1.11) 0.0000 (1.0) 0;0 1.0775 (0.90) 1 1 test_sharing_s3-pull-noop[2.39.0] 933.6744 (1.11) 933.6744 (1.11) 933.6744 (1.11) 0.0000 (1.0) 933.6744 (1.11) 0.0000 (1.0) 0;0 1.0710 (0.90) 1 1 test_sharing_s3-pull-noop[2.40.0] 929.3281 (1.11) 929.3281 (1.11) 929.3281 (1.11) 0.0000 (1.0) 929.3281 (1.11) 0.0000 (1.0) 0;0 1.0760 (0.90) 1 1 test_sharing_s3-pull-noop[2.41.1] 934.9332 (1.12) 934.9332 (1.12) 934.9332 (1.12) 0.0000 (1.0) 934.9332 (1.12) 0.0000 (1.0) 0;0 1.0696 (0.90) 1 1 test_sharing_s3-pull-noop[2.45.0] 969.6555 (1.16) 969.6555 (1.16) 969.6555 (1.16) 0.0000 (1.0) 969.6555 (1.16) 0.0000 (1.0) 0;0 1.0313 (0.86) 1 1 test_sharing_s3-pull-noop[main] 1,044.6701 (1.25) 1,044.6701 (1.25) 1,044.6701 (1.25) 0.0000 (1.0) 1,044.6701 (1.25) 0.0000 (1.0) 0;0 0.9572 (0.80) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.11.0] 26.0308 (2.44) 26.0308 (2.44) 26.0308 (2.44) 0.0000 (1.0) 26.0308 (2.44) 0.0000 (1.0) 0;0 0.0384 (0.41) 1 1 test_sharing_s3-push[2.18.1] 25.0934 (2.35) 25.0934 (2.35) 25.0934 (2.35) 0.0000 (1.0) 25.0934 (2.35) 0.0000 (1.0) 0;0 0.0399 (0.43) 1 1 test_sharing_s3-push[2.39.0] 25.9720 (2.43) 25.9720 (2.43) 25.9720 (2.43) 0.0000 (1.0) 25.9720 (2.43) 0.0000 (1.0) 0;0 0.0385 (0.41) 1 1 test_sharing_s3-push[2.40.0] 26.1149 (2.45) 26.1149 (2.45) 26.1149 (2.45) 0.0000 (1.0) 26.1149 (2.45) 0.0000 (1.0) 0;0 0.0383 (0.41) 1 1 test_sharing_s3-push[2.41.1] 14.2137 (1.33) 14.2137 (1.33) 14.2137 (1.33) 0.0000 (1.0) 14.2137 (1.33) 0.0000 (1.0) 0;0 0.0704 (0.75) 1 1 test_sharing_s3-push[2.45.0] 10.7374 (1.01) 10.7374 (1.01) 10.7374 (1.01) 0.0000 (1.0) 10.7374 (1.01) 0.0000 (1.0) 0;0 0.0931 (0.99) 1 1 test_sharing_s3-push[main] 10.6695 (1.0) 10.6695 (1.0) 10.6695 (1.0) 0.0000 (1.0) 10.6695 (1.0) 0.0000 (1.0) 0;0 0.0937 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-push-noop[2.11.0] 1.1079 (1.0) 1.1079 (1.0) 1.1079 (1.0) 0.0000 (1.0) 1.1079 (1.0) 0.0000 (1.0) 0;0 0.9026 (1.0) 1 1 test_sharing_s3-push-noop[2.18.1] 1.1687 (1.05) 1.1687 (1.05) 1.1687 (1.05) 0.0000 (1.0) 1.1687 (1.05) 0.0000 (1.0) 0;0 0.8556 (0.95) 1 1 test_sharing_s3-push-noop[2.39.0] 1.1384 (1.03) 1.1384 (1.03) 1.1384 (1.03) 0.0000 (1.0) 1.1384 (1.03) 0.0000 (1.0) 0;0 0.8785 (0.97) 1 1 test_sharing_s3-push-noop[2.40.0] 1.1352 (1.02) 1.1352 (1.02) 1.1352 (1.02) 0.0000 (1.0) 1.1352 (1.02) 0.0000 (1.0) 0;0 0.8809 (0.98) 1 1 test_sharing_s3-push-noop[2.41.1] 1.1483 (1.04) 1.1483 (1.04) 1.1483 (1.04) 0.0000 (1.0) 1.1483 (1.04) 0.0000 (1.0) 0;0 0.8708 (0.96) 1 1 test_sharing_s3-push-noop[2.45.0] 1.1475 (1.04) 1.1475 (1.04) 1.1475 (1.04) 0.0000 (1.0) 1.1475 (1.04) 0.0000 (1.0) 0;0 0.8715 (0.97) 1 1 test_sharing_s3-push-noop[main] 1.2441 (1.12) 1.2441 (1.12) 1.2441 (1.12) 0.0000 (1.0) 1.2441 (1.12) 0.0000 (1.0) 0;0 0.8038 (0.89) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.11.0] 18.2860 (1.43) 18.2860 (1.43) 18.2860 (1.43) 0.0000 (1.0) 18.2860 (1.43) 0.0000 (1.0) 0;0 0.0547 (0.70) 1 1 test_import_url-import-url[2.18.1] 16.1234 (1.26) 16.1234 (1.26) 16.1234 (1.26) 0.0000 (1.0) 16.1234 (1.26) 0.0000 (1.0) 0;0 0.0620 (0.80) 1 1 test_import_url-import-url[2.39.0] 16.1775 (1.26) 16.1775 (1.26) 16.1775 (1.26) 0.0000 (1.0) 16.1775 (1.26) 0.0000 (1.0) 0;0 0.0618 (0.79) 1 1 test_import_url-import-url[2.40.0] 16.1910 (1.26) 16.1910 (1.26) 16.1910 (1.26) 0.0000 (1.0) 16.1910 (1.26) 0.0000 (1.0) 0;0 0.0618 (0.79) 1 1 test_import_url-import-url[2.41.1] 15.6411 (1.22) 15.6411 (1.22) 15.6411 (1.22) 0.0000 (1.0) 15.6411 (1.22) 0.0000 (1.0) 0;0 0.0639 (0.82) 1 1 test_import_url-import-url[2.45.0] 12.8822 (1.00) 12.8822 (1.00) 12.8822 (1.00) 0.0000 (1.0) 12.8822 (1.00) 0.0000 (1.0) 0;0 0.0776 (1.00) 1 1 test_import_url-import-url[main] 12.8201 (1.0) 12.8201 (1.0) 12.8201 (1.0) 0.0000 (1.0) 12.8201 (1.0) 0.0000 (1.0) 0;0 0.0780 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.11.0] 2.2874 (1.65) 2.2874 (1.65) 2.2874 (1.65) 0.0000 (1.0) 2.2874 (1.65) 0.0000 (1.0) 0;0 0.4372 (0.61) 1 1 test_status-status[2.18.1] 1.4258 (1.03) 1.4258 (1.03) 1.4258 (1.03) 0.0000 (1.0) 1.4258 (1.03) 0.0000 (1.0) 0;0 0.7014 (0.97) 1 1 test_status-status[2.39.0] 1.4229 (1.03) 1.4229 (1.03) 1.4229 (1.03) 0.0000 (1.0) 1.4229 (1.03) 0.0000 (1.0) 0;0 0.7028 (0.97) 1 1 test_status-status[2.40.0] 1.4128 (1.02) 1.4128 (1.02) 1.4128 (1.02) 0.0000 (1.0) 1.4128 (1.02) 0.0000 (1.0) 0;0 0.7078 (0.98) 1 1 test_status-status[2.41.1] 1.3997 (1.01) 1.3997 (1.01) 1.3997 (1.01) 0.0000 (1.0) 1.3997 (1.01) 0.0000 (1.0) 0;0 0.7144 (0.99) 1 1 test_status-status[2.45.0] 1.3867 (1.0) 1.3867 (1.0) 1.3867 (1.0) 0.0000 (1.0) 1.3867 (1.0) 0.0000 (1.0) 0;0 0.7211 (1.0) 1 1 test_status-status[main] 1.4497 (1.05) 1.4497 (1.05) 1.4497 (1.05) 0.0000 (1.0) 1.4497 (1.05) 0.0000 (1.0) 0;0 0.6898 (0.96) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_status-status-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.11.0] 1.6380 (2.98) 1.6380 (2.98) 1.6380 (2.98) 0.0000 (1.0) 1.6380 (2.98) 0.0000 (1.0) 0;0 0.6105 (0.34) 1 1 test_status-status-changed[2.18.1] 0.5494 (1.0) 0.5494 (1.0) 0.5494 (1.0) 0.0000 (1.0) 0.5494 (1.0) 0.0000 (1.0) 0;0 1.8200 (1.0) 1 1 test_status-status-changed[2.39.0] 0.5517 (1.00) 0.5517 (1.00) 0.5517 (1.00) 0.0000 (1.0) 0.5517 (1.00) 0.0000 (1.0) 0;0 1.8124 (1.00) 1 1 test_status-status-changed[2.40.0] 0.9542 (1.74) 0.9542 (1.74) 0.9542 (1.74) 0.0000 (1.0) 0.9542 (1.74) 0.0000 (1.0) 0;0 1.0480 (0.58) 1 1 test_status-status-changed[2.41.1] 0.5543 (1.01) 0.5543 (1.01) 0.5543 (1.01) 0.0000 (1.0) 0.5543 (1.01) 0.0000 (1.0) 0;0 1.8040 (0.99) 1 1 test_status-status-changed[2.45.0] 0.5772 (1.05) 0.5772 (1.05) 0.5772 (1.05) 0.0000 (1.0) 0.5772 (1.05) 0.0000 (1.0) 0;0 1.7324 (0.95) 1 1 test_status-status-changed[main] 0.6605 (1.20) 0.6605 (1.20) 0.6605 (1.20) 0.0000 (1.0) 0.6605 (1.20) 0.0000 (1.0) 0;0 1.5140 (0.83) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.11.0] 708.3187 (1.30) 708.3187 (1.30) 708.3187 (1.30) 0.0000 (1.0) 708.3187 (1.30) 0.0000 (1.0) 0;0 1.4118 (0.77) 1 1 test_status-status-changed-noop[2.18.1] 550.0464 (1.01) 550.0464 (1.01) 550.0464 (1.01) 0.0000 (1.0) 550.0464 (1.01) 0.0000 (1.0) 0;0 1.8180 (0.99) 1 1 test_status-status-changed-noop[2.39.0] 553.2956 (1.01) 553.2956 (1.01) 553.2956 (1.01) 0.0000 (1.0) 553.2956 (1.01) 0.0000 (1.0) 0;0 1.8074 (0.99) 1 1 test_status-status-changed-noop[2.40.0] 547.4246 (1.00) 547.4246 (1.00) 547.4246 (1.00) 0.0000 (1.0) 547.4246 (1.00) 0.0000 (1.0) 0;0 1.8267 (1.00) 1 1 test_status-status-changed-noop[2.41.1] 545.1363 (1.0) 545.1363 (1.0) 545.1363 (1.0) 0.0000 (1.0) 545.1363 (1.0) 0.0000 (1.0) 0;0 1.8344 (1.0) 1 1 test_status-status-changed-noop[2.45.0] 586.8187 (1.08) 586.8187 (1.08) 586.8187 (1.08) 0.0000 (1.0) 586.8187 (1.08) 0.0000 (1.0) 0;0 1.7041 (0.93) 1 1 test_status-status-changed-noop[main] 649.7508 (1.19) 649.7508 (1.19) 649.7508 (1.19) 0.0000 (1.0) 649.7508 (1.19) 0.0000 (1.0) 0;0 1.5391 (0.84) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.11.0] 464.9523 (1.0) 464.9523 (1.0) 464.9523 (1.0) 0.0000 (1.0) 464.9523 (1.0) 0.0000 (1.0) 0;0 2.1508 (1.0) 1 1 test_status-status-noop[2.18.1] 539.3364 (1.16) 539.3364 (1.16) 539.3364 (1.16) 0.0000 (1.0) 539.3364 (1.16) 0.0000 (1.0) 0;0 1.8541 (0.86) 1 1 test_status-status-noop[2.39.0] 557.5474 (1.20) 557.5474 (1.20) 557.5474 (1.20) 0.0000 (1.0) 557.5474 (1.20) 0.0000 (1.0) 0;0 1.7936 (0.83) 1 1 test_status-status-noop[2.40.0] 550.0905 (1.18) 550.0905 (1.18) 550.0905 (1.18) 0.0000 (1.0) 550.0905 (1.18) 0.0000 (1.0) 0;0 1.8179 (0.85) 1 1 test_status-status-noop[2.41.1] 550.0444 (1.18) 550.0444 (1.18) 550.0444 (1.18) 0.0000 (1.0) 550.0444 (1.18) 0.0000 (1.0) 0;0 1.8180 (0.85) 1 1 test_status-status-noop[2.45.0] 584.2789 (1.26) 584.2789 (1.26) 584.2789 (1.26) 0.0000 (1.0) 584.2789 (1.26) 0.0000 (1.0) 0;0 1.7115 (0.80) 1 1 test_status-status-noop[main] 659.1645 (1.42) 659.1645 (1.42) 659.1645 (1.42) 0.0000 (1.0) 659.1645 (1.42) 0.0000 (1.0) 0;0 1.5171 (0.71) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_pull-pull': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_pull-pull[2.11.0] 7.0979 (1.03) 7.0979 (1.03) 7.0979 (1.03) 0.0000 (1.0) 7.0979 (1.03) 0.0000 (1.0) 0;0 0.1409 (0.97) 1 1 test_pull-pull[2.18.1] 7.2289 (1.05) 7.2289 (1.05) 7.2289 (1.05) 0.0000 (1.0) 7.2289 (1.05) 0.0000 (1.0) 0;0 0.1383 (0.95) 1 1 test_pull-pull[2.39.0] 8.8575 (1.29) 8.8575 (1.29) 8.8575 (1.29) 0.0000 (1.0) 8.8575 (1.29) 0.0000 (1.0) 0;0 0.1129 (0.78) 1 1 test_pull-pull[2.40.0] 8.5704 (1.24) 8.5704 (1.24) 8.5704 (1.24) 0.0000 (1.0) 8.5704 (1.24) 0.0000 (1.0) 0;0 0.1167 (0.80) 1 1 test_pull-pull[2.41.1] 8.6271 (1.25) 8.6271 (1.25) 8.6271 (1.25) 0.0000 (1.0) 8.6271 (1.25) 0.0000 (1.0) 0;0 0.1159 (0.80) 1 1 test_pull-pull[2.45.0] 6.9023 (1.00) 6.9023 (1.00) 6.9023 (1.00) 0.0000 (1.0) 6.9023 (1.00) 0.0000 (1.0) 0;0 0.1449 (1.00) 1 1 test_pull-pull[main] 6.8916 (1.0) 6.8916 (1.0) 6.8916 (1.0) 0.0000 (1.0) 6.8916 (1.0) 0.0000 (1.0) 0;0 0.1451 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[2.11.0] 8.6671 (1.87) 8.6671 (1.87) 8.6671 (1.87) 0.0000 (1.0) 8.6671 (1.87) 0.0000 (1.0) 0;0 0.1154 (0.53) 1 1 test_add-add[2.18.1] 7.5512 (1.63) 7.5512 (1.63) 7.5512 (1.63) 0.0000 (1.0) 7.5512 (1.63) 0.0000 (1.0) 0;0 0.1324 (0.61) 1 1 test_add-add[2.39.0] 7.0253 (1.52) 7.0253 (1.52) 7.0253 (1.52) 0.0000 (1.0) 7.0253 (1.52) 0.0000 (1.0) 0;0 0.1423 (0.66) 1 1 test_add-add[2.40.0] 7.1625 (1.55) 7.1625 (1.55) 7.1625 (1.55) 0.0000 (1.0) 7.1625 (1.55) 0.0000 (1.0) 0;0 0.1396 (0.65) 1 1 test_add-add[2.41.1] 6.9555 (1.50) 6.9555 (1.50) 6.9555 (1.50) 0.0000 (1.0) 6.9555 (1.50) 0.0000 (1.0) 0;0 0.1438 (0.67) 1 1 test_add-add[2.45.0] 4.9004 (1.06) 4.9004 (1.06) 4.9004 (1.06) 0.0000 (1.0) 4.9004 (1.06) 0.0000 (1.0) 0;0 0.2041 (0.94) 1 1 test_add-add[main] 4.6300 (1.0) 4.6300 (1.0) 4.6300 (1.0) 0.0000 (1.0) 4.6300 (1.0) 0.0000 (1.0) 0;0 0.2160 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_init-init': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.11.0] 328.4205 (1.0) 349.4095 (1.0) 336.1097 (1.0) 3.7699 (1.0) 335.6634 (1.0) 4.5487 (1.0) 28;3 2.9752 (1.0) 100 1 test_init-init[2.18.1] 338.6258 (1.03) 438.1812 (1.25) 348.0544 (1.04) 9.7878 (2.60) 346.7839 (1.03) 4.9811 (1.10) 1;1 2.8731 (0.97) 100 1 test_init-init[2.39.0] 389.8137 (1.19) 425.7928 (1.22) 401.8090 (1.20) 5.1400 (1.36) 401.6169 (1.20) 6.6843 (1.47) 22;1 2.4887 (0.84) 100 1 test_init-init[2.40.0] 395.2683 (1.20) 459.4195 (1.31) 404.4920 (1.20) 7.6885 (2.04) 403.1130 (1.20) 7.9530 (1.75) 9;2 2.4722 (0.83) 100 1 test_init-init[2.41.1] 390.0270 (1.19) 433.4282 (1.24) 399.8525 (1.19) 5.8856 (1.56) 398.9839 (1.19) 6.5216 (1.43) 16;3 2.5009 (0.84) 100 1 test_init-init[2.45.0] 394.7832 (1.20) 414.2710 (1.19) 404.0203 (1.20) 4.4811 (1.19) 404.0610 (1.20) 6.6861 (1.47) 41;0 2.4751 (0.83) 100 1 test_init-init[main] 488.4540 (1.49) 515.9719 (1.48) 499.1552 (1.49) 6.1783 (1.64) 498.6582 (1.49) 8.7970 (1.93) 34;0 2.0034 (0.67) 100 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.11.0] 4.0491 (1.15) 4.0491 (1.15) 4.0491 (1.15) 0.0000 (1.0) 4.0491 (1.15) 0.0000 (1.0) 0;0 0.2470 (0.87) 1 1 test_push-push[2.18.1] 4.0305 (1.15) 4.0305 (1.15) 4.0305 (1.15) 0.0000 (1.0) 4.0305 (1.15) 0.0000 (1.0) 0;0 0.2481 (0.87) 1 1 test_push-push[2.39.0] 5.1688 (1.47) 5.1688 (1.47) 5.1688 (1.47) 0.0000 (1.0) 5.1688 (1.47) 0.0000 (1.0) 0;0 0.1935 (0.68) 1 1 test_push-push[2.40.0] 5.0481 (1.44) 5.0481 (1.44) 5.0481 (1.44) 0.0000 (1.0) 5.0481 (1.44) 0.0000 (1.0) 0;0 0.1981 (0.70) 1 1 test_push-push[2.41.1] 5.0241 (1.43) 5.0241 (1.43) 5.0241 (1.43) 0.0000 (1.0) 5.0241 (1.43) 0.0000 (1.0) 0;0 0.1990 (0.70) 1 1 test_push-push[2.45.0] 3.5877 (1.02) 3.5877 (1.02) 3.5877 (1.02) 0.0000 (1.0) 3.5877 (1.02) 0.0000 (1.0) 0;0 0.2787 (0.98) 1 1 test_push-push[main] 3.5107 (1.0) 3.5107 (1.0) 3.5107 (1.0) 0.0000 (1.0) 3.5107 (1.0) 0.0000 (1.0) 0;0 0.2848 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.11.0] 1.7534 (1.01) 1.7534 (1.01) 1.7534 (1.01) 0.0000 (1.0) 1.7534 (1.01) 0.0000 (1.0) 0;0 0.5703 (0.99) 1 1 test_checkout_hardlink-checkout[2.18.1] 1.7994 (1.04) 1.7994 (1.04) 1.7994 (1.04) 0.0000 (1.0) 1.7994 (1.04) 0.0000 (1.0) 0;0 0.5557 (0.96) 1 1 test_checkout_hardlink-checkout[2.39.0] 1.7561 (1.01) 1.7561 (1.01) 1.7561 (1.01) 0.0000 (1.0) 1.7561 (1.01) 0.0000 (1.0) 0;0 0.5695 (0.99) 1 1 test_checkout_hardlink-checkout[2.40.0] 1.7363 (1.0) 1.7363 (1.0) 1.7363 (1.0) 0.0000 (1.0) 1.7363 (1.0) 0.0000 (1.0) 0;0 0.5759 (1.0) 1 1 test_checkout_hardlink-checkout[2.41.1] 1.7384 (1.00) 1.7384 (1.00) 1.7384 (1.00) 0.0000 (1.0) 1.7384 (1.00) 0.0000 (1.0) 0;0 0.5752 (1.00) 1 1 test_checkout_hardlink-checkout[2.45.0] 2.1930 (1.26) 2.1930 (1.26) 2.1930 (1.26) 0.0000 (1.0) 2.1930 (1.26) 0.0000 (1.0) 0;0 0.4560 (0.79) 1 1 test_checkout_hardlink-checkout[main] 2.2401 (1.29) 2.2401 (1.29) 2.2401 (1.29) 0.0000 (1.0) 2.2401 (1.29) 0.0000 (1.0) 0;0 0.4464 (0.78) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.11.0] 654.5669 (1.0) 654.5669 (1.0) 654.5669 (1.0) 0.0000 (1.0) 654.5669 (1.0) 0.0000 (1.0) 0;0 1.5277 (1.0) 1 1 test_checkout_hardlink-checkout-noop[2.18.1] 820.6157 (1.25) 820.6157 (1.25) 820.6157 (1.25) 0.0000 (1.0) 820.6157 (1.25) 0.0000 (1.0) 0;0 1.2186 (0.80) 1 1 test_checkout_hardlink-checkout-noop[2.39.0] 854.9677 (1.31) 854.9677 (1.31) 854.9677 (1.31) 0.0000 (1.0) 854.9677 (1.31) 0.0000 (1.0) 0;0 1.1696 (0.77) 1 1 test_checkout_hardlink-checkout-noop[2.40.0] 783.9933 (1.20) 783.9933 (1.20) 783.9933 (1.20) 0.0000 (1.0) 783.9933 (1.20) 0.0000 (1.0) 0;0 1.2755 (0.83) 1 1 test_checkout_hardlink-checkout-noop[2.41.1] 781.6880 (1.19) 781.6880 (1.19) 781.6880 (1.19) 0.0000 (1.0) 781.6880 (1.19) 0.0000 (1.0) 0;0 1.2793 (0.84) 1 1 test_checkout_hardlink-checkout-noop[2.45.0] 860.2310 (1.31) 860.2310 (1.31) 860.2310 (1.31) 0.0000 (1.0) 860.2310 (1.31) 0.0000 (1.0) 0;0 1.1625 (0.76) 1 1 test_checkout_hardlink-checkout-noop[main] 968.4061 (1.48) 968.4061 (1.48) 968.4061 (1.48) 0.0000 (1.0) 968.4061 (1.48) 0.0000 (1.0) 0;0 1.0326 (0.68) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.11.0] 1.8521 (2.14) 1.8521 (2.14) 1.8521 (2.14) 0.0000 (1.0) 1.8521 (2.14) 0.0000 (1.0) 0;0 0.5399 (0.47) 1 1 test_checkout_hardlink-checkout-update[2.18.1] 0.9033 (1.04) 0.9033 (1.04) 0.9033 (1.04) 0.0000 (1.0) 0.9033 (1.04) 0.0000 (1.0) 0;0 1.1070 (0.96) 1 1 test_checkout_hardlink-checkout-update[2.39.0] 0.9232 (1.07) 0.9232 (1.07) 0.9232 (1.07) 0.0000 (1.0) 0.9232 (1.07) 0.0000 (1.0) 0;0 1.0832 (0.94) 1 1 test_checkout_hardlink-checkout-update[2.40.0] 0.8645 (1.0) 0.8645 (1.0) 0.8645 (1.0) 0.0000 (1.0) 0.8645 (1.0) 0.0000 (1.0) 0;0 1.1568 (1.0) 1 1 test_checkout_hardlink-checkout-update[2.41.1] 0.8767 (1.01) 0.8767 (1.01) 0.8767 (1.01) 0.0000 (1.0) 0.8767 (1.01) 0.0000 (1.0) 0;0 1.1406 (0.99) 1 1 test_checkout_hardlink-checkout-update[2.45.0] 0.9177 (1.06) 0.9177 (1.06) 0.9177 (1.06) 0.0000 (1.0) 0.9177 (1.06) 0.0000 (1.0) 0;0 1.0897 (0.94) 1 1 test_checkout_hardlink-checkout-update[main] 1.0117 (1.17) 1.0117 (1.17) 1.0117 (1.17) 0.0000 (1.0) 1.0117 (1.17) 0.0000 (1.0) 0;0 0.9885 (0.85) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.11.0] 8.2427 (1.36) 8.2427 (1.36) 8.2427 (1.36) 0.0000 (1.0) 8.2427 (1.36) 0.0000 (1.0) 0;0 0.1213 (0.73) 1 1 test_update-update[2.18.1] 7.3952 (1.22) 7.3952 (1.22) 7.3952 (1.22) 0.0000 (1.0) 7.3952 (1.22) 0.0000 (1.0) 0;0 0.1352 (0.82) 1 1 test_update-update[2.39.0] 6.5512 (1.08) 6.5512 (1.08) 6.5512 (1.08) 0.0000 (1.0) 6.5512 (1.08) 0.0000 (1.0) 0;0 0.1526 (0.92) 1 1 test_update-update[2.40.0] 6.5442 (1.08) 6.5442 (1.08) 6.5442 (1.08) 0.0000 (1.0) 6.5442 (1.08) 0.0000 (1.0) 0;0 0.1528 (0.93) 1 1 test_update-update[2.41.1] 6.5231 (1.08) 6.5231 (1.08) 6.5231 (1.08) 0.0000 (1.0) 6.5231 (1.08) 0.0000 (1.0) 0;0 0.1533 (0.93) 1 1 test_update-update[2.45.0] 6.6466 (1.10) 6.6466 (1.10) 6.6466 (1.10) 0.0000 (1.0) 6.6466 (1.10) 0.0000 (1.0) 0;0 0.1505 (0.91) 1 1 test_update-update[main] 6.0558 (1.0) 6.0558 (1.0) 6.0558 (1.0) 0.0000 (1.0) 6.0558 (1.0) 0.0000 (1.0) 0;0 0.1651 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update-noop[2.11.0] 462.0999 (1.0) 462.0999 (1.0) 462.0999 (1.0) 0.0000 (1.0) 462.0999 (1.0) 0.0000 (1.0) 0;0 2.1640 (1.0) 1 1 test_update-update-noop[2.18.1] 598.5188 (1.30) 598.5188 (1.30) 598.5188 (1.30) 0.0000 (1.0) 598.5188 (1.30) 0.0000 (1.0) 0;0 1.6708 (0.77) 1 1 test_update-update-noop[2.39.0] 876.0333 (1.90) 876.0333 (1.90) 876.0333 (1.90) 0.0000 (1.0) 876.0333 (1.90) 0.0000 (1.0) 0;0 1.1415 (0.53) 1 1 test_update-update-noop[2.40.0] 873.5569 (1.89) 873.5569 (1.89) 873.5569 (1.89) 0.0000 (1.0) 873.5569 (1.89) 0.0000 (1.0) 0;0 1.1447 (0.53) 1 1 test_update-update-noop[2.41.1] 867.2912 (1.88) 867.2912 (1.88) 867.2912 (1.88) 0.0000 (1.0) 867.2912 (1.88) 0.0000 (1.0) 0;0 1.1530 (0.53) 1 1 test_update-update-noop[2.45.0] 984.1368 (2.13) 984.1368 (2.13) 984.1368 (2.13) 0.0000 (1.0) 984.1368 (2.13) 0.0000 (1.0) 0;0 1.0161 (0.47) 1 1 test_update-update-noop[main] 1,051.1290 (2.27) 1,051.1290 (2.27) 1,051.1290 (2.27) 0.0000 (1.0) 1,051.1290 (2.27) 0.0000 (1.0) 0;0 0.9514 (0.44) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.18.1] 671.2916 (1.0) 671.2916 (1.0) 671.2916 (1.0) 0.0000 (1.0) 671.2916 (1.0) 0.0000 (1.0) 0;0 1.4897 (1.0) 1 1 test_data_status-data-changed[2.39.0] 752.4670 (1.12) 752.4670 (1.12) 752.4670 (1.12) 0.0000 (1.0) 752.4670 (1.12) 0.0000 (1.0) 0;0 1.3290 (0.89) 1 1 test_data_status-data-changed[2.40.0] 721.6312 (1.07) 721.6312 (1.07) 721.6312 (1.07) 0.0000 (1.0) 721.6312 (1.07) 0.0000 (1.0) 0;0 1.3857 (0.93) 1 1 test_data_status-data-changed[2.41.1] 735.5183 (1.10) 735.5183 (1.10) 735.5183 (1.10) 0.0000 (1.0) 735.5183 (1.10) 0.0000 (1.0) 0;0 1.3596 (0.91) 1 1 test_data_status-data-changed[2.45.0] 677.9807 (1.01) 677.9807 (1.01) 677.9807 (1.01) 0.0000 (1.0) 677.9807 (1.01) 0.0000 (1.0) 0;0 1.4750 (0.99) 1 1 test_data_status-data-changed[main] 741.3499 (1.10) 741.3499 (1.10) 741.3499 (1.10) 0.0000 (1.0) 741.3499 (1.10) 0.0000 (1.0) 0;0 1.3489 (0.91) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.18.1] 678.7075 (1.0) 678.7075 (1.0) 678.7075 (1.0) 0.0000 (1.0) 678.7075 (1.0) 0.0000 (1.0) 0;0 1.4734 (1.0) 1 1 test_data_status-data-changed-noop[2.39.0] 725.4521 (1.07) 725.4521 (1.07) 725.4521 (1.07) 0.0000 (1.0) 725.4521 (1.07) 0.0000 (1.0) 0;0 1.3785 (0.94) 1 1 test_data_status-data-changed-noop[2.40.0] 707.1210 (1.04) 707.1210 (1.04) 707.1210 (1.04) 0.0000 (1.0) 707.1210 (1.04) 0.0000 (1.0) 0;0 1.4142 (0.96) 1 1 test_data_status-data-changed-noop[2.41.1] 720.1761 (1.06) 720.1761 (1.06) 720.1761 (1.06) 0.0000 (1.0) 720.1761 (1.06) 0.0000 (1.0) 0;0 1.3885 (0.94) 1 1 test_data_status-data-changed-noop[2.45.0] 681.2221 (1.00) 681.2221 (1.00) 681.2221 (1.00) 0.0000 (1.0) 681.2221 (1.00) 0.0000 (1.0) 0;0 1.4679 (1.00) 1 1 test_data_status-data-changed-noop[main] 769.9814 (1.13) 769.9814 (1.13) 769.9814 (1.13) 0.0000 (1.0) 769.9814 (1.13) 0.0000 (1.0) 0;0 1.2987 (0.88) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.18.1] 1.6577 (1.08) 1.6577 (1.08) 1.6577 (1.08) 0.0000 (1.0) 1.6577 (1.08) 0.0000 (1.0) 0;0 0.6032 (0.93) 1 1 test_data_status-data-new[2.39.0] 1.8747 (1.22) 1.8747 (1.22) 1.8747 (1.22) 0.0000 (1.0) 1.8747 (1.22) 0.0000 (1.0) 0;0 0.5334 (0.82) 1 1 test_data_status-data-new[2.40.0] 2.1822 (1.42) 2.1822 (1.42) 2.1822 (1.42) 0.0000 (1.0) 2.1822 (1.42) 0.0000 (1.0) 0;0 0.4583 (0.71) 1 1 test_data_status-data-new[2.41.1] 2.1717 (1.41) 2.1717 (1.41) 2.1717 (1.41) 0.0000 (1.0) 2.1717 (1.41) 0.0000 (1.0) 0;0 0.4605 (0.71) 1 1 test_data_status-data-new[2.45.0] 1.5409 (1.0) 1.5409 (1.0) 1.5409 (1.0) 0.0000 (1.0) 1.5409 (1.0) 0.0000 (1.0) 0;0 0.6490 (1.0) 1 1 test_data_status-data-new[main] 1.5931 (1.03) 1.5931 (1.03) 1.5931 (1.03) 0.0000 (1.0) 1.5931 (1.03) 0.0000 (1.0) 0;0 0.6277 (0.97) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.18.1] 724.9953 (1.08) 724.9953 (1.08) 724.9953 (1.08) 0.0000 (1.0) 724.9953 (1.08) 0.0000 (1.0) 0;0 1.3793 (0.92) 1 1 test_data_status-data-noop[2.39.0] 721.8572 (1.08) 721.8572 (1.08) 721.8572 (1.08) 0.0000 (1.0) 721.8572 (1.08) 0.0000 (1.0) 0;0 1.3853 (0.93) 1 1 test_data_status-data-noop[2.40.0] 719.8939 (1.08) 719.8939 (1.08) 719.8939 (1.08) 0.0000 (1.0) 719.8939 (1.08) 0.0000 (1.0) 0;0 1.3891 (0.93) 1 1 test_data_status-data-noop[2.41.1] 737.1885 (1.10) 737.1885 (1.10) 737.1885 (1.10) 0.0000 (1.0) 737.1885 (1.10) 0.0000 (1.0) 0;0 1.3565 (0.91) 1 1 test_data_status-data-noop[2.45.0] 668.8574 (1.0) 668.8574 (1.0) 668.8574 (1.0) 0.0000 (1.0) 668.8574 (1.0) 0.0000 (1.0) 0;0 1.4951 (1.0) 1 1 test_data_status-data-noop[main] 750.9268 (1.12) 750.9268 (1.12) 750.9268 (1.12) 0.0000 (1.0) 750.9268 (1.12) 0.0000 (1.0) 0;0 1.3317 (0.89) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.11.0] 3.6085 (1.14) 3.6085 (1.14) 3.6085 (1.14) 0.0000 (1.0) 3.6085 (1.14) 0.0000 (1.0) 0;0 0.2771 (0.88) 1 1 test_exp_show-exp[2.18.1] 3.5814 (1.13) 3.5814 (1.13) 3.5814 (1.13) 0.0000 (1.0) 3.5814 (1.13) 0.0000 (1.0) 0;0 0.2792 (0.89) 1 1 test_exp_show-exp[2.39.0] 3.1852 (1.00) 3.1852 (1.00) 3.1852 (1.00) 0.0000 (1.0) 3.1852 (1.00) 0.0000 (1.0) 0;0 0.3140 (1.00) 1 1 test_exp_show-exp[2.40.0] 3.2068 (1.01) 3.2068 (1.01) 3.2068 (1.01) 0.0000 (1.0) 3.2068 (1.01) 0.0000 (1.0) 0;0 0.3118 (0.99) 1 1 test_exp_show-exp[2.41.1] 3.1776 (1.0) 3.1776 (1.0) 3.1776 (1.0) 0.0000 (1.0) 3.1776 (1.0) 0.0000 (1.0) 0;0 0.3147 (1.0) 1 1 test_exp_show-exp[2.45.0] 3.3083 (1.04) 3.3083 (1.04) 3.3083 (1.04) 0.0000 (1.0) 3.3083 (1.04) 0.0000 (1.0) 0;0 0.3023 (0.96) 1 1 test_exp_show-exp[main] 4.0666 (1.28) 4.0666 (1.28) 4.0666 (1.28) 0.0000 (1.0) 4.0666 (1.28) 0.0000 (1.0) 0;0 0.2459 (0.78) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.11.0] 426.7697 (1.09) 426.7697 (1.09) 426.7697 (1.09) 0.0000 (1.0) 426.7697 (1.09) 0.0000 (1.0) 0;0 2.3432 (0.92) 1 1 test_list-list[2.18.1] 392.4574 (1.0) 392.4574 (1.0) 392.4574 (1.0) 0.0000 (1.0) 392.4574 (1.0) 0.0000 (1.0) 0;0 2.5480 (1.0) 1 1 test_list-list[2.39.0] 418.1877 (1.07) 418.1877 (1.07) 418.1877 (1.07) 0.0000 (1.0) 418.1877 (1.07) 0.0000 (1.0) 0;0 2.3913 (0.94) 1 1 test_list-list[2.40.0] 423.8380 (1.08) 423.8380 (1.08) 423.8380 (1.08) 0.0000 (1.0) 423.8380 (1.08) 0.0000 (1.0) 0;0 2.3594 (0.93) 1 1 test_list-list[2.41.1] 418.5279 (1.07) 418.5279 (1.07) 418.5279 (1.07) 0.0000 (1.0) 418.5279 (1.07) 0.0000 (1.0) 0;0 2.3893 (0.94) 1 1 test_list-list[2.45.0] 439.8361 (1.12) 439.8361 (1.12) 439.8361 (1.12) 0.0000 (1.0) 439.8361 (1.12) 0.0000 (1.0) 0;0 2.2736 (0.89) 1 1 test_list-list[main] 524.1066 (1.34) 524.1066 (1.34) 524.1066 (1.34) 0.0000 (1.0) 524.1066 (1.34) 0.0000 (1.0) 0;0 1.9080 (0.75) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.11.0] 419.9170 (1.11) 419.9170 (1.11) 419.9170 (1.11) 0.0000 (1.0) 419.9170 (1.11) 0.0000 (1.0) 0;0 2.3814 (0.90) 1 1 test_list-list-dvc-only[2.18.1] 377.0539 (1.0) 377.0539 (1.0) 377.0539 (1.0) 0.0000 (1.0) 377.0539 (1.0) 0.0000 (1.0) 0;0 2.6521 (1.0) 1 1 test_list-list-dvc-only[2.39.0] 402.6995 (1.07) 402.6995 (1.07) 402.6995 (1.07) 0.0000 (1.0) 402.6995 (1.07) 0.0000 (1.0) 0;0 2.4832 (0.94) 1 1 test_list-list-dvc-only[2.40.0] 408.9387 (1.08) 408.9387 (1.08) 408.9387 (1.08) 0.0000 (1.0) 408.9387 (1.08) 0.0000 (1.0) 0;0 2.4454 (0.92) 1 1 test_list-list-dvc-only[2.41.1] 406.6598 (1.08) 406.6598 (1.08) 406.6598 (1.08) 0.0000 (1.0) 406.6598 (1.08) 0.0000 (1.0) 0;0 2.4591 (0.93) 1 1 test_list-list-dvc-only[2.45.0] 424.9447 (1.13) 424.9447 (1.13) 424.9447 (1.13) 0.0000 (1.0) 424.9447 (1.13) 0.0000 (1.0) 0;0 2.3532 (0.89) 1 1 test_list-list-dvc-only[main] 509.0721 (1.35) 509.0721 (1.35) 509.0721 (1.35) 0.0000 (1.0) 509.0721 (1.35) 0.0000 (1.0) 0;0 1.9644 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.11.0] 1.6872 (3.51) 1.6872 (3.51) 1.6872 (3.51) 0.0000 (1.0) 1.6872 (3.51) 0.0000 (1.0) 0;0 0.5927 (0.28) 1 1 test_list-list-recursive[2.18.1] 2.3424 (4.87) 2.3424 (4.87) 2.3424 (4.87) 0.0000 (1.0) 2.3424 (4.87) 0.0000 (1.0) 0;0 0.4269 (0.21) 1 1 test_list-list-recursive[2.39.0] 0.7926 (1.65) 0.7926 (1.65) 0.7926 (1.65) 0.0000 (1.0) 0.7926 (1.65) 0.0000 (1.0) 0;0 1.2616 (0.61) 1 1 test_list-list-recursive[2.40.0] 0.4805 (1.0) 0.4805 (1.0) 0.4805 (1.0) 0.0000 (1.0) 0.4805 (1.0) 0.0000 (1.0) 0;0 2.0812 (1.0) 1 1 test_list-list-recursive[2.41.1] 0.4839 (1.01) 0.4839 (1.01) 0.4839 (1.01) 0.0000 (1.0) 0.4839 (1.01) 0.0000 (1.0) 0;0 2.0667 (0.99) 1 1 test_list-list-recursive[2.45.0] 0.5020 (1.04) 0.5020 (1.04) 0.5020 (1.04) 0.0000 (1.0) 0.5020 (1.04) 0.0000 (1.0) 0;0 1.9922 (0.96) 1 1 test_list-list-recursive[main] 0.6050 (1.26) 0.6050 (1.26) 0.6050 (1.26) 0.0000 (1.0) 0.6050 (1.26) 0.0000 (1.0) 0;0 1.6528 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.11.0] 418.6109 (1.03) 418.6109 (1.03) 418.6109 (1.03) 0.0000 (1.0) 418.6109 (1.03) 0.0000 (1.0) 0;0 2.3889 (0.97) 1 1 test_list-list-shallow[2.18.1] 405.4856 (1.0) 405.4856 (1.0) 405.4856 (1.0) 0.0000 (1.0) 405.4856 (1.0) 0.0000 (1.0) 0;0 2.4662 (1.0) 1 1 test_list-list-shallow[2.39.0] 441.5568 (1.09) 441.5568 (1.09) 441.5568 (1.09) 0.0000 (1.0) 441.5568 (1.09) 0.0000 (1.0) 0;0 2.2647 (0.92) 1 1 test_list-list-shallow[2.40.0] 440.1376 (1.09) 440.1376 (1.09) 440.1376 (1.09) 0.0000 (1.0) 440.1376 (1.09) 0.0000 (1.0) 0;0 2.2720 (0.92) 1 1 test_list-list-shallow[2.41.1] 438.5533 (1.08) 438.5533 (1.08) 438.5533 (1.08) 0.0000 (1.0) 438.5533 (1.08) 0.0000 (1.0) 0;0 2.2802 (0.92) 1 1 test_list-list-shallow[2.45.0] 458.5419 (1.13) 458.5419 (1.13) 458.5419 (1.13) 0.0000 (1.0) 458.5419 (1.13) 0.0000 (1.0) 0;0 2.1808 (0.88) 1 1 test_list-list-shallow[main] 502.7539 (1.24) 502.7539 (1.24) 502.7539 (1.24) 0.0000 (1.0) 502.7539 (1.24) 0.0000 (1.0) 0;0 1.9890 (0.81) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.11.0] 139.4373 (1.0) 143.2281 (1.0) 141.2443 (1.0) 0.7971 (1.0) 141.1441 (1.0) 1.0822 (1.0) 28;0 7.0799 (1.0) 100 1 test_help---help[2.18.1] 143.9011 (1.03) 148.9345 (1.04) 146.0834 (1.03) 0.9616 (1.21) 145.9002 (1.03) 1.1055 (1.02) 28;2 6.8454 (0.97) 100 1 test_help---help[2.39.0] 183.3305 (1.31) 192.1922 (1.34) 185.8341 (1.32) 1.3185 (1.65) 185.7449 (1.32) 1.5120 (1.40) 29;2 5.3811 (0.76) 100 1 test_help---help[2.40.0] 182.5853 (1.31) 194.3971 (1.36) 185.3960 (1.31) 1.6708 (2.10) 185.2502 (1.31) 2.2062 (2.04) 22;2 5.3939 (0.76) 100 1 test_help---help[2.41.1] 183.1228 (1.31) 190.6447 (1.33) 186.2512 (1.32) 1.5552 (1.95) 186.2431 (1.32) 2.1128 (1.95) 35;1 5.3691 (0.76) 100 1 test_help---help[2.45.0] 145.1895 (1.04) 150.2200 (1.05) 146.8110 (1.04) 1.0306 (1.29) 146.6346 (1.04) 1.2326 (1.14) 23;5 6.8115 (0.96) 100 1 test_help---help[main] 146.7399 (1.05) 155.0364 (1.08) 148.5712 (1.05) 1.2221 (1.53) 148.2873 (1.05) 1.5103 (1.40) 30;1 6.7308 (0.95) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.11.0] 2.1866 (1.24) 2.1866 (1.24) 2.1866 (1.24) 0.0000 (1.0) 2.1866 (1.24) 0.0000 (1.0) 0;0 0.4573 (0.80) 1 1 test_diff-diff[2.18.1] 1.7574 (1.0) 1.7574 (1.0) 1.7574 (1.0) 0.0000 (1.0) 1.7574 (1.0) 0.0000 (1.0) 0;0 0.5690 (1.0) 1 1 test_diff-diff[2.39.0] 1.8264 (1.04) 1.8264 (1.04) 1.8264 (1.04) 0.0000 (1.0) 1.8264 (1.04) 0.0000 (1.0) 0;0 0.5475 (0.96) 1 1 test_diff-diff[2.40.0] 1.8320 (1.04) 1.8320 (1.04) 1.8320 (1.04) 0.0000 (1.0) 1.8320 (1.04) 0.0000 (1.0) 0;0 0.5459 (0.96) 1 1 test_diff-diff[2.41.1] 1.7692 (1.01) 1.7692 (1.01) 1.7692 (1.01) 0.0000 (1.0) 1.7692 (1.01) 0.0000 (1.0) 0;0 0.5652 (0.99) 1 1 test_diff-diff[2.45.0] 1.7833 (1.01) 1.7833 (1.01) 1.7833 (1.01) 0.0000 (1.0) 1.7833 (1.01) 0.0000 (1.0) 0;0 0.5608 (0.99) 1 1 test_diff-diff[main] 1.8902 (1.08) 1.8902 (1.08) 1.8902 (1.08) 0.0000 (1.0) 1.8902 (1.08) 0.0000 (1.0) 0;0 0.5290 (0.93) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.11.0] 1.4837 (1.96) 1.4837 (1.96) 1.4837 (1.96) 0.0000 (1.0) 1.4837 (1.96) 0.0000 (1.0) 0;0 0.6740 (0.51) 1 1 test_diff-diff-changed[2.18.1] 0.7582 (1.0) 0.7582 (1.0) 0.7582 (1.0) 0.0000 (1.0) 0.7582 (1.0) 0.0000 (1.0) 0;0 1.3189 (1.0) 1 1 test_diff-diff-changed[2.39.0] 0.7998 (1.05) 0.7998 (1.05) 0.7998 (1.05) 0.0000 (1.0) 0.7998 (1.05) 0.0000 (1.0) 0;0 1.2503 (0.95) 1 1 test_diff-diff-changed[2.40.0] 0.8361 (1.10) 0.8361 (1.10) 0.8361 (1.10) 0.0000 (1.0) 0.8361 (1.10) 0.0000 (1.0) 0;0 1.1961 (0.91) 1 1 test_diff-diff-changed[2.41.1] 0.8436 (1.11) 0.8436 (1.11) 0.8436 (1.11) 0.0000 (1.0) 0.8436 (1.11) 0.0000 (1.0) 0;0 1.1854 (0.90) 1 1 test_diff-diff-changed[2.45.0] 0.8995 (1.19) 0.8995 (1.19) 0.8995 (1.19) 0.0000 (1.0) 0.8995 (1.19) 0.0000 (1.0) 0;0 1.1117 (0.84) 1 1 test_diff-diff-changed[main] 1.0169 (1.34) 1.0169 (1.34) 1.0169 (1.34) 0.0000 (1.0) 1.0169 (1.34) 0.0000 (1.0) 0;0 0.9834 (0.75) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.11.0] 570.5111 (1.0) 570.5111 (1.0) 570.5111 (1.0) 0.0000 (1.0) 570.5111 (1.0) 0.0000 (1.0) 0;0 1.7528 (1.0) 1 1 test_diff-diff-changed-noop[2.18.1] 769.5664 (1.35) 769.5664 (1.35) 769.5664 (1.35) 0.0000 (1.0) 769.5664 (1.35) 0.0000 (1.0) 0;0 1.2994 (0.74) 1 1 test_diff-diff-changed-noop[2.39.0] 825.7388 (1.45) 825.7388 (1.45) 825.7388 (1.45) 0.0000 (1.0) 825.7388 (1.45) 0.0000 (1.0) 0;0 1.2110 (0.69) 1 1 test_diff-diff-changed-noop[2.40.0] 790.6650 (1.39) 790.6650 (1.39) 790.6650 (1.39) 0.0000 (1.0) 790.6650 (1.39) 0.0000 (1.0) 0;0 1.2648 (0.72) 1 1 test_diff-diff-changed-noop[2.41.1] 808.7890 (1.42) 808.7890 (1.42) 808.7890 (1.42) 0.0000 (1.0) 808.7890 (1.42) 0.0000 (1.0) 0;0 1.2364 (0.71) 1 1 test_diff-diff-changed-noop[2.45.0] 873.5649 (1.53) 873.5649 (1.53) 873.5649 (1.53) 0.0000 (1.0) 873.5649 (1.53) 0.0000 (1.0) 0;0 1.1447 (0.65) 1 1 test_diff-diff-changed-noop[main] 878.0202 (1.54) 878.0202 (1.54) 878.0202 (1.54) 0.0000 (1.0) 878.0202 (1.54) 0.0000 (1.0) 0;0 1.1389 (0.65) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.11.0] 514.6487 (1.0) 514.6487 (1.0) 514.6487 (1.0) 0.0000 (1.0) 514.6487 (1.0) 0.0000 (1.0) 0;0 1.9431 (1.0) 1 1 test_diff-diff-noop[2.18.1] 771.6098 (1.50) 771.6098 (1.50) 771.6098 (1.50) 0.0000 (1.0) 771.6098 (1.50) 0.0000 (1.0) 0;0 1.2960 (0.67) 1 1 test_diff-diff-noop[2.39.0] 764.1488 (1.48) 764.1488 (1.48) 764.1488 (1.48) 0.0000 (1.0) 764.1488 (1.48) 0.0000 (1.0) 0;0 1.3086 (0.67) 1 1 test_diff-diff-noop[2.40.0] 791.4067 (1.54) 791.4067 (1.54) 791.4067 (1.54) 0.0000 (1.0) 791.4067 (1.54) 0.0000 (1.0) 0;0 1.2636 (0.65) 1 1 test_diff-diff-noop[2.41.1] 761.3227 (1.48) 761.3227 (1.48) 761.3227 (1.48) 0.0000 (1.0) 761.3227 (1.48) 0.0000 (1.0) 0;0 1.3135 (0.68) 1 1 test_diff-diff-noop[2.45.0] 854.3979 (1.66) 854.3979 (1.66) 854.3979 (1.66) 0.0000 (1.0) 854.3979 (1.66) 0.0000 (1.0) 0;0 1.1704 (0.60) 1 1 test_diff-diff-noop[main] 842.7322 (1.64) 842.7322 (1.64) 842.7322 (1.64) 0.0000 (1.0) 842.7322 (1.64) 0.0000 (1.0) 0;0 1.1866 (0.61) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.11.0] 2.9536 (1.0) 2.9536 (1.0) 2.9536 (1.0) 0.0000 (1.0) 2.9536 (1.0) 0.0000 (1.0) 0;0 0.3386 (1.0) 1 1 test_checkout_copy-checkout[2.18.1] 2.9696 (1.01) 2.9696 (1.01) 2.9696 (1.01) 0.0000 (1.0) 2.9696 (1.01) 0.0000 (1.0) 0;0 0.3367 (0.99) 1 1 test_checkout_copy-checkout[2.39.0] 3.1499 (1.07) 3.1499 (1.07) 3.1499 (1.07) 0.0000 (1.0) 3.1499 (1.07) 0.0000 (1.0) 0;0 0.3175 (0.94) 1 1 test_checkout_copy-checkout[2.40.0] 3.7376 (1.27) 3.7376 (1.27) 3.7376 (1.27) 0.0000 (1.0) 3.7376 (1.27) 0.0000 (1.0) 0;0 0.2676 (0.79) 1 1 test_checkout_copy-checkout[2.41.1] 3.3390 (1.13) 3.3390 (1.13) 3.3390 (1.13) 0.0000 (1.0) 3.3390 (1.13) 0.0000 (1.0) 0;0 0.2995 (0.88) 1 1 test_checkout_copy-checkout[2.45.0] 3.6641 (1.24) 3.6641 (1.24) 3.6641 (1.24) 0.0000 (1.0) 3.6641 (1.24) 0.0000 (1.0) 0;0 0.2729 (0.81) 1 1 test_checkout_copy-checkout[main] 3.2395 (1.10) 3.2395 (1.10) 3.2395 (1.10) 0.0000 (1.0) 3.2395 (1.10) 0.0000 (1.0) 0;0 0.3087 (0.91) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.11.0] 493.0243 (1.0) 493.0243 (1.0) 493.0243 (1.0) 0.0000 (1.0) 493.0243 (1.0) 0.0000 (1.0) 0;0 2.0283 (1.0) 1 1 test_checkout_copy-checkout-noop[2.18.1] 548.2379 (1.11) 548.2379 (1.11) 548.2379 (1.11) 0.0000 (1.0) 548.2379 (1.11) 0.0000 (1.0) 0;0 1.8240 (0.90) 1 1 test_checkout_copy-checkout-noop[2.39.0] 565.1207 (1.15) 565.1207 (1.15) 565.1207 (1.15) 0.0000 (1.0) 565.1207 (1.15) 0.0000 (1.0) 0;0 1.7695 (0.87) 1 1 test_checkout_copy-checkout-noop[2.40.0] 567.8094 (1.15) 567.8094 (1.15) 567.8094 (1.15) 0.0000 (1.0) 567.8094 (1.15) 0.0000 (1.0) 0;0 1.7612 (0.87) 1 1 test_checkout_copy-checkout-noop[2.41.1] 588.2037 (1.19) 588.2037 (1.19) 588.2037 (1.19) 0.0000 (1.0) 588.2037 (1.19) 0.0000 (1.0) 0;0 1.7001 (0.84) 1 1 test_checkout_copy-checkout-noop[2.45.0] 591.4106 (1.20) 591.4106 (1.20) 591.4106 (1.20) 0.0000 (1.0) 591.4106 (1.20) 0.0000 (1.0) 0;0 1.6909 (0.83) 1 1 test_checkout_copy-checkout-noop[main] 662.3546 (1.34) 662.3546 (1.34) 662.3546 (1.34) 0.0000 (1.0) 662.3546 (1.34) 0.0000 (1.0) 0;0 1.5098 (0.74) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.11.0] 1.2255 (1.95) 1.2255 (1.95) 1.2255 (1.95) 0.0000 (1.0) 1.2255 (1.95) 0.0000 (1.0) 0;0 0.8160 (0.51) 1 1 test_checkout_copy-checkout-update[2.18.1] 0.6295 (1.0) 0.6295 (1.0) 0.6295 (1.0) 0.0000 (1.0) 0.6295 (1.0) 0.0000 (1.0) 0;0 1.5887 (1.0) 1 1 test_checkout_copy-checkout-update[2.39.0] 0.6453 (1.03) 0.6453 (1.03) 0.6453 (1.03) 0.0000 (1.0) 0.6453 (1.03) 0.0000 (1.0) 0;0 1.5496 (0.98) 1 1 test_checkout_copy-checkout-update[2.40.0] 0.6562 (1.04) 0.6562 (1.04) 0.6562 (1.04) 0.0000 (1.0) 0.6562 (1.04) 0.0000 (1.0) 0;0 1.5239 (0.96) 1 1 test_checkout_copy-checkout-update[2.41.1] 0.6517 (1.04) 0.6517 (1.04) 0.6517 (1.04) 0.0000 (1.0) 0.6517 (1.04) 0.0000 (1.0) 0;0 1.5344 (0.97) 1 1 test_checkout_copy-checkout-update[2.45.0] 0.6625 (1.05) 0.6625 (1.05) 0.6625 (1.05) 0.0000 (1.0) 0.6625 (1.05) 0.0000 (1.0) 0;0 1.5094 (0.95) 1 1 test_checkout_copy-checkout-update[main] 0.7238 (1.15) 0.7238 (1.15) 0.7238 (1.15) 0.0000 (1.0) 0.7238 (1.15) 0.0000 (1.0) 0;0 1.3816 (0.87) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.11.0] 15.0770 (1.44) 15.0770 (1.44) 15.0770 (1.44) 0.0000 (1.0) 15.0770 (1.44) 0.0000 (1.0) 0;0 0.0663 (0.69) 1 1 test_import-import[2.18.1] 14.6685 (1.40) 14.6685 (1.40) 14.6685 (1.40) 0.0000 (1.0) 14.6685 (1.40) 0.0000 (1.0) 0;0 0.0682 (0.71) 1 1 test_import-import[2.39.0] 12.8845 (1.23) 12.8845 (1.23) 12.8845 (1.23) 0.0000 (1.0) 12.8845 (1.23) 0.0000 (1.0) 0;0 0.0776 (0.81) 1 1 test_import-import[2.40.0] 12.9047 (1.23) 12.9047 (1.23) 12.9047 (1.23) 0.0000 (1.0) 12.9047 (1.23) 0.0000 (1.0) 0;0 0.0775 (0.81) 1 1 test_import-import[2.41.1] 12.6746 (1.21) 12.6746 (1.21) 12.6746 (1.21) 0.0000 (1.0) 12.6746 (1.21) 0.0000 (1.0) 0;0 0.0789 (0.82) 1 1 test_import-import[2.45.0] 10.4509 (1.0) 10.4509 (1.0) 10.4509 (1.0) 0.0000 (1.0) 10.4509 (1.0) 0.0000 (1.0) 0;0 0.0957 (1.0) 1 1 test_import-import[main] 10.9716 (1.05) 10.9716 (1.05) 10.9716 (1.05) 0.0000 (1.0) 10.9716 (1.05) 0.0000 (1.0) 0;0 0.0911 (0.95) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.11.0] 4.2115 (1.78) 4.2115 (1.78) 4.2115 (1.78) 0.0000 (1.0) 4.2115 (1.78) 0.0000 (1.0) 0;0 0.2374 (0.56) 1 1 test_partial_remove-add[2.18.1] 6.4645 (2.73) 6.4645 (2.73) 6.4645 (2.73) 0.0000 (1.0) 6.4645 (2.73) 0.0000 (1.0) 0;0 0.1547 (0.37) 1 1 test_partial_remove-add[2.39.0] 2.8110 (1.19) 2.8110 (1.19) 2.8110 (1.19) 0.0000 (1.0) 2.8110 (1.19) 0.0000 (1.0) 0;0 0.3558 (0.84) 1 1 test_partial_remove-add[2.40.0] 4.8691 (2.06) 4.8691 (2.06) 4.8691 (2.06) 0.0000 (1.0) 4.8691 (2.06) 0.0000 (1.0) 0;0 0.2054 (0.49) 1 1 test_partial_remove-add[2.41.1] 2.8954 (1.22) 2.8954 (1.22) 2.8954 (1.22) 0.0000 (1.0) 2.8954 (1.22) 0.0000 (1.0) 0;0 0.3454 (0.82) 1 1 test_partial_remove-add[2.45.0] 2.8632 (1.21) 2.8632 (1.21) 2.8632 (1.21) 0.0000 (1.0) 2.8632 (1.21) 0.0000 (1.0) 0;0 0.3493 (0.83) 1 1 test_partial_remove-add[main] 2.3664 (1.0) 2.3664 (1.0) 2.3664 (1.0) 0.0000 (1.0) 2.3664 (1.0) 0.0000 (1.0) 0;0 0.4226 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.11.0] 588.5936 (1.0) 588.5936 (1.0) 588.5936 (1.0) 0.0000 (1.0) 588.5936 (1.0) 0.0000 (1.0) 0;0 1.6990 (1.0) 1 1 test_partial_remove-gc[2.18.1] 601.3820 (1.02) 601.3820 (1.02) 601.3820 (1.02) 0.0000 (1.0) 601.3820 (1.02) 0.0000 (1.0) 0;0 1.6628 (0.98) 1 1 test_partial_remove-gc[2.39.0] 711.6037 (1.21) 711.6037 (1.21) 711.6037 (1.21) 0.0000 (1.0) 711.6037 (1.21) 0.0000 (1.0) 0;0 1.4053 (0.83) 1 1 test_partial_remove-gc[2.40.0] 664.0035 (1.13) 664.0035 (1.13) 664.0035 (1.13) 0.0000 (1.0) 664.0035 (1.13) 0.0000 (1.0) 0;0 1.5060 (0.89) 1 1 test_partial_remove-gc[2.41.1] 719.1242 (1.22) 719.1242 (1.22) 719.1242 (1.22) 0.0000 (1.0) 719.1242 (1.22) 0.0000 (1.0) 0;0 1.3906 (0.82) 1 1 test_partial_remove-gc[2.45.0] 701.1834 (1.19) 701.1834 (1.19) 701.1834 (1.19) 0.0000 (1.0) 701.1834 (1.19) 0.0000 (1.0) 0;0 1.4262 (0.84) 1 1 test_partial_remove-gc[main] 743.2370 (1.26) 743.2370 (1.26) 743.2370 (1.26) 0.0000 (1.0) 743.2370 (1.26) 0.0000 (1.0) 0;0 1.3455 (0.79) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.11.0] 670.7695 (1.01) 670.7695 (1.01) 670.7695 (1.01) 0.0000 (1.0) 670.7695 (1.01) 0.0000 (1.0) 0;0 1.4908 (0.99) 1 1 test_partial_remove-gc-cloud[2.18.1] 662.3073 (1.0) 662.3073 (1.0) 662.3073 (1.0) 0.0000 (1.0) 662.3073 (1.0) 0.0000 (1.0) 0;0 1.5099 (1.0) 1 1 test_partial_remove-gc-cloud[2.39.0] 730.6497 (1.10) 730.6497 (1.10) 730.6497 (1.10) 0.0000 (1.0) 730.6497 (1.10) 0.0000 (1.0) 0;0 1.3686 (0.91) 1 1 test_partial_remove-gc-cloud[2.40.0] 715.1056 (1.08) 715.1056 (1.08) 715.1056 (1.08) 0.0000 (1.0) 715.1056 (1.08) 0.0000 (1.0) 0;0 1.3984 (0.93) 1 1 test_partial_remove-gc-cloud[2.41.1] 764.4576 (1.15) 764.4576 (1.15) 764.4576 (1.15) 0.0000 (1.0) 764.4576 (1.15) 0.0000 (1.0) 0;0 1.3081 (0.87) 1 1 test_partial_remove-gc-cloud[2.45.0] 764.2791 (1.15) 764.2791 (1.15) 764.2791 (1.15) 0.0000 (1.0) 764.2791 (1.15) 0.0000 (1.0) 0;0 1.3084 (0.87) 1 1 test_partial_remove-gc-cloud[main] 859.8843 (1.30) 859.8843 (1.30) 859.8843 (1.30) 0.0000 (1.0) 859.8843 (1.30) 0.0000 (1.0) 0;0 1.1629 (0.77) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.11.0] 628.0416 (1.0) 628.0416 (1.0) 628.0416 (1.0) 0.0000 (1.0) 628.0416 (1.0) 0.0000 (1.0) 0;0 1.5923 (1.0) 1 1 test_partial_remove-push[2.18.1] 647.8825 (1.03) 647.8825 (1.03) 647.8825 (1.03) 0.0000 (1.0) 647.8825 (1.03) 0.0000 (1.0) 0;0 1.5435 (0.97) 1 1 test_partial_remove-push[2.39.0] 668.2312 (1.06) 668.2312 (1.06) 668.2312 (1.06) 0.0000 (1.0) 668.2312 (1.06) 0.0000 (1.0) 0;0 1.4965 (0.94) 1 1 test_partial_remove-push[2.40.0] 718.7425 (1.14) 718.7425 (1.14) 718.7425 (1.14) 0.0000 (1.0) 718.7425 (1.14) 0.0000 (1.0) 0;0 1.3913 (0.87) 1 1 test_partial_remove-push[2.41.1] 689.0444 (1.10) 689.0444 (1.10) 689.0444 (1.10) 0.0000 (1.0) 689.0444 (1.10) 0.0000 (1.0) 0;0 1.4513 (0.91) 1 1 test_partial_remove-push[2.45.0] 670.4990 (1.07) 670.4990 (1.07) 670.4990 (1.07) 0.0000 (1.0) 670.4990 (1.07) 0.0000 (1.0) 0;0 1.4914 (0.94) 1 1 test_partial_remove-push[main] 845.9161 (1.35) 845.9161 (1.35) 845.9161 (1.35) 0.0000 (1.0) 845.9161 (1.35) 0.0000 (1.0) 0;0 1.1822 (0.74) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial-add[2.11.0] 6.4113 (1.70) 6.4113 (1.70) 6.4113 (1.70) 0.0000 (1.0) 6.4113 (1.70) 0.0000 (1.0) 0;0 0.1560 (0.59) 1 1 test_partial_add-add-partial-add[2.18.1] 5.4086 (1.43) 5.4086 (1.43) 5.4086 (1.43) 0.0000 (1.0) 5.4086 (1.43) 0.0000 (1.0) 0;0 0.1849 (0.70) 1 1 test_partial_add-add-partial-add[2.39.0] 4.6919 (1.24) 4.6919 (1.24) 4.6919 (1.24) 0.0000 (1.0) 4.6919 (1.24) 0.0000 (1.0) 0;0 0.2131 (0.80) 1 1 test_partial_add-add-partial-add[2.40.0] 4.6111 (1.22) 4.6111 (1.22) 4.6111 (1.22) 0.0000 (1.0) 4.6111 (1.22) 0.0000 (1.0) 0;0 0.2169 (0.82) 1 1 test_partial_add-add-partial-add[2.41.1] 6.0765 (1.61) 6.0765 (1.61) 6.0765 (1.61) 0.0000 (1.0) 6.0765 (1.61) 0.0000 (1.0) 0;0 0.1646 (0.62) 1 1 test_partial_add-add-partial-add[2.45.0] 3.7740 (1.0) 3.7740 (1.0) 3.7740 (1.0) 0.0000 (1.0) 3.7740 (1.0) 0.0000 (1.0) 0;0 0.2650 (1.0) 1 1 test_partial_add-add-partial-add[main] 3.9754 (1.05) 3.9754 (1.05) 3.9754 (1.05) 0.0000 (1.0) 3.9754 (1.05) 0.0000 (1.0) 0;0 0.2515 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.11.0] 477.5109 (1.0) 477.5109 (1.0) 477.5109 (1.0) 0.0000 (1.0) 477.5109 (1.0) 0.0000 (1.0) 0;0 2.0942 (1.0) 1 1 test_partial_add-gc-cloud-noop[2.18.1] 523.5298 (1.10) 523.5298 (1.10) 523.5298 (1.10) 0.0000 (1.0) 523.5298 (1.10) 0.0000 (1.0) 0;0 1.9101 (0.91) 1 1 test_partial_add-gc-cloud-noop[2.39.0] 569.0143 (1.19) 569.0143 (1.19) 569.0143 (1.19) 0.0000 (1.0) 569.0143 (1.19) 0.0000 (1.0) 0;0 1.7574 (0.84) 1 1 test_partial_add-gc-cloud-noop[2.40.0] 564.1179 (1.18) 564.1179 (1.18) 564.1179 (1.18) 0.0000 (1.0) 564.1179 (1.18) 0.0000 (1.0) 0;0 1.7727 (0.85) 1 1 test_partial_add-gc-cloud-noop[2.41.1] 556.9187 (1.17) 556.9187 (1.17) 556.9187 (1.17) 0.0000 (1.0) 556.9187 (1.17) 0.0000 (1.0) 0;0 1.7956 (0.86) 1 1 test_partial_add-gc-cloud-noop[2.45.0] 562.8806 (1.18) 562.8806 (1.18) 562.8806 (1.18) 0.0000 (1.0) 562.8806 (1.18) 0.0000 (1.0) 0;0 1.7766 (0.85) 1 1 test_partial_add-gc-cloud-noop[main] 640.6752 (1.34) 640.6752 (1.34) 640.6752 (1.34) 0.0000 (1.0) 640.6752 (1.34) 0.0000 (1.0) 0;0 1.5609 (0.75) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.11.0] 420.4918 (1.0) 420.4918 (1.0) 420.4918 (1.0) 0.0000 (1.0) 420.4918 (1.0) 0.0000 (1.0) 0;0 2.3782 (1.0) 1 1 test_partial_add-gc-noop[2.18.1] 454.9811 (1.08) 454.9811 (1.08) 454.9811 (1.08) 0.0000 (1.0) 454.9811 (1.08) 0.0000 (1.0) 0;0 2.1979 (0.92) 1 1 test_partial_add-gc-noop[2.39.0] 507.4041 (1.21) 507.4041 (1.21) 507.4041 (1.21) 0.0000 (1.0) 507.4041 (1.21) 0.0000 (1.0) 0;0 1.9708 (0.83) 1 1 test_partial_add-gc-noop[2.40.0] 506.3477 (1.20) 506.3477 (1.20) 506.3477 (1.20) 0.0000 (1.0) 506.3477 (1.20) 0.0000 (1.0) 0;0 1.9749 (0.83) 1 1 test_partial_add-gc-noop[2.41.1] 501.3179 (1.19) 501.3179 (1.19) 501.3179 (1.19) 0.0000 (1.0) 501.3179 (1.19) 0.0000 (1.0) 0;0 1.9947 (0.84) 1 1 test_partial_add-gc-noop[2.45.0] 514.4525 (1.22) 514.4525 (1.22) 514.4525 (1.22) 0.0000 (1.0) 514.4525 (1.22) 0.0000 (1.0) 0;0 1.9438 (0.82) 1 1 test_partial_add-gc-noop[main] 579.8666 (1.38) 579.8666 (1.38) 579.8666 (1.38) 0.0000 (1.0) 579.8666 (1.38) 0.0000 (1.0) 0;0 1.7245 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial-add[2.11.0] 2.2524 (1.11) 2.2524 (1.11) 2.2524 (1.11) 0.0000 (1.0) 2.2524 (1.11) 0.0000 (1.0) 0;0 0.4440 (0.90) 1 1 test_partial_add-push-partial-add[2.18.1] 2.2180 (1.10) 2.2180 (1.10) 2.2180 (1.10) 0.0000 (1.0) 2.2180 (1.10) 0.0000 (1.0) 0;0 0.4509 (0.91) 1 1 test_partial_add-push-partial-add[2.39.0] 2.8170 (1.39) 2.8170 (1.39) 2.8170 (1.39) 0.0000 (1.0) 2.8170 (1.39) 0.0000 (1.0) 0;0 0.3550 (0.72) 1 1 test_partial_add-push-partial-add[2.40.0] 2.8252 (1.40) 2.8252 (1.40) 2.8252 (1.40) 0.0000 (1.0) 2.8252 (1.40) 0.0000 (1.0) 0;0 0.3540 (0.72) 1 1 test_partial_add-push-partial-add[2.41.1] 4.9309 (2.44) 4.9309 (2.44) 4.9309 (2.44) 0.0000 (1.0) 4.9309 (2.44) 0.0000 (1.0) 0;0 0.2028 (0.41) 1 1 test_partial_add-push-partial-add[2.45.0] 2.0218 (1.0) 2.0218 (1.0) 2.0218 (1.0) 0.0000 (1.0) 2.0218 (1.0) 0.0000 (1.0) 0;0 0.4946 (1.0) 1 1 test_partial_add-push-partial-add[main] 3.8843 (1.92) 3.8843 (1.92) 3.8843 (1.92) 0.0000 (1.0) 3.8843 (1.92) 0.0000 (1.0) 0;0 0.2574 (0.52) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 year ago 
github-actions[bot]
commented
1 year ago