efiop
commented
1 year ago @mjasion Thank you! I'll wait for a new run later today and will report back.
Closed mjasion closed 1 year ago
efiop
commented
1 year ago @mjasion Thank you! I'll wait for a new run later today and will report back.
github-actions[bot]
commented
1 year ago
Mon May 8 11:56:21 UTC 2023
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.39.0] 1.2909 (1.15) 1.3032 (1.14) 1.2974 (1.15) 0.0045 (1.34) 1.2971 (1.14) 0.0052 (1.0) 2;0 0.7708 (0.87) 5 3
test_plots-plots-diff[2.40.0] 1.3800 (1.23) 1.4497 (1.27) 1.4051 (1.24) 0.0302 (8.97) 1.3937 (1.22) 0.0485 (9.26) 1;0 0.7117 (0.81) 5 3
test_plots-plots-diff[2.41.1] 1.2905 (1.15) 1.2986 (1.14) 1.2944 (1.14) 0.0034 (1.0) 1.2941 (1.14) 0.0058 (1.10) 2;0 0.7725 (0.87) 5 3
test_plots-plots-diff[2.45.0] 1.1764 (1.05) 1.2024 (1.05) 1.1853 (1.05) 0.0105 (3.13) 1.1826 (1.04) 0.0139 (2.65) 1;0 0.8437 (0.96) 5 3
test_plots-plots-diff[main] 1.1181 (1.0) 1.1437 (1.0) 1.1322 (1.0) 0.0111 (3.31) 1.1380 (1.0) 0.0183 (3.49) 2;0 0.8833 (1.0) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.39.0] 2.3951 (1.62) 2.4559 (1.64) 2.4279 (1.64) 0.0264 (2.90) 2.4199 (1.63) 0.0450 (4.51) 2;0 0.4119 (0.61) 5 3
test_plots-plots-diff-json[2.40.0] 2.4539 (1.66) 2.4875 (1.66) 2.4716 (1.66) 0.0142 (1.56) 2.4776 (1.67) 0.0232 (2.33) 2;0 0.4046 (0.60) 5 3
test_plots-plots-diff-json[2.41.1] 2.4234 (1.64) 2.4496 (1.64) 2.4415 (1.64) 0.0105 (1.15) 2.4441 (1.65) 0.0100 (1.0) 1;0 0.4096 (0.61) 5 3
test_plots-plots-diff-json[2.45.0] 2.1700 (1.47) 2.2298 (1.49) 2.1975 (1.48) 0.0234 (2.57) 2.1939 (1.48) 0.0355 (3.56) 2;0 0.4551 (0.68) 5 3
test_plots-plots-diff-json[main] 1.4740 (1.0) 1.4977 (1.0) 1.4845 (1.0) 0.0091 (1.0) 1.4843 (1.0) 0.0131 (1.32) 2;0 0.6736 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.39.0] 906.3152 (1.08) 930.0460 (1.09) 915.3402 (1.08) 10.8317 (1.74) 909.9417 (1.08) 18.5900 (1.95) 1;0 1.0925 (0.92) 5 3
test_plots-plots-show[2.40.0] 897.6239 (1.07) 919.3759 (1.07) 913.5912 (1.08) 9.3351 (1.50) 918.9251 (1.09) 10.1758 (1.07) 1;0 1.0946 (0.93) 5 3
test_plots-plots-show[2.41.1] 889.1396 (1.06) 927.7864 (1.08) 907.1117 (1.07) 16.6204 (2.67) 900.8419 (1.07) 28.3017 (2.96) 2;0 1.1024 (0.93) 5 3
test_plots-plots-show[2.45.0] 835.7213 (1.0) 856.3758 (1.0) 845.2624 (1.0) 7.6410 (1.23) 843.8854 (1.0) 9.5476 (1.0) 2;0 1.1831 (1.0) 5 3
test_plots-plots-show[main] 894.5363 (1.07) 908.5457 (1.06) 901.2955 (1.07) 6.2219 (1.0) 899.1778 (1.07) 11.0614 (1.16) 2;0 1.1095 (0.94) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.39.0] 1.4875 (1.34) 1.5181 (1.33) 1.5008 (1.33) 0.0124 (1.42) 1.4951 (1.32) 0.0185 (1.95) 2;0 0.6663 (0.75) 5 3
test_plots-plots-show-json[2.40.0] 1.4823 (1.34) 1.5535 (1.36) 1.5211 (1.35) 0.0285 (3.27) 1.5178 (1.34) 0.0447 (4.71) 2;0 0.6574 (0.74) 5 3
test_plots-plots-show-json[2.41.1] 1.4679 (1.33) 1.4907 (1.31) 1.4763 (1.31) 0.0087 (1.0) 1.4755 (1.30) 0.0095 (1.0) 1;0 0.6774 (0.77) 5 3
test_plots-plots-show-json[2.45.0] 1.3560 (1.23) 1.3826 (1.21) 1.3704 (1.21) 0.0110 (1.26) 1.3741 (1.21) 0.0178 (1.88) 2;0 0.7297 (0.82) 5 3
test_plots-plots-show-json[main] 1.1064 (1.0) 1.1403 (1.0) 1.1294 (1.0) 0.0137 (1.57) 1.1361 (1.0) 0.0154 (1.62) 1;0 0.8854 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.18.1] 1.7174 (1.0) 1.7174 (1.0) 1.7174 (1.0) 0.0000 (1.0) 1.7174 (1.0) 0.0000 (1.0) 0;0 0.5823 (1.0) 1 1
test_data_status_all_flags-data-changed[2.39.0] 1.9130 (1.11) 1.9130 (1.11) 1.9130 (1.11) 0.0000 (1.0) 1.9130 (1.11) 0.0000 (1.0) 0;0 0.5227 (0.90) 1 1
test_data_status_all_flags-data-changed[2.40.0] 1.7473 (1.02) 1.7473 (1.02) 1.7473 (1.02) 0.0000 (1.0) 1.7473 (1.02) 0.0000 (1.0) 0;0 0.5723 (0.98) 1 1
test_data_status_all_flags-data-changed[2.41.1] 1.7672 (1.03) 1.7672 (1.03) 1.7672 (1.03) 0.0000 (1.0) 1.7672 (1.03) 0.0000 (1.0) 0;0 0.5659 (0.97) 1 1
test_data_status_all_flags-data-changed[2.45.0] 1.7887 (1.04) 1.7887 (1.04) 1.7887 (1.04) 0.0000 (1.0) 1.7887 (1.04) 0.0000 (1.0) 0;0 0.5591 (0.96) 1 1
test_data_status_all_flags-data-changed[main] 1.8051 (1.05) 1.8051 (1.05) 1.8051 (1.05) 0.0000 (1.0) 1.8051 (1.05) 0.0000 (1.0) 0;0 0.5540 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.18.1] 1.7036 (1.0) 1.7036 (1.0) 1.7036 (1.0) 0.0000 (1.0) 1.7036 (1.0) 0.0000 (1.0) 0;0 0.5870 (1.0) 1 1
test_data_status_all_flags-data-changed-noop[2.39.0] 1.8657 (1.10) 1.8657 (1.10) 1.8657 (1.10) 0.0000 (1.0) 1.8657 (1.10) 0.0000 (1.0) 0;0 0.5360 (0.91) 1 1
test_data_status_all_flags-data-changed-noop[2.40.0] 1.7519 (1.03) 1.7519 (1.03) 1.7519 (1.03) 0.0000 (1.0) 1.7519 (1.03) 0.0000 (1.0) 0;0 0.5708 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[2.41.1] 1.7784 (1.04) 1.7784 (1.04) 1.7784 (1.04) 0.0000 (1.0) 1.7784 (1.04) 0.0000 (1.0) 0;0 0.5623 (0.96) 1 1
test_data_status_all_flags-data-changed-noop[2.45.0] 1.7644 (1.04) 1.7644 (1.04) 1.7644 (1.04) 0.0000 (1.0) 1.7644 (1.04) 0.0000 (1.0) 0;0 0.5668 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.8797 (1.10) 1.8797 (1.10) 1.8797 (1.10) 0.0000 (1.0) 1.8797 (1.10) 0.0000 (1.0) 0;0 0.5320 (0.91) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.18.1] 2.9589 (1.03) 2.9589 (1.03) 2.9589 (1.03) 0.0000 (1.0) 2.9589 (1.03) 0.0000 (1.0) 0;0 0.3380 (0.97) 1 1
test_data_status_all_flags-data-new[2.39.0] 2.9251 (1.02) 2.9251 (1.02) 2.9251 (1.02) 0.0000 (1.0) 2.9251 (1.02) 0.0000 (1.0) 0;0 0.3419 (0.98) 1 1
test_data_status_all_flags-data-new[2.40.0] 3.0066 (1.04) 3.0066 (1.04) 3.0066 (1.04) 0.0000 (1.0) 3.0066 (1.04) 0.0000 (1.0) 0;0 0.3326 (0.96) 1 1
test_data_status_all_flags-data-new[2.41.1] 2.9565 (1.03) 2.9565 (1.03) 2.9565 (1.03) 0.0000 (1.0) 2.9565 (1.03) 0.0000 (1.0) 0;0 0.3382 (0.97) 1 1
test_data_status_all_flags-data-new[2.45.0] 2.8792 (1.0) 2.8792 (1.0) 2.8792 (1.0) 0.0000 (1.0) 2.8792 (1.0) 0.0000 (1.0) 0;0 0.3473 (1.0) 1 1
test_data_status_all_flags-data-new[main] 3.0562 (1.06) 3.0562 (1.06) 3.0562 (1.06) 0.0000 (1.0) 3.0562 (1.06) 0.0000 (1.0) 0;0 0.3272 (0.94) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.18.1] 1.6393 (1.0) 1.6393 (1.0) 1.6393 (1.0) 0.0000 (1.0) 1.6393 (1.0) 0.0000 (1.0) 0;0 0.6100 (1.0) 1 1
test_data_status_all_flags-data-noop[2.39.0] 1.7901 (1.09) 1.7901 (1.09) 1.7901 (1.09) 0.0000 (1.0) 1.7901 (1.09) 0.0000 (1.0) 0;0 0.5586 (0.92) 1 1
test_data_status_all_flags-data-noop[2.40.0] 1.6700 (1.02) 1.6700 (1.02) 1.6700 (1.02) 0.0000 (1.0) 1.6700 (1.02) 0.0000 (1.0) 0;0 0.5988 (0.98) 1 1
test_data_status_all_flags-data-noop[2.41.1] 1.6998 (1.04) 1.6998 (1.04) 1.6998 (1.04) 0.0000 (1.0) 1.6998 (1.04) 0.0000 (1.0) 0;0 0.5883 (0.96) 1 1
test_data_status_all_flags-data-noop[2.45.0] 1.6682 (1.02) 1.6682 (1.02) 1.6682 (1.02) 0.0000 (1.0) 1.6682 (1.02) 0.0000 (1.0) 0;0 0.5994 (0.98) 1 1
test_data_status_all_flags-data-noop[main] 1.7408 (1.06) 1.7408 (1.06) 1.7408 (1.06) 0.0000 (1.0) 1.7408 (1.06) 0.0000 (1.0) 0;0 0.5744 (0.94) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 8.4876 (1.89) 8.4876 (1.89) 8.4876 (1.89) 0.0000 (1.0) 8.4876 (1.89) 0.0000 (1.0) 0;0 0.1178 (0.53) 1 1
test_sharing-add[2.18.1] 7.4813 (1.66) 7.4813 (1.66) 7.4813 (1.66) 0.0000 (1.0) 7.4813 (1.66) 0.0000 (1.0) 0;0 0.1337 (0.60) 1 1
test_sharing-add[2.39.0] 6.8329 (1.52) 6.8329 (1.52) 6.8329 (1.52) 0.0000 (1.0) 6.8329 (1.52) 0.0000 (1.0) 0;0 0.1464 (0.66) 1 1
test_sharing-add[2.40.0] 7.2732 (1.62) 7.2732 (1.62) 7.2732 (1.62) 0.0000 (1.0) 7.2732 (1.62) 0.0000 (1.0) 0;0 0.1375 (0.62) 1 1
test_sharing-add[2.41.1] 6.8750 (1.53) 6.8750 (1.53) 6.8750 (1.53) 0.0000 (1.0) 6.8750 (1.53) 0.0000 (1.0) 0;0 0.1455 (0.65) 1 1
test_sharing-add[2.45.0] 4.5001 (1.0) 4.5001 (1.0) 4.5001 (1.0) 0.0000 (1.0) 4.5001 (1.0) 0.0000 (1.0) 0;0 0.2222 (1.0) 1 1
test_sharing-add[main] 4.5407 (1.01) 4.5407 (1.01) 4.5407 (1.01) 0.0000 (1.0) 4.5407 (1.01) 0.0000 (1.0) 0;0 0.2202 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 3.9087 (1.38) 3.9087 (1.38) 3.9087 (1.38) 0.0000 (1.0) 3.9087 (1.38) 0.0000 (1.0) 0;0 0.2558 (0.72) 1 1
test_sharing-add-noop[2.18.1] 4.1380 (1.46) 4.1380 (1.46) 4.1380 (1.46) 0.0000 (1.0) 4.1380 (1.46) 0.0000 (1.0) 0;0 0.2417 (0.68) 1 1
test_sharing-add-noop[2.39.0] 2.8452 (1.01) 2.8452 (1.01) 2.8452 (1.01) 0.0000 (1.0) 2.8452 (1.01) 0.0000 (1.0) 0;0 0.3515 (0.99) 1 1
test_sharing-add-noop[2.40.0] 2.8249 (1.0) 2.8249 (1.0) 2.8249 (1.0) 0.0000 (1.0) 2.8249 (1.0) 0.0000 (1.0) 0;0 0.3540 (1.0) 1 1
test_sharing-add-noop[2.41.1] 2.8388 (1.00) 2.8388 (1.00) 2.8388 (1.00) 0.0000 (1.0) 2.8388 (1.00) 0.0000 (1.0) 0;0 0.3523 (1.00) 1 1
test_sharing-add-noop[2.45.0] 2.8999 (1.03) 2.8999 (1.03) 2.8999 (1.03) 0.0000 (1.0) 2.8999 (1.03) 0.0000 (1.0) 0;0 0.3448 (0.97) 1 1
test_sharing-add-noop[main] 2.9769 (1.05) 2.9769 (1.05) 2.9769 (1.05) 0.0000 (1.0) 2.9769 (1.05) 0.0000 (1.0) 0;0 0.3359 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 553.1006 (1.0) 553.1006 (1.0) 553.1006 (1.0) 0.0000 (1.0) 553.1006 (1.0) 0.0000 (1.0) 0;0 1.8080 (1.0) 1 1
test_sharing-checkout-noop[2.18.1] 641.9936 (1.16) 641.9936 (1.16) 641.9936 (1.16) 0.0000 (1.0) 641.9936 (1.16) 0.0000 (1.0) 0;0 1.5576 (0.86) 1 1
test_sharing-checkout-noop[2.39.0] 662.5875 (1.20) 662.5875 (1.20) 662.5875 (1.20) 0.0000 (1.0) 662.5875 (1.20) 0.0000 (1.0) 0;0 1.5092 (0.83) 1 1
test_sharing-checkout-noop[2.40.0] 686.1325 (1.24) 686.1325 (1.24) 686.1325 (1.24) 0.0000 (1.0) 686.1325 (1.24) 0.0000 (1.0) 0;0 1.4574 (0.81) 1 1
test_sharing-checkout-noop[2.41.1] 656.1704 (1.19) 656.1704 (1.19) 656.1704 (1.19) 0.0000 (1.0) 656.1704 (1.19) 0.0000 (1.0) 0;0 1.5240 (0.84) 1 1
test_sharing-checkout-noop[2.45.0] 699.1773 (1.26) 699.1773 (1.26) 699.1773 (1.26) 0.0000 (1.0) 699.1773 (1.26) 0.0000 (1.0) 0;0 1.4303 (0.79) 1 1
test_sharing-checkout-noop[main] 763.3812 (1.38) 763.3812 (1.38) 763.3812 (1.38) 0.0000 (1.0) 763.3812 (1.38) 0.0000 (1.0) 0;0 1.3100 (0.72) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-pull': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 8.2959 (1.06) 8.2959 (1.06) 8.2959 (1.06) 0.0000 (1.0) 8.2959 (1.06) 0.0000 (1.0) 0;0 0.1205 (0.95) 1 1
test_sharing-pull[2.18.1] 8.4075 (1.07) 8.4075 (1.07) 8.4075 (1.07) 0.0000 (1.0) 8.4075 (1.07) 0.0000 (1.0) 0;0 0.1189 (0.93) 1 1
test_sharing-pull[2.39.0] 9.7338 (1.24) 9.7338 (1.24) 9.7338 (1.24) 0.0000 (1.0) 9.7338 (1.24) 0.0000 (1.0) 0;0 0.1027 (0.81) 1 1
test_sharing-pull[2.40.0] 9.7864 (1.25) 9.7864 (1.25) 9.7864 (1.25) 0.0000 (1.0) 9.7864 (1.25) 0.0000 (1.0) 0;0 0.1022 (0.80) 1 1
test_sharing-pull[2.41.1] 9.7229 (1.24) 9.7229 (1.24) 9.7229 (1.24) 0.0000 (1.0) 9.7229 (1.24) 0.0000 (1.0) 0;0 0.1029 (0.81) 1 1
test_sharing-pull[2.45.0] 7.8586 (1.0) 7.8586 (1.0) 7.8586 (1.0) 0.0000 (1.0) 7.8586 (1.0) 0.0000 (1.0) 0;0 0.1272 (1.0) 1 1
test_sharing-pull[main] 7.9911 (1.02) 7.9911 (1.02) 7.9911 (1.02) 0.0000 (1.0) 7.9911 (1.02) 0.0000 (1.0) 0;0 0.1251 (0.98) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 588.0370 (1.0) 588.0370 (1.0) 588.0370 (1.0) 0.0000 (1.0) 588.0370 (1.0) 0.0000 (1.0) 0;0 1.7006 (1.0) 1 1
test_sharing-pull-noop[2.18.1] 760.7147 (1.29) 760.7147 (1.29) 760.7147 (1.29) 0.0000 (1.0) 760.7147 (1.29) 0.0000 (1.0) 0;0 1.3146 (0.77) 1 1
test_sharing-pull-noop[2.39.0] 700.7001 (1.19) 700.7001 (1.19) 700.7001 (1.19) 0.0000 (1.0) 700.7001 (1.19) 0.0000 (1.0) 0;0 1.4271 (0.84) 1 1
test_sharing-pull-noop[2.40.0] 728.6574 (1.24) 728.6574 (1.24) 728.6574 (1.24) 0.0000 (1.0) 728.6574 (1.24) 0.0000 (1.0) 0;0 1.3724 (0.81) 1 1
test_sharing-pull-noop[2.41.1] 695.6843 (1.18) 695.6843 (1.18) 695.6843 (1.18) 0.0000 (1.0) 695.6843 (1.18) 0.0000 (1.0) 0;0 1.4374 (0.85) 1 1
test_sharing-pull-noop[2.45.0] 756.3013 (1.29) 756.3013 (1.29) 756.3013 (1.29) 0.0000 (1.0) 756.3013 (1.29) 0.0000 (1.0) 0;0 1.3222 (0.78) 1 1
test_sharing-pull-noop[main] 841.1101 (1.43) 841.1101 (1.43) 841.1101 (1.43) 0.0000 (1.0) 841.1101 (1.43) 0.0000 (1.0) 0;0 1.1889 (0.70) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 4.4796 (1.16) 4.4796 (1.16) 4.4796 (1.16) 0.0000 (1.0) 4.4796 (1.16) 0.0000 (1.0) 0;0 0.2232 (0.86) 1 1
test_sharing-push[2.18.1] 4.4792 (1.16) 4.4792 (1.16) 4.4792 (1.16) 0.0000 (1.0) 4.4792 (1.16) 0.0000 (1.0) 0;0 0.2233 (0.86) 1 1
test_sharing-push[2.39.0] 5.7051 (1.47) 5.7051 (1.47) 5.7051 (1.47) 0.0000 (1.0) 5.7051 (1.47) 0.0000 (1.0) 0;0 0.1753 (0.68) 1 1
test_sharing-push[2.40.0] 5.7186 (1.48) 5.7186 (1.48) 5.7186 (1.48) 0.0000 (1.0) 5.7186 (1.48) 0.0000 (1.0) 0;0 0.1749 (0.68) 1 1
test_sharing-push[2.41.1] 5.6743 (1.47) 5.6743 (1.47) 5.6743 (1.47) 0.0000 (1.0) 5.6743 (1.47) 0.0000 (1.0) 0;0 0.1762 (0.68) 1 1
test_sharing-push[2.45.0] 3.8721 (1.0) 3.8721 (1.0) 3.8721 (1.0) 0.0000 (1.0) 3.8721 (1.0) 0.0000 (1.0) 0;0 0.2583 (1.0) 1 1
test_sharing-push[main] 3.9800 (1.03) 3.9800 (1.03) 3.9800 (1.03) 0.0000 (1.0) 3.9800 (1.03) 0.0000 (1.0) 0;0 0.2513 (0.97) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 487.4804 (1.0) 487.4804 (1.0) 487.4804 (1.0) 0.0000 (1.0) 487.4804 (1.0) 0.0000 (1.0) 0;0 2.0514 (1.0) 1 1
test_sharing-push-noop[2.18.1] 489.8072 (1.00) 489.8072 (1.00) 489.8072 (1.00) 0.0000 (1.0) 489.8072 (1.00) 0.0000 (1.0) 0;0 2.0416 (1.00) 1 1
test_sharing-push-noop[2.39.0] 547.2463 (1.12) 547.2463 (1.12) 547.2463 (1.12) 0.0000 (1.0) 547.2463 (1.12) 0.0000 (1.0) 0;0 1.8273 (0.89) 1 1
test_sharing-push-noop[2.40.0] 542.0360 (1.11) 542.0360 (1.11) 542.0360 (1.11) 0.0000 (1.0) 542.0360 (1.11) 0.0000 (1.0) 0;0 1.8449 (0.90) 1 1
test_sharing-push-noop[2.41.1] 539.6779 (1.11) 539.6779 (1.11) 539.6779 (1.11) 0.0000 (1.0) 539.6779 (1.11) 0.0000 (1.0) 0;0 1.8530 (0.90) 1 1
test_sharing-push-noop[2.45.0] 542.9181 (1.11) 542.9181 (1.11) 542.9181 (1.11) 0.0000 (1.0) 542.9181 (1.11) 0.0000 (1.0) 0;0 1.8419 (0.90) 1 1
test_sharing-push-noop[main] 662.1560 (1.36) 662.1560 (1.36) 662.1560 (1.36) 0.0000 (1.0) 662.1560 (1.36) 0.0000 (1.0) 0;0 1.5102 (0.74) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 5.1637 (1.37) 5.1637 (1.37) 5.1637 (1.37) 0.0000 (1.0) 5.1637 (1.37) 0.0000 (1.0) 0;0 0.1937 (0.73) 1 1
test_get-get[2.18.1] 4.7900 (1.27) 4.7900 (1.27) 4.7900 (1.27) 0.0000 (1.0) 4.7900 (1.27) 0.0000 (1.0) 0;0 0.2088 (0.79) 1 1
test_get-get[2.39.0] 3.8633 (1.03) 3.8633 (1.03) 3.8633 (1.03) 0.0000 (1.0) 3.8633 (1.03) 0.0000 (1.0) 0;0 0.2588 (0.97) 1 1
test_get-get[2.40.0] 3.7643 (1.0) 3.7643 (1.0) 3.7643 (1.0) 0.0000 (1.0) 3.7643 (1.0) 0.0000 (1.0) 0;0 0.2657 (1.0) 1 1
test_get-get[2.41.1] 3.9942 (1.06) 3.9942 (1.06) 3.9942 (1.06) 0.0000 (1.0) 3.9942 (1.06) 0.0000 (1.0) 0;0 0.2504 (0.94) 1 1
test_get-get[2.45.0] 3.8081 (1.01) 3.8081 (1.01) 3.8081 (1.01) 0.0000 (1.0) 3.8081 (1.01) 0.0000 (1.0) 0;0 0.2626 (0.99) 1 1
test_get-get[main] 5.0405 (1.34) 5.0405 (1.34) 5.0405 (1.34) 0.0000 (1.0) 5.0405 (1.34) 0.0000 (1.0) 0;0 0.1984 (0.75) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 1.3658 (1.0) 1.3658 (1.0) 1.3658 (1.0) 0.0000 (1.0) 1.3658 (1.0) 0.0000 (1.0) 0;0 0.7322 (1.0) 1 1
test_checkout_symlink-checkout[2.18.1] 1.4235 (1.04) 1.4235 (1.04) 1.4235 (1.04) 0.0000 (1.0) 1.4235 (1.04) 0.0000 (1.0) 0;0 0.7025 (0.96) 1 1
test_checkout_symlink-checkout[2.39.0] 1.4746 (1.08) 1.4746 (1.08) 1.4746 (1.08) 0.0000 (1.0) 1.4746 (1.08) 0.0000 (1.0) 0;0 0.6782 (0.93) 1 1
test_checkout_symlink-checkout[2.40.0] 1.9411 (1.42) 1.9411 (1.42) 1.9411 (1.42) 0.0000 (1.0) 1.9411 (1.42) 0.0000 (1.0) 0;0 0.5152 (0.70) 1 1
test_checkout_symlink-checkout[2.41.1] 1.3750 (1.01) 1.3750 (1.01) 1.3750 (1.01) 0.0000 (1.0) 1.3750 (1.01) 0.0000 (1.0) 0;0 0.7273 (0.99) 1 1
test_checkout_symlink-checkout[2.45.0] 1.7008 (1.25) 1.7008 (1.25) 1.7008 (1.25) 0.0000 (1.0) 1.7008 (1.25) 0.0000 (1.0) 0;0 0.5880 (0.80) 1 1
test_checkout_symlink-checkout[main] 1.7395 (1.27) 1.7395 (1.27) 1.7395 (1.27) 0.0000 (1.0) 1.7395 (1.27) 0.0000 (1.0) 0;0 0.5749 (0.79) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 508.7019 (1.0) 508.7019 (1.0) 508.7019 (1.0) 0.0000 (1.0) 508.7019 (1.0) 0.0000 (1.0) 0;0 1.9658 (1.0) 1 1
test_checkout_symlink-checkout-noop[2.18.1] 710.2158 (1.40) 710.2158 (1.40) 710.2158 (1.40) 0.0000 (1.0) 710.2158 (1.40) 0.0000 (1.0) 0;0 1.4080 (0.72) 1 1
test_checkout_symlink-checkout-noop[2.39.0] 592.8354 (1.17) 592.8354 (1.17) 592.8354 (1.17) 0.0000 (1.0) 592.8354 (1.17) 0.0000 (1.0) 0;0 1.6868 (0.86) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 584.4341 (1.15) 584.4341 (1.15) 584.4341 (1.15) 0.0000 (1.0) 584.4341 (1.15) 0.0000 (1.0) 0;0 1.7111 (0.87) 1 1
test_checkout_symlink-checkout-noop[2.41.1] 582.6233 (1.15) 582.6233 (1.15) 582.6233 (1.15) 0.0000 (1.0) 582.6233 (1.15) 0.0000 (1.0) 0;0 1.7164 (0.87) 1 1
test_checkout_symlink-checkout-noop[2.45.0] 629.9775 (1.24) 629.9775 (1.24) 629.9775 (1.24) 0.0000 (1.0) 629.9775 (1.24) 0.0000 (1.0) 0;0 1.5874 (0.81) 1 1
test_checkout_symlink-checkout-noop[main] 694.5005 (1.37) 694.5005 (1.37) 694.5005 (1.37) 0.0000 (1.0) 694.5005 (1.37) 0.0000 (1.0) 0;0 1.4399 (0.73) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 1.4565 (2.16) 1.4565 (2.16) 1.4565 (2.16) 0.0000 (1.0) 1.4565 (2.16) 0.0000 (1.0) 0;0 0.6866 (0.46) 1 1
test_checkout_symlink-checkout-update[2.18.1] 0.6734 (1.0) 0.6734 (1.0) 0.6734 (1.0) 0.0000 (1.0) 0.6734 (1.0) 0.0000 (1.0) 0;0 1.4850 (1.0) 1 1
test_checkout_symlink-checkout-update[2.39.0] 0.6837 (1.02) 0.6837 (1.02) 0.6837 (1.02) 0.0000 (1.0) 0.6837 (1.02) 0.0000 (1.0) 0;0 1.4625 (0.98) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.6794 (1.01) 0.6794 (1.01) 0.6794 (1.01) 0.0000 (1.0) 0.6794 (1.01) 0.0000 (1.0) 0;0 1.4718 (0.99) 1 1
test_checkout_symlink-checkout-update[2.41.1] 0.6785 (1.01) 0.6785 (1.01) 0.6785 (1.01) 0.0000 (1.0) 0.6785 (1.01) 0.0000 (1.0) 0;0 1.4737 (0.99) 1 1
test_checkout_symlink-checkout-update[2.45.0] 1.0683 (1.59) 1.0683 (1.59) 1.0683 (1.59) 0.0000 (1.0) 1.0683 (1.59) 0.0000 (1.0) 0;0 0.9360 (0.63) 1 1
test_checkout_symlink-checkout-update[main] 0.7946 (1.18) 0.7946 (1.18) 0.7946 (1.18) 0.0000 (1.0) 0.7946 (1.18) 0.0000 (1.0) 0;0 1.2585 (0.85) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 455.6147 (1.0) 455.6147 (1.0) 455.6147 (1.0) 0.0000 (1.0) 455.6147 (1.0) 0.0000 (1.0) 0;0 2.1948 (1.0) 1 1
test_gc-gc[2.18.1] 469.2450 (1.03) 469.2450 (1.03) 469.2450 (1.03) 0.0000 (1.0) 469.2450 (1.03) 0.0000 (1.0) 0;0 2.1311 (0.97) 1 1
test_gc-gc[2.39.0] 513.2281 (1.13) 513.2281 (1.13) 513.2281 (1.13) 0.0000 (1.0) 513.2281 (1.13) 0.0000 (1.0) 0;0 1.9485 (0.89) 1 1
test_gc-gc[2.40.0] 510.5806 (1.12) 510.5806 (1.12) 510.5806 (1.12) 0.0000 (1.0) 510.5806 (1.12) 0.0000 (1.0) 0;0 1.9586 (0.89) 1 1
test_gc-gc[2.41.1] 503.3711 (1.10) 503.3711 (1.10) 503.3711 (1.10) 0.0000 (1.0) 503.3711 (1.10) 0.0000 (1.0) 0;0 1.9866 (0.91) 1 1
test_gc-gc[2.45.0] 500.0524 (1.10) 500.0524 (1.10) 500.0524 (1.10) 0.0000 (1.0) 500.0524 (1.10) 0.0000 (1.0) 0;0 1.9998 (0.91) 1 1
test_gc-gc[main] 562.3725 (1.23) 562.3725 (1.23) 562.3725 (1.23) 0.0000 (1.0) 562.3725 (1.23) 0.0000 (1.0) 0;0 1.7782 (0.81) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 2.9355 (1.0) 2.9355 (1.0) 2.9355 (1.0) 0.0000 (1.0) 2.9355 (1.0) 0.0000 (1.0) 0;0 0.3407 (1.0) 1 1
test_get_url-get-url[2.18.1] 2.9999 (1.02) 2.9999 (1.02) 2.9999 (1.02) 0.0000 (1.0) 2.9999 (1.02) 0.0000 (1.0) 0;0 0.3333 (0.98) 1 1
test_get_url-get-url[2.39.0] 3.0787 (1.05) 3.0787 (1.05) 3.0787 (1.05) 0.0000 (1.0) 3.0787 (1.05) 0.0000 (1.0) 0;0 0.3248 (0.95) 1 1
test_get_url-get-url[2.40.0] 3.3415 (1.14) 3.3415 (1.14) 3.3415 (1.14) 0.0000 (1.0) 3.3415 (1.14) 0.0000 (1.0) 0;0 0.2993 (0.88) 1 1
test_get_url-get-url[2.41.1] 3.4212 (1.17) 3.4212 (1.17) 3.4212 (1.17) 0.0000 (1.0) 3.4212 (1.17) 0.0000 (1.0) 0;0 0.2923 (0.86) 1 1
test_get_url-get-url[2.45.0] 3.0671 (1.04) 3.0671 (1.04) 3.0671 (1.04) 0.0000 (1.0) 3.0671 (1.04) 0.0000 (1.0) 0;0 0.3260 (0.96) 1 1
test_get_url-get-url[main] 3.1101 (1.06) 3.1101 (1.06) 3.1101 (1.06) 0.0000 (1.0) 3.1101 (1.06) 0.0000 (1.0) 0;0 0.3215 (0.94) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0] 9.6413 (1.89) 9.6413 (1.89) 9.6413 (1.89) 0.0000 (1.0) 9.6413 (1.89) 0.0000 (1.0) 0;0 0.1037 (0.53) 1 1
test_sharing_s3-add[2.18.1] 8.3502 (1.63) 8.3502 (1.63) 8.3502 (1.63) 0.0000 (1.0) 8.3502 (1.63) 0.0000 (1.0) 0;0 0.1198 (0.61) 1 1
test_sharing_s3-add[2.39.0] 7.6891 (1.51) 7.6891 (1.51) 7.6891 (1.51) 0.0000 (1.0) 7.6891 (1.51) 0.0000 (1.0) 0;0 0.1301 (0.66) 1 1
test_sharing_s3-add[2.40.0] 7.8888 (1.54) 7.8888 (1.54) 7.8888 (1.54) 0.0000 (1.0) 7.8888 (1.54) 0.0000 (1.0) 0;0 0.1268 (0.65) 1 1
test_sharing_s3-add[2.41.1] 7.9049 (1.55) 7.9049 (1.55) 7.9049 (1.55) 0.0000 (1.0) 7.9049 (1.55) 0.0000 (1.0) 0;0 0.1265 (0.65) 1 1
test_sharing_s3-add[2.45.0] 5.1072 (1.0) 5.1072 (1.0) 5.1072 (1.0) 0.0000 (1.0) 5.1072 (1.0) 0.0000 (1.0) 0;0 0.1958 (1.0) 1 1
test_sharing_s3-add[main] 5.1453 (1.01) 5.1453 (1.01) 5.1453 (1.01) 0.0000 (1.0) 5.1453 (1.01) 0.0000 (1.0) 0;0 0.1944 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0] 4.3324 (1.40) 4.3324 (1.40) 4.3324 (1.40) 0.0000 (1.0) 4.3324 (1.40) 0.0000 (1.0) 0;0 0.2308 (0.71) 1 1
test_sharing_s3-add-noop[2.18.1] 4.7696 (1.54) 4.7696 (1.54) 4.7696 (1.54) 0.0000 (1.0) 4.7696 (1.54) 0.0000 (1.0) 0;0 0.2097 (0.65) 1 1
test_sharing_s3-add-noop[2.39.0] 3.0948 (1.0) 3.0948 (1.0) 3.0948 (1.0) 0.0000 (1.0) 3.0948 (1.0) 0.0000 (1.0) 0;0 0.3231 (1.0) 1 1
test_sharing_s3-add-noop[2.40.0] 3.1525 (1.02) 3.1525 (1.02) 3.1525 (1.02) 0.0000 (1.0) 3.1525 (1.02) 0.0000 (1.0) 0;0 0.3172 (0.98) 1 1
test_sharing_s3-add-noop[2.41.1] 3.2306 (1.04) 3.2306 (1.04) 3.2306 (1.04) 0.0000 (1.0) 3.2306 (1.04) 0.0000 (1.0) 0;0 0.3095 (0.96) 1 1
test_sharing_s3-add-noop[2.45.0] 3.3375 (1.08) 3.3375 (1.08) 3.3375 (1.08) 0.0000 (1.0) 3.3375 (1.08) 0.0000 (1.0) 0;0 0.2996 (0.93) 1 1
test_sharing_s3-add-noop[main] 3.3955 (1.10) 3.3955 (1.10) 3.3955 (1.10) 0.0000 (1.0) 3.3955 (1.10) 0.0000 (1.0) 0;0 0.2945 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0] 560.6720 (1.0) 560.6720 (1.0) 560.6720 (1.0) 0.0000 (1.0) 560.6720 (1.0) 0.0000 (1.0) 0;0 1.7836 (1.0) 1 1
test_sharing_s3-checkout-noop[2.18.1] 714.7916 (1.27) 714.7916 (1.27) 714.7916 (1.27) 0.0000 (1.0) 714.7916 (1.27) 0.0000 (1.0) 0;0 1.3990 (0.78) 1 1
test_sharing_s3-checkout-noop[2.39.0] 749.7492 (1.34) 749.7492 (1.34) 749.7492 (1.34) 0.0000 (1.0) 749.7492 (1.34) 0.0000 (1.0) 0;0 1.3338 (0.75) 1 1
test_sharing_s3-checkout-noop[2.40.0] 741.3379 (1.32) 741.3379 (1.32) 741.3379 (1.32) 0.0000 (1.0) 741.3379 (1.32) 0.0000 (1.0) 0;0 1.3489 (0.76) 1 1
test_sharing_s3-checkout-noop[2.41.1] 739.0726 (1.32) 739.0726 (1.32) 739.0726 (1.32) 0.0000 (1.0) 739.0726 (1.32) 0.0000 (1.0) 0;0 1.3530 (0.76) 1 1
test_sharing_s3-checkout-noop[2.45.0] 774.4254 (1.38) 774.4254 (1.38) 774.4254 (1.38) 0.0000 (1.0) 774.4254 (1.38) 0.0000 (1.0) 0;0 1.2913 (0.72) 1 1
test_sharing_s3-checkout-noop[main] 842.5045 (1.50) 842.5045 (1.50) 842.5045 (1.50) 0.0000 (1.0) 842.5045 (1.50) 0.0000 (1.0) 0;0 1.1869 (0.67) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0] 18.8751 (1.19) 18.8751 (1.19) 18.8751 (1.19) 0.0000 (1.0) 18.8751 (1.19) 0.0000 (1.0) 0;0 0.0530 (0.84) 1 1
test_sharing_s3-pull[2.18.1] 19.0345 (1.20) 19.0345 (1.20) 19.0345 (1.20) 0.0000 (1.0) 19.0345 (1.20) 0.0000 (1.0) 0;0 0.0525 (0.84) 1 1
test_sharing_s3-pull[2.39.0] 18.3276 (1.15) 18.3276 (1.15) 18.3276 (1.15) 0.0000 (1.0) 18.3276 (1.15) 0.0000 (1.0) 0;0 0.0546 (0.87) 1 1
test_sharing_s3-pull[2.40.0] 18.9409 (1.19) 18.9409 (1.19) 18.9409 (1.19) 0.0000 (1.0) 18.9409 (1.19) 0.0000 (1.0) 0;0 0.0528 (0.84) 1 1
test_sharing_s3-pull[2.41.1] 19.2618 (1.21) 19.2618 (1.21) 19.2618 (1.21) 0.0000 (1.0) 19.2618 (1.21) 0.0000 (1.0) 0;0 0.0519 (0.83) 1 1
test_sharing_s3-pull[2.45.0] 16.1810 (1.02) 16.1810 (1.02) 16.1810 (1.02) 0.0000 (1.0) 16.1810 (1.02) 0.0000 (1.0) 0;0 0.0618 (0.98) 1 1
test_sharing_s3-pull[main] 15.9063 (1.0) 15.9063 (1.0) 15.9063 (1.0) 0.0000 (1.0) 15.9063 (1.0) 0.0000 (1.0) 0;0 0.0629 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 7 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0] 839.8201 (1.0) 839.8201 (1.0) 839.8201 (1.0) 0.0000 (1.0) 839.8201 (1.0) 0.0000 (1.0) 0;0 1.1907 (1.0) 1 1
test_sharing_s3-pull-noop[2.18.1] 986.8538 (1.18) 986.8538 (1.18) 986.8538 (1.18) 0.0000 (1.0) 986.8538 (1.18) 0.0000 (1.0) 0;0 1.0133 (0.85) 1 1
test_sharing_s3-pull-noop[2.39.0] 1,001.0636 (1.19) 1,001.0636 (1.19) 1,001.0636 (1.19) 0.0000 (1.0) 1,001.0636 (1.19) 0.0000 (1.0) 0;0 0.9989 (0.84) 1 1
test_sharing_s3-pull-noop[2.40.0] 996.3910 (1.19) 996.3910 (1.19) 996.3910 (1.19) 0.0000 (1.0) 996.3910 (1.19) 0.0000 (1.0) 0;0 1.0036 (0.84) 1 1
test_sharing_s3-pull-noop[2.41.1] 1,001.8140 (1.19) 1,001.8140 (1.19) 1,001.8140 (1.19) 0.0000 (1.0) 1,001.8140 (1.19) 0.0000 (1.0) 0;0 0.9982 (0.84) 1 1
test_sharing_s3-pull-noop[2.45.0] 1,058.7115 (1.26) 1,058.7115 (1.26) 1,058.7115 (1.26) 0.0000 (1.0) 1,058.7115 (1.26) 0.0000 (1.0) 0;0 0.9445 (0.79) 1 1
test_sharing_s3-pull-noop[main] 1,078.1534 (1.28) 1,078.1534 (1.28) 1,078.1534 (1.28) 0.0000 (1.0) 1,078.1534 (1.28) 0.0000 (1.0) 0;0 0.9275 (0.78) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0] 26.7562 (2.44) 26.7562 (2.44) 26.7562 (2.44) 0.0000 (1.0) 26.7562 (2.44) 0.0000 (1.0) 0;0 0.0374 (0.41) 1 1
test_sharing_s3-push[2.18.1] 26.8846 (2.45) 26.8846 (2.45) 26.8846 (2.45) 0.0000 (1.0) 26.8846 (2.45) 0.0000 (1.0) 0;0 0.0372 (0.41) 1 1
test_sharing_s3-push[2.39.0] 27.1248 (2.47) 27.1248 (2.47) 27.1248 (2.47) 0.0000 (1.0) 27.1248 (2.47) 0.0000 (1.0) 0;0 0.0369 (0.40) 1 1
test_sharing_s3-push[2.40.0] 27.0750 (2.47) 27.0750 (2.47) 27.0750 (2.47) 0.0000 (1.0) 27.0750 (2.47) 0.0000 (1.0) 0;0 0.0369 (0.41) 1 1
test_sharing_s3-push[2.41.1] 15.0038 (1.37) 15.0038 (1.37) 15.0038 (1.37) 0.0000 (1.0) 15.0038 (1.37) 0.0000 (1.0) 0;0 0.0666 (0.73) 1 1
test_sharing_s3-push[2.45.0] 10.9717 (1.0) 10.9717 (1.0) 10.9717 (1.0) 0.0000 (1.0) 10.9717 (1.0) 0.0000 (1.0) 0;0 0.0911 (1.0) 1 1
test_sharing_s3-push[main] 11.1736 (1.02) 11.1736 (1.02) 11.1736 (1.02) 0.0000 (1.0) 11.1736 (1.02) 0.0000 (1.0) 0;0 0.0895 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0] 1.1192 (1.0) 1.1192 (1.0) 1.1192 (1.0) 0.0000 (1.0) 1.1192 (1.0) 0.0000 (1.0) 0;0 0.8935 (1.0) 1 1
test_sharing_s3-push-noop[2.18.1] 1.2014 (1.07) 1.2014 (1.07) 1.2014 (1.07) 0.0000 (1.0) 1.2014 (1.07) 0.0000 (1.0) 0;0 0.8323 (0.93) 1 1
test_sharing_s3-push-noop[2.39.0] 1.1211 (1.00) 1.1211 (1.00) 1.1211 (1.00) 0.0000 (1.0) 1.1211 (1.00) 0.0000 (1.0) 0;0 0.8920 (1.00) 1 1
test_sharing_s3-push-noop[2.40.0] 1.1526 (1.03) 1.1526 (1.03) 1.1526 (1.03) 0.0000 (1.0) 1.1526 (1.03) 0.0000 (1.0) 0;0 0.8676 (0.97) 1 1
test_sharing_s3-push-noop[2.41.1] 1.1692 (1.04) 1.1692 (1.04) 1.1692 (1.04) 0.0000 (1.0) 1.1692 (1.04) 0.0000 (1.0) 0;0 0.8553 (0.96) 1 1
test_sharing_s3-push-noop[2.45.0] 1.1716 (1.05) 1.1716 (1.05) 1.1716 (1.05) 0.0000 (1.0) 1.1716 (1.05) 0.0000 (1.0) 0;0 0.8536 (0.96) 1 1
test_sharing_s3-push-noop[main] 1.2543 (1.12) 1.2543 (1.12) 1.2543 (1.12) 0.0000 (1.0) 1.2543 (1.12) 0.0000 (1.0) 0;0 0.7972 (0.89) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 13.4342 (1.47) 13.4342 (1.47) 13.4342 (1.47) 0.0000 (1.0) 13.4342 (1.47) 0.0000 (1.0) 0;0 0.0744 (0.68) 1 1
test_import_url-import-url[2.18.1] 12.0322 (1.32) 12.0322 (1.32) 12.0322 (1.32) 0.0000 (1.0) 12.0322 (1.32) 0.0000 (1.0) 0;0 0.0831 (0.76) 1 1
test_import_url-import-url[2.39.0] 11.9531 (1.31) 11.9531 (1.31) 11.9531 (1.31) 0.0000 (1.0) 11.9531 (1.31) 0.0000 (1.0) 0;0 0.0837 (0.76) 1 1
test_import_url-import-url[2.40.0] 11.5336 (1.26) 11.5336 (1.26) 11.5336 (1.26) 0.0000 (1.0) 11.5336 (1.26) 0.0000 (1.0) 0;0 0.0867 (0.79) 1 1
test_import_url-import-url[2.41.1] 11.3413 (1.24) 11.3413 (1.24) 11.3413 (1.24) 0.0000 (1.0) 11.3413 (1.24) 0.0000 (1.0) 0;0 0.0882 (0.81) 1 1
test_import_url-import-url[2.45.0] 9.1750 (1.00) 9.1750 (1.00) 9.1750 (1.00) 0.0000 (1.0) 9.1750 (1.00) 0.0000 (1.0) 0;0 0.1090 (1.00) 1 1
test_import_url-import-url[main] 9.1303 (1.0) 9.1303 (1.0) 9.1303 (1.0) 0.0000 (1.0) 9.1303 (1.0) 0.0000 (1.0) 0;0 0.1095 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 3.0125 (1.65) 3.0125 (1.65) 3.0125 (1.65) 0.0000 (1.0) 3.0125 (1.65) 0.0000 (1.0) 0;0 0.3319 (0.61) 1 1
test_status-status[2.18.1] 1.8275 (1.0) 1.8275 (1.0) 1.8275 (1.0) 0.0000 (1.0) 1.8275 (1.0) 0.0000 (1.0) 0;0 0.5472 (1.0) 1 1
test_status-status[2.39.0] 1.9323 (1.06) 1.9323 (1.06) 1.9323 (1.06) 0.0000 (1.0) 1.9323 (1.06) 0.0000 (1.0) 0;0 0.5175 (0.95) 1 1
test_status-status[2.40.0] 1.9283 (1.06) 1.9283 (1.06) 1.9283 (1.06) 0.0000 (1.0) 1.9283 (1.06) 0.0000 (1.0) 0;0 0.5186 (0.95) 1 1
test_status-status[2.41.1] 1.8996 (1.04) 1.8996 (1.04) 1.8996 (1.04) 0.0000 (1.0) 1.8996 (1.04) 0.0000 (1.0) 0;0 0.5264 (0.96) 1 1
test_status-status[2.45.0] 1.8935 (1.04) 1.8935 (1.04) 1.8935 (1.04) 0.0000 (1.0) 1.8935 (1.04) 0.0000 (1.0) 0;0 0.5281 (0.97) 1 1
test_status-status[main] 1.9505 (1.07) 1.9505 (1.07) 1.9505 (1.07) 0.0000 (1.0) 1.9505 (1.07) 0.0000 (1.0) 0;0 0.5127 (0.94) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 2.1409 (3.04) 2.1409 (3.04) 2.1409 (3.04) 0.0000 (1.0) 2.1409 (3.04) 0.0000 (1.0) 0;0 0.4671 (0.33) 1 1
test_status-status-changed[2.18.1] 0.7031 (1.0) 0.7031 (1.0) 0.7031 (1.0) 0.0000 (1.0) 0.7031 (1.0) 0.0000 (1.0) 0;0 1.4223 (1.0) 1 1
test_status-status-changed[2.39.0] 0.7392 (1.05) 0.7392 (1.05) 0.7392 (1.05) 0.0000 (1.0) 0.7392 (1.05) 0.0000 (1.0) 0;0 1.3528 (0.95) 1 1
test_status-status-changed[2.40.0] 0.7396 (1.05) 0.7396 (1.05) 0.7396 (1.05) 0.0000 (1.0) 0.7396 (1.05) 0.0000 (1.0) 0;0 1.3521 (0.95) 1 1
test_status-status-changed[2.41.1] 0.7611 (1.08) 0.7611 (1.08) 0.7611 (1.08) 0.0000 (1.0) 0.7611 (1.08) 0.0000 (1.0) 0;0 1.3138 (0.92) 1 1
test_status-status-changed[2.45.0] 0.8069 (1.15) 0.8069 (1.15) 0.8069 (1.15) 0.0000 (1.0) 0.8069 (1.15) 0.0000 (1.0) 0;0 1.2393 (0.87) 1 1
test_status-status-changed[main] 0.8678 (1.23) 0.8678 (1.23) 0.8678 (1.23) 0.0000 (1.0) 0.8678 (1.23) 0.0000 (1.0) 0;0 1.1523 (0.81) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 903.9970 (1.29) 903.9970 (1.29) 903.9970 (1.29) 0.0000 (1.0) 903.9970 (1.29) 0.0000 (1.0) 0;0 1.1062 (0.78) 1 1
test_status-status-changed-noop[2.18.1] 701.4025 (1.0) 701.4025 (1.0) 701.4025 (1.0) 0.0000 (1.0) 701.4025 (1.0) 0.0000 (1.0) 0;0 1.4257 (1.0) 1 1
test_status-status-changed-noop[2.39.0] 757.4029 (1.08) 757.4029 (1.08) 757.4029 (1.08) 0.0000 (1.0) 757.4029 (1.08) 0.0000 (1.0) 0;0 1.3203 (0.93) 1 1
test_status-status-changed-noop[2.40.0] 744.6156 (1.06) 744.6156 (1.06) 744.6156 (1.06) 0.0000 (1.0) 744.6156 (1.06) 0.0000 (1.0) 0;0 1.3430 (0.94) 1 1
test_status-status-changed-noop[2.41.1] 764.9982 (1.09) 764.9982 (1.09) 764.9982 (1.09) 0.0000 (1.0) 764.9982 (1.09) 0.0000 (1.0) 0;0 1.3072 (0.92) 1 1
test_status-status-changed-noop[2.45.0] 822.6000 (1.17) 822.6000 (1.17) 822.6000 (1.17) 0.0000 (1.0) 822.6000 (1.17) 0.0000 (1.0) 0;0 1.2157 (0.85) 1 1
test_status-status-changed-noop[main] 883.3542 (1.26) 883.3542 (1.26) 883.3542 (1.26) 0.0000 (1.0) 883.3542 (1.26) 0.0000 (1.0) 0;0 1.1320 (0.79) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 557.5414 (1.0) 557.5414 (1.0) 557.5414 (1.0) 0.0000 (1.0) 557.5414 (1.0) 0.0000 (1.0) 0;0 1.7936 (1.0) 1 1
test_status-status-noop[2.18.1] 726.0561 (1.30) 726.0561 (1.30) 726.0561 (1.30) 0.0000 (1.0) 726.0561 (1.30) 0.0000 (1.0) 0;0 1.3773 (0.77) 1 1
test_status-status-noop[2.39.0] 746.0064 (1.34) 746.0064 (1.34) 746.0064 (1.34) 0.0000 (1.0) 746.0064 (1.34) 0.0000 (1.0) 0;0 1.3405 (0.75) 1 1
test_status-status-noop[2.40.0] 719.4516 (1.29) 719.4516 (1.29) 719.4516 (1.29) 0.0000 (1.0) 719.4516 (1.29) 0.0000 (1.0) 0;0 1.3899 (0.77) 1 1
test_status-status-noop[2.41.1] 749.6763 (1.34) 749.6763 (1.34) 749.6763 (1.34) 0.0000 (1.0) 749.6763 (1.34) 0.0000 (1.0) 0;0 1.3339 (0.74) 1 1
test_status-status-noop[2.45.0] 772.9559 (1.39) 772.9559 (1.39) 772.9559 (1.39) 0.0000 (1.0) 772.9559 (1.39) 0.0000 (1.0) 0;0 1.2937 (0.72) 1 1
test_status-status-noop[main] 859.7650 (1.54) 859.7650 (1.54) 859.7650 (1.54) 0.0000 (1.0) 859.7650 (1.54) 0.0000 (1.0) 0;0 1.1631 (0.65) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_pull-pull': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 7.2873 (1.07) 7.2873 (1.07) 7.2873 (1.07) 0.0000 (1.0) 7.2873 (1.07) 0.0000 (1.0) 0;0 0.1372 (0.93) 1 1
test_pull-pull[2.18.1] 7.1857 (1.05) 7.1857 (1.05) 7.1857 (1.05) 0.0000 (1.0) 7.1857 (1.05) 0.0000 (1.0) 0;0 0.1392 (0.95) 1 1
test_pull-pull[2.39.0] 8.5093 (1.25) 8.5093 (1.25) 8.5093 (1.25) 0.0000 (1.0) 8.5093 (1.25) 0.0000 (1.0) 0;0 0.1175 (0.80) 1 1
test_pull-pull[2.40.0] 8.5251 (1.25) 8.5251 (1.25) 8.5251 (1.25) 0.0000 (1.0) 8.5251 (1.25) 0.0000 (1.0) 0;0 0.1173 (0.80) 1 1
test_pull-pull[2.41.1] 8.5270 (1.25) 8.5270 (1.25) 8.5270 (1.25) 0.0000 (1.0) 8.5270 (1.25) 0.0000 (1.0) 0;0 0.1173 (0.80) 1 1
test_pull-pull[2.45.0] 6.8135 (1.0) 6.8135 (1.0) 6.8135 (1.0) 0.0000 (1.0) 6.8135 (1.0) 0.0000 (1.0) 0;0 0.1468 (1.0) 1 1
test_pull-pull[main] 6.8652 (1.01) 6.8652 (1.01) 6.8652 (1.01) 0.0000 (1.0) 6.8652 (1.01) 0.0000 (1.0) 0;0 0.1457 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 7.3245 (1.80) 7.3245 (1.80) 7.3245 (1.80) 0.0000 (1.0) 7.3245 (1.80) 0.0000 (1.0) 0;0 0.1365 (0.55) 1 1
test_add-add[2.18.1] 6.1985 (1.53) 6.1985 (1.53) 6.1985 (1.53) 0.0000 (1.0) 6.1985 (1.53) 0.0000 (1.0) 0;0 0.1613 (0.65) 1 1
test_add-add[2.39.0] 6.0821 (1.50) 6.0821 (1.50) 6.0821 (1.50) 0.0000 (1.0) 6.0821 (1.50) 0.0000 (1.0) 0;0 0.1644 (0.67) 1 1
test_add-add[2.40.0] 6.1082 (1.50) 6.1082 (1.50) 6.1082 (1.50) 0.0000 (1.0) 6.1082 (1.50) 0.0000 (1.0) 0;0 0.1637 (0.66) 1 1
test_add-add[2.41.1] 6.2094 (1.53) 6.2094 (1.53) 6.2094 (1.53) 0.0000 (1.0) 6.2094 (1.53) 0.0000 (1.0) 0;0 0.1610 (0.65) 1 1
test_add-add[2.45.0] 4.7147 (1.16) 4.7147 (1.16) 4.7147 (1.16) 0.0000 (1.0) 4.7147 (1.16) 0.0000 (1.0) 0;0 0.2121 (0.86) 1 1
test_add-add[main] 4.0591 (1.0) 4.0591 (1.0) 4.0591 (1.0) 0.0000 (1.0) 4.0591 (1.0) 0.0000 (1.0) 0;0 0.2464 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_init-init': 7 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 339.0883 (1.0) 391.8020 (1.00) 354.0335 (1.0) 7.9838 (1.64) 352.7211 (1.0) 9.1135 (1.71) 23;4 2.8246 (1.0) 100 1
test_init-init[2.18.1] 347.5656 (1.03) 391.6874 (1.0) 360.4535 (1.02) 6.2772 (1.29) 360.2702 (1.02) 7.0802 (1.33) 25;2 2.7743 (0.98) 100 1
test_init-init[2.39.0] 399.6357 (1.18) 492.3850 (1.26) 420.0728 (1.19) 11.7389 (2.42) 418.9686 (1.19) 12.8082 (2.40) 21;2 2.3805 (0.84) 100 1
test_init-init[2.40.0] 400.8823 (1.18) 443.9080 (1.13) 414.1745 (1.17) 7.5019 (1.54) 413.0079 (1.17) 10.1324 (1.90) 26;2 2.4144 (0.85) 100 1
test_init-init[2.41.1] 391.9303 (1.16) 487.7356 (1.25) 415.7287 (1.17) 12.2496 (2.52) 415.1739 (1.18) 14.6308 (2.74) 23;1 2.4054 (0.85) 100 1
test_init-init[2.45.0] 409.3350 (1.21) 442.8462 (1.13) 418.6381 (1.18) 4.8582 (1.0) 417.8766 (1.18) 5.3344 (1.0) 23;2 2.3887 (0.85) 100 1
test_init-init[main] 494.7087 (1.46) 572.8421 (1.46) 515.9488 (1.46) 12.9104 (2.66) 515.7383 (1.46) 15.1913 (2.85) 30;3 1.9382 (0.69) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 3.5546 (1.10) 3.5546 (1.10) 3.5546 (1.10) 0.0000 (1.0) 3.5546 (1.10) 0.0000 (1.0) 0;0 0.2813 (0.91) 1 1
test_push-push[2.18.1] 3.5258 (1.09) 3.5258 (1.09) 3.5258 (1.09) 0.0000 (1.0) 3.5258 (1.09) 0.0000 (1.0) 0;0 0.2836 (0.92) 1 1
test_push-push[2.39.0] 4.5402 (1.40) 4.5402 (1.40) 4.5402 (1.40) 0.0000 (1.0) 4.5402 (1.40) 0.0000 (1.0) 0;0 0.2203 (0.71) 1 1
test_push-push[2.40.0] 4.5531 (1.40) 4.5531 (1.40) 4.5531 (1.40) 0.0000 (1.0) 4.5531 (1.40) 0.0000 (1.0) 0;0 0.2196 (0.71) 1 1
test_push-push[2.41.1] 4.5657 (1.41) 4.5657 (1.41) 4.5657 (1.41) 0.0000 (1.0) 4.5657 (1.41) 0.0000 (1.0) 0;0 0.2190 (0.71) 1 1
test_push-push[2.45.0] 3.2820 (1.01) 3.2820 (1.01) 3.2820 (1.01) 0.0000 (1.0) 3.2820 (1.01) 0.0000 (1.0) 0;0 0.3047 (0.99) 1 1
test_push-push[main] 3.2442 (1.0) 3.2442 (1.0) 3.2442 (1.0) 0.0000 (1.0) 3.2442 (1.0) 0.0000 (1.0) 0;0 0.3082 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.7168 (1.03) 1.7168 (1.03) 1.7168 (1.03) 0.0000 (1.0) 1.7168 (1.03) 0.0000 (1.0) 0;0 0.5825 (0.97) 1 1
test_checkout_hardlink-checkout[2.18.1] 2.2199 (1.34) 2.2199 (1.34) 2.2199 (1.34) 0.0000 (1.0) 2.2199 (1.34) 0.0000 (1.0) 0;0 0.4505 (0.75) 1 1
test_checkout_hardlink-checkout[2.39.0] 1.6886 (1.02) 1.6886 (1.02) 1.6886 (1.02) 0.0000 (1.0) 1.6886 (1.02) 0.0000 (1.0) 0;0 0.5922 (0.98) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.6867 (1.02) 1.6867 (1.02) 1.6867 (1.02) 0.0000 (1.0) 1.6867 (1.02) 0.0000 (1.0) 0;0 0.5929 (0.98) 1 1
test_checkout_hardlink-checkout[2.41.1] 1.6592 (1.0) 1.6592 (1.0) 1.6592 (1.0) 0.0000 (1.0) 1.6592 (1.0) 0.0000 (1.0) 0;0 0.6027 (1.0) 1 1
test_checkout_hardlink-checkout[2.45.0] 2.0841 (1.26) 2.0841 (1.26) 2.0841 (1.26) 0.0000 (1.0) 2.0841 (1.26) 0.0000 (1.0) 0;0 0.4798 (0.80) 1 1
test_checkout_hardlink-checkout[main] 2.1027 (1.27) 2.1027 (1.27) 2.1027 (1.27) 0.0000 (1.0) 2.1027 (1.27) 0.0000 (1.0) 0;0 0.4756 (0.79) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 592.6946 (1.0) 592.6946 (1.0) 592.6946 (1.0) 0.0000 (1.0) 592.6946 (1.0) 0.0000 (1.0) 0;0 1.6872 (1.0) 1 1
test_checkout_hardlink-checkout-noop[2.18.1] 755.3166 (1.27) 755.3166 (1.27) 755.3166 (1.27) 0.0000 (1.0) 755.3166 (1.27) 0.0000 (1.0) 0;0 1.3239 (0.78) 1 1
test_checkout_hardlink-checkout-noop[2.39.0] 791.4719 (1.34) 791.4719 (1.34) 791.4719 (1.34) 0.0000 (1.0) 791.4719 (1.34) 0.0000 (1.0) 0;0 1.2635 (0.75) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 787.7180 (1.33) 787.7180 (1.33) 787.7180 (1.33) 0.0000 (1.0) 787.7180 (1.33) 0.0000 (1.0) 0;0 1.2695 (0.75) 1 1
test_checkout_hardlink-checkout-noop[2.41.1] 796.2046 (1.34) 796.2046 (1.34) 796.2046 (1.34) 0.0000 (1.0) 796.2046 (1.34) 0.0000 (1.0) 0;0 1.2560 (0.74) 1 1
test_checkout_hardlink-checkout-noop[2.45.0] 805.0873 (1.36) 805.0873 (1.36) 805.0873 (1.36) 0.0000 (1.0) 805.0873 (1.36) 0.0000 (1.0) 0;0 1.2421 (0.74) 1 1
test_checkout_hardlink-checkout-noop[main] 873.2520 (1.47) 873.2520 (1.47) 873.2520 (1.47) 0.0000 (1.0) 873.2520 (1.47) 0.0000 (1.0) 0;0 1.1451 (0.68) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.7339 (2.15) 1.7339 (2.15) 1.7339 (2.15) 0.0000 (1.0) 1.7339 (2.15) 0.0000 (1.0) 0;0 0.5767 (0.47) 1 1
test_checkout_hardlink-checkout-update[2.18.1] 0.8071 (1.0) 0.8071 (1.0) 0.8071 (1.0) 0.0000 (1.0) 0.8071 (1.0) 0.0000 (1.0) 0;0 1.2390 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.39.0] 0.8868 (1.10) 0.8868 (1.10) 0.8868 (1.10) 0.0000 (1.0) 0.8868 (1.10) 0.0000 (1.0) 0;0 1.1277 (0.91) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.8750 (1.08) 0.8750 (1.08) 0.8750 (1.08) 0.0000 (1.0) 0.8750 (1.08) 0.0000 (1.0) 0;0 1.1428 (0.92) 1 1
test_checkout_hardlink-checkout-update[2.41.1] 0.9038 (1.12) 0.9038 (1.12) 0.9038 (1.12) 0.0000 (1.0) 0.9038 (1.12) 0.0000 (1.0) 0;0 1.1064 (0.89) 1 1
test_checkout_hardlink-checkout-update[2.45.0] 0.8899 (1.10) 0.8899 (1.10) 0.8899 (1.10) 0.0000 (1.0) 0.8899 (1.10) 0.0000 (1.0) 0;0 1.1237 (0.91) 1 1
test_checkout_hardlink-checkout-update[main] 0.9965 (1.23) 0.9965 (1.23) 0.9965 (1.23) 0.0000 (1.0) 0.9965 (1.23) 0.0000 (1.0) 0;0 1.0035 (0.81) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_update-update': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 11.6917 (1.37) 11.6917 (1.37) 11.6917 (1.37) 0.0000 (1.0) 11.6917 (1.37) 0.0000 (1.0) 0;0 0.0855 (0.73) 1 1
test_update-update[2.18.1] 10.2673 (1.21) 10.2673 (1.21) 10.2673 (1.21) 0.0000 (1.0) 10.2673 (1.21) 0.0000 (1.0) 0;0 0.0974 (0.83) 1 1
test_update-update[2.39.0] 9.4687 (1.11) 9.4687 (1.11) 9.4687 (1.11) 0.0000 (1.0) 9.4687 (1.11) 0.0000 (1.0) 0;0 0.1056 (0.90) 1 1
test_update-update[2.40.0] 9.2329 (1.09) 9.2329 (1.09) 9.2329 (1.09) 0.0000 (1.0) 9.2329 (1.09) 0.0000 (1.0) 0;0 0.1083 (0.92) 1 1
test_update-update[2.41.1] 9.4079 (1.11) 9.4079 (1.11) 9.4079 (1.11) 0.0000 (1.0) 9.4079 (1.11) 0.0000 (1.0) 0;0 0.1063 (0.90) 1 1
test_update-update[2.45.0] 9.8364 (1.16) 9.8364 (1.16) 9.8364 (1.16) 0.0000 (1.0) 9.8364 (1.16) 0.0000 (1.0) 0;0 0.1017 (0.86) 1 1
test_update-update[main] 8.5076 (1.0) 8.5076 (1.0) 8.5076 (1.0) 0.0000 (1.0) 8.5076 (1.0) 0.0000 (1.0) 0;0 0.1175 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 7 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 662.3819 (1.0) 662.3819 (1.0) 662.3819 (1.0) 0.0000 (1.0) 662.3819 (1.0) 0.0000 (1.0) 0;0 1.5097 (1.0) 1 1
test_update-update-noop[2.18.1] 792.7173 (1.20) 792.7173 (1.20) 792.7173 (1.20) 0.0000 (1.0) 792.7173 (1.20) 0.0000 (1.0) 0;0 1.2615 (0.84) 1 1
test_update-update-noop[2.39.0] 1,215.5593 (1.84) 1,215.5593 (1.84) 1,215.5593 (1.84) 0.0000 (1.0) 1,215.5593 (1.84) 0.0000 (1.0) 0;0 0.8227 (0.54) 1 1
test_update-update-noop[2.40.0] 1,162.6775 (1.76) 1,162.6775 (1.76) 1,162.6775 (1.76) 0.0000 (1.0) 1,162.6775 (1.76) 0.0000 (1.0) 0;0 0.8601 (0.57) 1 1
test_update-update-noop[2.41.1] 1,172.5962 (1.77) 1,172.5962 (1.77) 1,172.5962 (1.77) 0.0000 (1.0) 1,172.5962 (1.77) 0.0000 (1.0) 0;0 0.8528 (0.56) 1 1
test_update-update-noop[2.45.0] 1,310.2494 (1.98) 1,310.2494 (1.98) 1,310.2494 (1.98) 0.0000 (1.0) 1,310.2494 (1.98) 0.0000 (1.0) 0;0 0.7632 (0.51) 1 1
test_update-update-noop[main] 1,412.5536 (2.13) 1,412.5536 (2.13) 1,412.5536 (2.13) 0.0000 (1.0) 1,412.5536 (2.13) 0.0000 (1.0) 0;0 0.7079 (0.47) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.18.1] 880.7912 (1.0) 880.7912 (1.0) 880.7912 (1.0) 0.0000 (1.0) 880.7912 (1.0) 0.0000 (1.0) 0;0 1.1353 (1.0) 1 1
test_data_status-data-changed[2.39.0] 900.8350 (1.02) 900.8350 (1.02) 900.8350 (1.02) 0.0000 (1.0) 900.8350 (1.02) 0.0000 (1.0) 0;0 1.1101 (0.98) 1 1
test_data_status-data-changed[2.40.0] 956.3295 (1.09) 956.3295 (1.09) 956.3295 (1.09) 0.0000 (1.0) 956.3295 (1.09) 0.0000 (1.0) 0;0 1.0457 (0.92) 1 1
test_data_status-data-changed[2.41.1] 919.3338 (1.04) 919.3338 (1.04) 919.3338 (1.04) 0.0000 (1.0) 919.3338 (1.04) 0.0000 (1.0) 0;0 1.0877 (0.96) 1 1
test_data_status-data-changed[2.45.0] 886.2319 (1.01) 886.2319 (1.01) 886.2319 (1.01) 0.0000 (1.0) 886.2319 (1.01) 0.0000 (1.0) 0;0 1.1284 (0.99) 1 1
test_data_status-data-changed[main] 1,008.7314 (1.15) 1,008.7314 (1.15) 1,008.7314 (1.15) 0.0000 (1.0) 1,008.7314 (1.15) 0.0000 (1.0) 0;0 0.9913 (0.87) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.18.1] 903.5771 (1.05) 903.5771 (1.05) 903.5771 (1.05) 0.0000 (1.0) 903.5771 (1.05) 0.0000 (1.0) 0;0 1.1067 (0.95) 1 1
test_data_status-data-changed-noop[2.39.0] 950.2541 (1.10) 950.2541 (1.10) 950.2541 (1.10) 0.0000 (1.0) 950.2541 (1.10) 0.0000 (1.0) 0;0 1.0524 (0.91) 1 1
test_data_status-data-changed-noop[2.40.0] 938.8018 (1.09) 938.8018 (1.09) 938.8018 (1.09) 0.0000 (1.0) 938.8018 (1.09) 0.0000 (1.0) 0;0 1.0652 (0.92) 1 1
test_data_status-data-changed-noop[2.41.1] 949.5250 (1.10) 949.5250 (1.10) 949.5250 (1.10) 0.0000 (1.0) 949.5250 (1.10) 0.0000 (1.0) 0;0 1.0532 (0.91) 1 1
test_data_status-data-changed-noop[2.45.0] 862.3854 (1.0) 862.3854 (1.0) 862.3854 (1.0) 0.0000 (1.0) 862.3854 (1.0) 0.0000 (1.0) 0;0 1.1596 (1.0) 1 1
test_data_status-data-changed-noop[main] 991.5602 (1.15) 991.5602 (1.15) 991.5602 (1.15) 0.0000 (1.0) 991.5602 (1.15) 0.0000 (1.0) 0;0 1.0085 (0.87) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.18.1] 1.9833 (1.03) 1.9833 (1.03) 1.9833 (1.03) 0.0000 (1.0) 1.9833 (1.03) 0.0000 (1.0) 0;0 0.5042 (0.97) 1 1
test_data_status-data-new[2.39.0] 2.0583 (1.07) 2.0583 (1.07) 2.0583 (1.07) 0.0000 (1.0) 2.0583 (1.07) 0.0000 (1.0) 0;0 0.4858 (0.93) 1 1
test_data_status-data-new[2.40.0] 2.0391 (1.06) 2.0391 (1.06) 2.0391 (1.06) 0.0000 (1.0) 2.0391 (1.06) 0.0000 (1.0) 0;0 0.4904 (0.94) 1 1
test_data_status-data-new[2.41.1] 2.0655 (1.08) 2.0655 (1.08) 2.0655 (1.08) 0.0000 (1.0) 2.0655 (1.08) 0.0000 (1.0) 0;0 0.4841 (0.93) 1 1
test_data_status-data-new[2.45.0] 1.9172 (1.0) 1.9172 (1.0) 1.9172 (1.0) 0.0000 (1.0) 1.9172 (1.0) 0.0000 (1.0) 0;0 0.5216 (1.0) 1 1
test_data_status-data-new[main] 2.0079 (1.05) 2.0079 (1.05) 2.0079 (1.05) 0.0000 (1.0) 2.0079 (1.05) 0.0000 (1.0) 0;0 0.4980 (0.95) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.18.1] 885.0026 (1.0) 885.0026 (1.0) 885.0026 (1.0) 0.0000 (1.0) 885.0026 (1.0) 0.0000 (1.0) 0;0 1.1299 (1.0) 1 1
test_data_status-data-noop[2.39.0] 902.3202 (1.02) 902.3202 (1.02) 902.3202 (1.02) 0.0000 (1.0) 902.3202 (1.02) 0.0000 (1.0) 0;0 1.1083 (0.98) 1 1
test_data_status-data-noop[2.40.0] 920.2003 (1.04) 920.2003 (1.04) 920.2003 (1.04) 0.0000 (1.0) 920.2003 (1.04) 0.0000 (1.0) 0;0 1.0867 (0.96) 1 1
test_data_status-data-noop[2.41.1] 912.1554 (1.03) 912.1554 (1.03) 912.1554 (1.03) 0.0000 (1.0) 912.1554 (1.03) 0.0000 (1.0) 0;0 1.0963 (0.97) 1 1
test_data_status-data-noop[2.45.0] 888.4644 (1.00) 888.4644 (1.00) 888.4644 (1.00) 0.0000 (1.0) 888.4644 (1.00) 0.0000 (1.0) 0;0 1.1255 (1.00) 1 1
test_data_status-data-noop[main] 1,026.8438 (1.16) 1,026.8438 (1.16) 1,026.8438 (1.16) 0.0000 (1.0) 1,026.8438 (1.16) 0.0000 (1.0) 0;0 0.9739 (0.86) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.11.0] 4.6654 (1.17) 4.6654 (1.17) 4.6654 (1.17) 0.0000 (1.0) 4.6654 (1.17) 0.0000 (1.0) 0;0 0.2143 (0.85) 1 1
test_exp_show-exp[2.18.1] 4.7466 (1.19) 4.7466 (1.19) 4.7466 (1.19) 0.0000 (1.0) 4.7466 (1.19) 0.0000 (1.0) 0;0 0.2107 (0.84) 1 1
test_exp_show-exp[2.39.0] 4.0285 (1.01) 4.0285 (1.01) 4.0285 (1.01) 0.0000 (1.0) 4.0285 (1.01) 0.0000 (1.0) 0;0 0.2482 (0.99) 1 1
test_exp_show-exp[2.40.0] 4.1200 (1.03) 4.1200 (1.03) 4.1200 (1.03) 0.0000 (1.0) 4.1200 (1.03) 0.0000 (1.0) 0;0 0.2427 (0.97) 1 1
test_exp_show-exp[2.41.1] 3.9853 (1.0) 3.9853 (1.0) 3.9853 (1.0) 0.0000 (1.0) 3.9853 (1.0) 0.0000 (1.0) 0;0 0.2509 (1.0) 1 1
test_exp_show-exp[2.45.0] 4.1118 (1.03) 4.1118 (1.03) 4.1118 (1.03) 0.0000 (1.0) 4.1118 (1.03) 0.0000 (1.0) 0;0 0.2432 (0.97) 1 1
test_exp_show-exp[main] 5.2086 (1.31) 5.2086 (1.31) 5.2086 (1.31) 0.0000 (1.0) 5.2086 (1.31) 0.0000 (1.0) 0;0 0.1920 (0.77) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 425.7704 (1.07) 425.7704 (1.07) 425.7704 (1.07) 0.0000 (1.0) 425.7704 (1.07) 0.0000 (1.0) 0;0 2.3487 (0.93) 1 1
test_list-list[2.18.1] 397.4351 (1.0) 397.4351 (1.0) 397.4351 (1.0) 0.0000 (1.0) 397.4351 (1.0) 0.0000 (1.0) 0;0 2.5161 (1.0) 1 1
test_list-list[2.39.0] 433.5179 (1.09) 433.5179 (1.09) 433.5179 (1.09) 0.0000 (1.0) 433.5179 (1.09) 0.0000 (1.0) 0;0 2.3067 (0.92) 1 1
test_list-list[2.40.0] 418.1285 (1.05) 418.1285 (1.05) 418.1285 (1.05) 0.0000 (1.0) 418.1285 (1.05) 0.0000 (1.0) 0;0 2.3916 (0.95) 1 1
test_list-list[2.41.1] 419.0290 (1.05) 419.0290 (1.05) 419.0290 (1.05) 0.0000 (1.0) 419.0290 (1.05) 0.0000 (1.0) 0;0 2.3865 (0.95) 1 1
test_list-list[2.45.0] 439.3149 (1.11) 439.3149 (1.11) 439.3149 (1.11) 0.0000 (1.0) 439.3149 (1.11) 0.0000 (1.0) 0;0 2.2763 (0.90) 1 1
test_list-list[main] 523.2382 (1.32) 523.2382 (1.32) 523.2382 (1.32) 0.0000 (1.0) 523.2382 (1.32) 0.0000 (1.0) 0;0 1.9112 (0.76) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 420.9613 (1.10) 420.9613 (1.10) 420.9613 (1.10) 0.0000 (1.0) 420.9613 (1.10) 0.0000 (1.0) 0;0 2.3755 (0.91) 1 1
test_list-list-dvc-only[2.18.1] 381.1763 (1.0) 381.1763 (1.0) 381.1763 (1.0) 0.0000 (1.0) 381.1763 (1.0) 0.0000 (1.0) 0;0 2.6235 (1.0) 1 1
test_list-list-dvc-only[2.39.0] 411.3723 (1.08) 411.3723 (1.08) 411.3723 (1.08) 0.0000 (1.0) 411.3723 (1.08) 0.0000 (1.0) 0;0 2.4309 (0.93) 1 1
test_list-list-dvc-only[2.40.0] 429.3594 (1.13) 429.3594 (1.13) 429.3594 (1.13) 0.0000 (1.0) 429.3594 (1.13) 0.0000 (1.0) 0;0 2.3291 (0.89) 1 1
test_list-list-dvc-only[2.41.1] 414.7995 (1.09) 414.7995 (1.09) 414.7995 (1.09) 0.0000 (1.0) 414.7995 (1.09) 0.0000 (1.0) 0;0 2.4108 (0.92) 1 1
test_list-list-dvc-only[2.45.0] 519.2006 (1.36) 519.2006 (1.36) 519.2006 (1.36) 0.0000 (1.0) 519.2006 (1.36) 0.0000 (1.0) 0;0 1.9260 (0.73) 1 1
test_list-list-dvc-only[main] 511.3399 (1.34) 511.3399 (1.34) 511.3399 (1.34) 0.0000 (1.0) 511.3399 (1.34) 0.0000 (1.0) 0;0 1.9556 (0.75) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.6727 (3.48) 1.6727 (3.48) 1.6727 (3.48) 0.0000 (1.0) 1.6727 (3.48) 0.0000 (1.0) 0;0 0.5978 (0.29) 1 1
test_list-list-recursive[2.18.1] 2.3484 (4.88) 2.3484 (4.88) 2.3484 (4.88) 0.0000 (1.0) 2.3484 (4.88) 0.0000 (1.0) 0;0 0.4258 (0.20) 1 1
test_list-list-recursive[2.39.0] 0.7897 (1.64) 0.7897 (1.64) 0.7897 (1.64) 0.0000 (1.0) 0.7897 (1.64) 0.0000 (1.0) 0;0 1.2663 (0.61) 1 1
test_list-list-recursive[2.40.0] 0.4828 (1.00) 0.4828 (1.00) 0.4828 (1.00) 0.0000 (1.0) 0.4828 (1.00) 0.0000 (1.0) 0;0 2.0712 (1.00) 1 1
test_list-list-recursive[2.41.1] 0.4813 (1.0) 0.4813 (1.0) 0.4813 (1.0) 0.0000 (1.0) 0.4813 (1.0) 0.0000 (1.0) 0;0 2.0776 (1.0) 1 1
test_list-list-recursive[2.45.0] 0.4820 (1.00) 0.4820 (1.00) 0.4820 (1.00) 0.0000 (1.0) 0.4820 (1.00) 0.0000 (1.0) 0;0 2.0746 (1.00) 1 1
test_list-list-recursive[main] 0.6119 (1.27) 0.6119 (1.27) 0.6119 (1.27) 0.0000 (1.0) 0.6119 (1.27) 0.0000 (1.0) 0;0 1.6342 (0.79) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 416.5494 (1.0) 416.5494 (1.0) 416.5494 (1.0) 0.0000 (1.0) 416.5494 (1.0) 0.0000 (1.0) 0;0 2.4007 (1.0) 1 1
test_list-list-shallow[2.18.1] 424.5853 (1.02) 424.5853 (1.02) 424.5853 (1.02) 0.0000 (1.0) 424.5853 (1.02) 0.0000 (1.0) 0;0 2.3552 (0.98) 1 1
test_list-list-shallow[2.39.0] 440.4601 (1.06) 440.4601 (1.06) 440.4601 (1.06) 0.0000 (1.0) 440.4601 (1.06) 0.0000 (1.0) 0;0 2.2704 (0.95) 1 1
test_list-list-shallow[2.40.0] 437.4102 (1.05) 437.4102 (1.05) 437.4102 (1.05) 0.0000 (1.0) 437.4102 (1.05) 0.0000 (1.0) 0;0 2.2862 (0.95) 1 1
test_list-list-shallow[2.41.1] 436.2963 (1.05) 436.2963 (1.05) 436.2963 (1.05) 0.0000 (1.0) 436.2963 (1.05) 0.0000 (1.0) 0;0 2.2920 (0.95) 1 1
test_list-list-shallow[2.45.0] 445.8632 (1.07) 445.8632 (1.07) 445.8632 (1.07) 0.0000 (1.0) 445.8632 (1.07) 0.0000 (1.0) 0;0 2.2428 (0.93) 1 1
test_list-list-shallow[main] 522.5217 (1.25) 522.5217 (1.25) 522.5217 (1.25) 0.0000 (1.0) 522.5217 (1.25) 0.0000 (1.0) 0;0 1.9138 (0.80) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 161.9114 (1.0) 167.1100 (1.0) 164.0105 (1.0) 1.2246 (1.75) 163.7575 (1.0) 1.8600 (2.36) 36;0 6.0972 (1.0) 100 1
test_help---help[2.18.1] 169.6102 (1.05) 173.6207 (1.04) 170.8949 (1.04) 0.6998 (1.0) 170.7389 (1.04) 0.7896 (1.0) 30;3 5.8516 (0.96) 100 1
test_help---help[2.39.0] 219.9581 (1.36) 226.9539 (1.36) 222.2979 (1.36) 1.2103 (1.73) 222.2498 (1.36) 1.5498 (1.96) 29;2 4.4985 (0.74) 100 1
test_help---help[2.40.0] 220.8301 (1.36) 225.8843 (1.35) 222.8301 (1.36) 0.9190 (1.31) 222.6347 (1.36) 1.1869 (1.50) 29;2 4.4877 (0.74) 100 1
test_help---help[2.41.1] 220.5628 (1.36) 226.4643 (1.36) 222.5809 (1.36) 1.0526 (1.50) 222.3161 (1.36) 1.2594 (1.60) 30;3 4.4927 (0.74) 100 1
test_help---help[2.45.0] 167.9599 (1.04) 180.5995 (1.08) 170.3370 (1.04) 1.8865 (2.70) 169.6291 (1.04) 1.8772 (2.38) 23;4 5.8707 (0.96) 100 1
test_help---help[main] 172.1434 (1.06) 180.9260 (1.08) 174.4230 (1.06) 1.5885 (2.27) 174.1859 (1.06) 1.7681 (2.24) 21;5 5.7332 (0.94) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 2.1058 (1.22) 2.1058 (1.22) 2.1058 (1.22) 0.0000 (1.0) 2.1058 (1.22) 0.0000 (1.0) 0;0 0.4749 (0.82) 1 1
test_diff-diff[2.18.1] 1.7286 (1.0) 1.7286 (1.0) 1.7286 (1.0) 0.0000 (1.0) 1.7286 (1.0) 0.0000 (1.0) 0;0 0.5785 (1.0) 1 1
test_diff-diff[2.39.0] 1.7783 (1.03) 1.7783 (1.03) 1.7783 (1.03) 0.0000 (1.0) 1.7783 (1.03) 0.0000 (1.0) 0;0 0.5623 (0.97) 1 1
test_diff-diff[2.40.0] 1.7898 (1.04) 1.7898 (1.04) 1.7898 (1.04) 0.0000 (1.0) 1.7898 (1.04) 0.0000 (1.0) 0;0 0.5587 (0.97) 1 1
test_diff-diff[2.41.1] 1.7825 (1.03) 1.7825 (1.03) 1.7825 (1.03) 0.0000 (1.0) 1.7825 (1.03) 0.0000 (1.0) 0;0 0.5610 (0.97) 1 1
test_diff-diff[2.45.0] 1.7525 (1.01) 1.7525 (1.01) 1.7525 (1.01) 0.0000 (1.0) 1.7525 (1.01) 0.0000 (1.0) 0;0 0.5706 (0.99) 1 1
test_diff-diff[main] 1.7345 (1.00) 1.7345 (1.00) 1.7345 (1.00) 0.0000 (1.0) 1.7345 (1.00) 0.0000 (1.0) 0;0 0.5765 (1.00) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.3784 (1.73) 1.3784 (1.73) 1.3784 (1.73) 0.0000 (1.0) 1.3784 (1.73) 0.0000 (1.0) 0;0 0.7255 (0.58) 1 1
test_diff-diff-changed[2.18.1] 0.7972 (1.0) 0.7972 (1.0) 0.7972 (1.0) 0.0000 (1.0) 0.7972 (1.0) 0.0000 (1.0) 0;0 1.2544 (1.0) 1 1
test_diff-diff-changed[2.39.0] 0.8332 (1.05) 0.8332 (1.05) 0.8332 (1.05) 0.0000 (1.0) 0.8332 (1.05) 0.0000 (1.0) 0;0 1.2002 (0.96) 1 1
test_diff-diff-changed[2.40.0] 0.8436 (1.06) 0.8436 (1.06) 0.8436 (1.06) 0.0000 (1.0) 0.8436 (1.06) 0.0000 (1.0) 0;0 1.1854 (0.94) 1 1
test_diff-diff-changed[2.41.1] 0.8111 (1.02) 0.8111 (1.02) 0.8111 (1.02) 0.0000 (1.0) 0.8111 (1.02) 0.0000 (1.0) 0;0 1.2328 (0.98) 1 1
test_diff-diff-changed[2.45.0] 0.8592 (1.08) 0.8592 (1.08) 0.8592 (1.08) 0.0000 (1.0) 0.8592 (1.08) 0.0000 (1.0) 0;0 1.1639 (0.93) 1 1
test_diff-diff-changed[main] 0.9420 (1.18) 0.9420 (1.18) 0.9420 (1.18) 0.0000 (1.0) 0.9420 (1.18) 0.0000 (1.0) 0;0 1.0615 (0.85) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 595.2815 (1.0) 595.2815 (1.0) 595.2815 (1.0) 0.0000 (1.0) 595.2815 (1.0) 0.0000 (1.0) 0;0 1.6799 (1.0) 1 1
test_diff-diff-changed-noop[2.18.1] 786.6961 (1.32) 786.6961 (1.32) 786.6961 (1.32) 0.0000 (1.0) 786.6961 (1.32) 0.0000 (1.0) 0;0 1.2711 (0.76) 1 1
test_diff-diff-changed-noop[2.39.0] 817.4184 (1.37) 817.4184 (1.37) 817.4184 (1.37) 0.0000 (1.0) 817.4184 (1.37) 0.0000 (1.0) 0;0 1.2234 (0.73) 1 1
test_diff-diff-changed-noop[2.40.0] 826.3221 (1.39) 826.3221 (1.39) 826.3221 (1.39) 0.0000 (1.0) 826.3221 (1.39) 0.0000 (1.0) 0;0 1.2102 (0.72) 1 1
test_diff-diff-changed-noop[2.41.1] 820.6060 (1.38) 820.6060 (1.38) 820.6060 (1.38) 0.0000 (1.0) 820.6060 (1.38) 0.0000 (1.0) 0;0 1.2186 (0.73) 1 1
test_diff-diff-changed-noop[2.45.0] 843.6671 (1.42) 843.6671 (1.42) 843.6671 (1.42) 0.0000 (1.0) 843.6671 (1.42) 0.0000 (1.0) 0;0 1.1853 (0.71) 1 1
test_diff-diff-changed-noop[main] 887.0077 (1.49) 887.0077 (1.49) 887.0077 (1.49) 0.0000 (1.0) 887.0077 (1.49) 0.0000 (1.0) 0;0 1.1274 (0.67) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 550.2387 (1.0) 550.2387 (1.0) 550.2387 (1.0) 0.0000 (1.0) 550.2387 (1.0) 0.0000 (1.0) 0;0 1.8174 (1.0) 1 1
test_diff-diff-noop[2.18.1] 732.9666 (1.33) 732.9666 (1.33) 732.9666 (1.33) 0.0000 (1.0) 732.9666 (1.33) 0.0000 (1.0) 0;0 1.3643 (0.75) 1 1
test_diff-diff-noop[2.39.0] 769.6819 (1.40) 769.6819 (1.40) 769.6819 (1.40) 0.0000 (1.0) 769.6819 (1.40) 0.0000 (1.0) 0;0 1.2992 (0.71) 1 1
test_diff-diff-noop[2.40.0] 794.7948 (1.44) 794.7948 (1.44) 794.7948 (1.44) 0.0000 (1.0) 794.7948 (1.44) 0.0000 (1.0) 0;0 1.2582 (0.69) 1 1
test_diff-diff-noop[2.41.1] 771.9395 (1.40) 771.9395 (1.40) 771.9395 (1.40) 0.0000 (1.0) 771.9395 (1.40) 0.0000 (1.0) 0;0 1.2954 (0.71) 1 1
test_diff-diff-noop[2.45.0] 791.1263 (1.44) 791.1263 (1.44) 791.1263 (1.44) 0.0000 (1.0) 791.1263 (1.44) 0.0000 (1.0) 0;0 1.2640 (0.70) 1 1
test_diff-diff-noop[main] 838.4786 (1.52) 838.4786 (1.52) 838.4786 (1.52) 0.0000 (1.0) 838.4786 (1.52) 0.0000 (1.0) 0;0 1.1926 (0.66) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 3.1538 (1.01) 3.1538 (1.01) 3.1538 (1.01) 0.0000 (1.0) 3.1538 (1.01) 0.0000 (1.0) 0;0 0.3171 (0.99) 1 1
test_checkout_copy-checkout[2.18.1] 3.1365 (1.0) 3.1365 (1.0) 3.1365 (1.0) 0.0000 (1.0) 3.1365 (1.0) 0.0000 (1.0) 0;0 0.3188 (1.0) 1 1
test_checkout_copy-checkout[2.39.0] 3.5080 (1.12) 3.5080 (1.12) 3.5080 (1.12) 0.0000 (1.0) 3.5080 (1.12) 0.0000 (1.0) 0;0 0.2851 (0.89) 1 1
test_checkout_copy-checkout[2.40.0] 3.6344 (1.16) 3.6344 (1.16) 3.6344 (1.16) 0.0000 (1.0) 3.6344 (1.16) 0.0000 (1.0) 0;0 0.2751 (0.86) 1 1
test_checkout_copy-checkout[2.41.1] 3.5265 (1.12) 3.5265 (1.12) 3.5265 (1.12) 0.0000 (1.0) 3.5265 (1.12) 0.0000 (1.0) 0;0 0.2836 (0.89) 1 1
test_checkout_copy-checkout[2.45.0] 4.0073 (1.28) 4.0073 (1.28) 4.0073 (1.28) 0.0000 (1.0) 4.0073 (1.28) 0.0000 (1.0) 0;0 0.2495 (0.78) 1 1
test_checkout_copy-checkout[main] 3.4935 (1.11) 3.4935 (1.11) 3.4935 (1.11) 0.0000 (1.0) 3.4935 (1.11) 0.0000 (1.0) 0;0 0.2862 (0.90) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 504.5525 (1.0) 504.5525 (1.0) 504.5525 (1.0) 0.0000 (1.0) 504.5525 (1.0) 0.0000 (1.0) 0;0 1.9820 (1.0) 1 1
test_checkout_copy-checkout-noop[2.18.1] 563.7215 (1.12) 563.7215 (1.12) 563.7215 (1.12) 0.0000 (1.0) 563.7215 (1.12) 0.0000 (1.0) 0;0 1.7739 (0.90) 1 1
test_checkout_copy-checkout-noop[2.39.0] 599.3989 (1.19) 599.3989 (1.19) 599.3989 (1.19) 0.0000 (1.0) 599.3989 (1.19) 0.0000 (1.0) 0;0 1.6683 (0.84) 1 1
test_checkout_copy-checkout-noop[2.40.0] 590.6235 (1.17) 590.6235 (1.17) 590.6235 (1.17) 0.0000 (1.0) 590.6235 (1.17) 0.0000 (1.0) 0;0 1.6931 (0.85) 1 1
test_checkout_copy-checkout-noop[2.41.1] 601.9428 (1.19) 601.9428 (1.19) 601.9428 (1.19) 0.0000 (1.0) 601.9428 (1.19) 0.0000 (1.0) 0;0 1.6613 (0.84) 1 1
test_checkout_copy-checkout-noop[2.45.0] 609.0552 (1.21) 609.0552 (1.21) 609.0552 (1.21) 0.0000 (1.0) 609.0552 (1.21) 0.0000 (1.0) 0;0 1.6419 (0.83) 1 1
test_checkout_copy-checkout-noop[main] 680.5534 (1.35) 680.5534 (1.35) 680.5534 (1.35) 0.0000 (1.0) 680.5534 (1.35) 0.0000 (1.0) 0;0 1.4694 (0.74) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.2966 (1.96) 1.2966 (1.96) 1.2966 (1.96) 0.0000 (1.0) 1.2966 (1.96) 0.0000 (1.0) 0;0 0.7713 (0.51) 1 1
test_checkout_copy-checkout-update[2.18.1] 0.6629 (1.00) 0.6629 (1.00) 0.6629 (1.00) 0.0000 (1.0) 0.6629 (1.00) 0.0000 (1.0) 0;0 1.5085 (1.00) 1 1
test_checkout_copy-checkout-update[2.39.0] 0.6657 (1.01) 0.6657 (1.01) 0.6657 (1.01) 0.0000 (1.0) 0.6657 (1.01) 0.0000 (1.0) 0;0 1.5022 (0.99) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.6660 (1.01) 0.6660 (1.01) 0.6660 (1.01) 0.0000 (1.0) 0.6660 (1.01) 0.0000 (1.0) 0;0 1.5015 (0.99) 1 1
test_checkout_copy-checkout-update[2.41.1] 0.6608 (1.0) 0.6608 (1.0) 0.6608 (1.0) 0.0000 (1.0) 0.6608 (1.0) 0.0000 (1.0) 0;0 1.5134 (1.0) 1 1
test_checkout_copy-checkout-update[2.45.0] 0.6799 (1.03) 0.6799 (1.03) 0.6799 (1.03) 0.0000 (1.0) 0.6799 (1.03) 0.0000 (1.0) 0;0 1.4708 (0.97) 1 1
test_checkout_copy-checkout-update[main] 0.7351 (1.11) 0.7351 (1.11) 0.7351 (1.11) 0.0000 (1.0) 0.7351 (1.11) 0.0000 (1.0) 0;0 1.3603 (0.90) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 11.8437 (1.48) 11.8437 (1.48) 11.8437 (1.48) 0.0000 (1.0) 11.8437 (1.48) 0.0000 (1.0) 0;0 0.0844 (0.68) 1 1
test_import-import[2.18.1] 11.2803 (1.41) 11.2803 (1.41) 11.2803 (1.41) 0.0000 (1.0) 11.2803 (1.41) 0.0000 (1.0) 0;0 0.0886 (0.71) 1 1
test_import-import[2.39.0] 9.9732 (1.25) 9.9732 (1.25) 9.9732 (1.25) 0.0000 (1.0) 9.9732 (1.25) 0.0000 (1.0) 0;0 0.1003 (0.80) 1 1
test_import-import[2.40.0] 10.1796 (1.27) 10.1796 (1.27) 10.1796 (1.27) 0.0000 (1.0) 10.1796 (1.27) 0.0000 (1.0) 0;0 0.0982 (0.79) 1 1
test_import-import[2.41.1] 9.6672 (1.21) 9.6672 (1.21) 9.6672 (1.21) 0.0000 (1.0) 9.6672 (1.21) 0.0000 (1.0) 0;0 0.1034 (0.83) 1 1
test_import-import[2.45.0] 8.0066 (1.0) 8.0066 (1.0) 8.0066 (1.0) 0.0000 (1.0) 8.0066 (1.0) 0.0000 (1.0) 0;0 0.1249 (1.0) 1 1
test_import-import[main] 8.5796 (1.07) 8.5796 (1.07) 8.5796 (1.07) 0.0000 (1.0) 8.5796 (1.07) 0.0000 (1.0) 0;0 0.1166 (0.93) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 2.9918 (5.22) 2.9918 (5.22) 2.9918 (5.22) 0.0000 (1.0) 2.9918 (5.22) 0.0000 (1.0) 0;0 0.3342 (0.19) 1 1
test_partial_remove-add[2.18.1] 2.4963 (4.36) 2.4963 (4.36) 2.4963 (4.36) 0.0000 (1.0) 2.4963 (4.36) 0.0000 (1.0) 0;0 0.4006 (0.23) 1 1
test_partial_remove-add[2.39.0] 3.3415 (5.84) 3.3415 (5.84) 3.3415 (5.84) 0.0000 (1.0) 3.3415 (5.84) 0.0000 (1.0) 0;0 0.2993 (0.17) 1 1
test_partial_remove-add[2.40.0] 0.5726 (1.0) 0.5726 (1.0) 0.5726 (1.0) 0.0000 (1.0) 0.5726 (1.0) 0.0000 (1.0) 0;0 1.7464 (1.0) 1 1
test_partial_remove-add[2.41.1] 1.8926 (3.31) 1.8926 (3.31) 1.8926 (3.31) 0.0000 (1.0) 1.8926 (3.31) 0.0000 (1.0) 0;0 0.5284 (0.30) 1 1
test_partial_remove-add[2.45.0] 1.9580 (3.42) 1.9580 (3.42) 1.9580 (3.42) 0.0000 (1.0) 1.9580 (3.42) 0.0000 (1.0) 0;0 0.5107 (0.29) 1 1
test_partial_remove-add[main] 1.6189 (2.83) 1.6189 (2.83) 1.6189 (2.83) 0.0000 (1.0) 1.6189 (2.83) 0.0000 (1.0) 0;0 0.6177 (0.35) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 433.1962 (1.0) 433.1962 (1.0) 433.1962 (1.0) 0.0000 (1.0) 433.1962 (1.0) 0.0000 (1.0) 0;0 2.3084 (1.0) 1 1
test_partial_remove-gc[2.18.1] 468.8398 (1.08) 468.8398 (1.08) 468.8398 (1.08) 0.0000 (1.0) 468.8398 (1.08) 0.0000 (1.0) 0;0 2.1329 (0.92) 1 1
test_partial_remove-gc[2.39.0] 490.7755 (1.13) 490.7755 (1.13) 490.7755 (1.13) 0.0000 (1.0) 490.7755 (1.13) 0.0000 (1.0) 0;0 2.0376 (0.88) 1 1
test_partial_remove-gc[2.40.0] 512.5976 (1.18) 512.5976 (1.18) 512.5976 (1.18) 0.0000 (1.0) 512.5976 (1.18) 0.0000 (1.0) 0;0 1.9508 (0.85) 1 1
test_partial_remove-gc[2.41.1] 496.1010 (1.15) 496.1010 (1.15) 496.1010 (1.15) 0.0000 (1.0) 496.1010 (1.15) 0.0000 (1.0) 0;0 2.0157 (0.87) 1 1
test_partial_remove-gc[2.45.0] 495.3925 (1.14) 495.3925 (1.14) 495.3925 (1.14) 0.0000 (1.0) 495.3925 (1.14) 0.0000 (1.0) 0;0 2.0186 (0.87) 1 1
test_partial_remove-gc[main] 575.1386 (1.33) 575.1386 (1.33) 575.1386 (1.33) 0.0000 (1.0) 575.1386 (1.33) 0.0000 (1.0) 0;0 1.7387 (0.75) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 475.9699 (1.0) 475.9699 (1.0) 475.9699 (1.0) 0.0000 (1.0) 475.9699 (1.0) 0.0000 (1.0) 0;0 2.1010 (1.0) 1 1
test_partial_remove-gc-cloud[2.18.1] 509.2588 (1.07) 509.2588 (1.07) 509.2588 (1.07) 0.0000 (1.0) 509.2588 (1.07) 0.0000 (1.0) 0;0 1.9636 (0.93) 1 1
test_partial_remove-gc-cloud[2.39.0] 527.7152 (1.11) 527.7152 (1.11) 527.7152 (1.11) 0.0000 (1.0) 527.7152 (1.11) 0.0000 (1.0) 0;0 1.8950 (0.90) 1 1
test_partial_remove-gc-cloud[2.40.0] 532.9000 (1.12) 532.9000 (1.12) 532.9000 (1.12) 0.0000 (1.0) 532.9000 (1.12) 0.0000 (1.0) 0;0 1.8765 (0.89) 1 1
test_partial_remove-gc-cloud[2.41.1] 553.2740 (1.16) 553.2740 (1.16) 553.2740 (1.16) 0.0000 (1.0) 553.2740 (1.16) 0.0000 (1.0) 0;0 1.8074 (0.86) 1 1
test_partial_remove-gc-cloud[2.45.0] 531.9755 (1.12) 531.9755 (1.12) 531.9755 (1.12) 0.0000 (1.0) 531.9755 (1.12) 0.0000 (1.0) 0;0 1.8798 (0.89) 1 1
test_partial_remove-gc-cloud[main] 618.0235 (1.30) 618.0235 (1.30) 618.0235 (1.30) 0.0000 (1.0) 618.0235 (1.30) 0.0000 (1.0) 0;0 1.6181 (0.77) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 437.1779 (1.03) 437.1779 (1.03) 437.1779 (1.03) 0.0000 (1.0) 437.1779 (1.03) 0.0000 (1.0) 0;0 2.2874 (0.98) 1 1
test_partial_remove-push[2.18.1] 461.5320 (1.08) 461.5320 (1.08) 461.5320 (1.08) 0.0000 (1.0) 461.5320 (1.08) 0.0000 (1.0) 0;0 2.1667 (0.92) 1 1
test_partial_remove-push[2.39.0] 515.7275 (1.21) 515.7275 (1.21) 515.7275 (1.21) 0.0000 (1.0) 515.7275 (1.21) 0.0000 (1.0) 0;0 1.9390 (0.83) 1 1
test_partial_remove-push[2.40.0] 426.3554 (1.0) 426.3554 (1.0) 426.3554 (1.0) 0.0000 (1.0) 426.3554 (1.0) 0.0000 (1.0) 0;0 2.3455 (1.0) 1 1
test_partial_remove-push[2.41.1] 486.3708 (1.14) 486.3708 (1.14) 486.3708 (1.14) 0.0000 (1.0) 486.3708 (1.14) 0.0000 (1.0) 0;0 2.0560 (0.88) 1 1
test_partial_remove-push[2.45.0] 487.6896 (1.14) 487.6896 (1.14) 487.6896 (1.14) 0.0000 (1.0) 487.6896 (1.14) 0.0000 (1.0) 0;0 2.0505 (0.87) 1 1
test_partial_remove-push[main] 599.5760 (1.41) 599.5760 (1.41) 599.5760 (1.41) 0.0000 (1.0) 599.5760 (1.41) 0.0000 (1.0) 0;0 1.6678 (0.71) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial-add[2.11.0] 5.9117 (1.99) 5.9117 (1.99) 5.9117 (1.99) 0.0000 (1.0) 5.9117 (1.99) 0.0000 (1.0) 0;0 0.1692 (0.50) 1 1
test_partial_add-add-partial-add[2.18.1] 6.4106 (2.16) 6.4106 (2.16) 6.4106 (2.16) 0.0000 (1.0) 6.4106 (2.16) 0.0000 (1.0) 0;0 0.1560 (0.46) 1 1
test_partial_add-add-partial-add[2.39.0] 5.3283 (1.79) 5.3283 (1.79) 5.3283 (1.79) 0.0000 (1.0) 5.3283 (1.79) 0.0000 (1.0) 0;0 0.1877 (0.56) 1 1
test_partial_add-add-partial-add[2.40.0] 3.8073 (1.28) 3.8073 (1.28) 3.8073 (1.28) 0.0000 (1.0) 3.8073 (1.28) 0.0000 (1.0) 0;0 0.2627 (0.78) 1 1
test_partial_add-add-partial-add[2.41.1] 3.8010 (1.28) 3.8010 (1.28) 3.8010 (1.28) 0.0000 (1.0) 3.8010 (1.28) 0.0000 (1.0) 0;0 0.2631 (0.78) 1 1
test_partial_add-add-partial-add[2.45.0] 4.1828 (1.41) 4.1828 (1.41) 4.1828 (1.41) 0.0000 (1.0) 4.1828 (1.41) 0.0000 (1.0) 0;0 0.2391 (0.71) 1 1
test_partial_add-add-partial-add[main] 2.9722 (1.0) 2.9722 (1.0) 2.9722 (1.0) 0.0000 (1.0) 2.9722 (1.0) 0.0000 (1.0) 0;0 0.3364 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 506.7889 (1.0) 506.7889 (1.0) 506.7889 (1.0) 0.0000 (1.0) 506.7889 (1.0) 0.0000 (1.0) 0;0 1.9732 (1.0) 1 1
test_partial_add-gc-cloud-noop[2.18.1] 635.1178 (1.25) 635.1178 (1.25) 635.1178 (1.25) 0.0000 (1.0) 635.1178 (1.25) 0.0000 (1.0) 0;0 1.5745 (0.80) 1 1
test_partial_add-gc-cloud-noop[2.39.0] 635.0590 (1.25) 635.0590 (1.25) 635.0590 (1.25) 0.0000 (1.0) 635.0590 (1.25) 0.0000 (1.0) 0;0 1.5747 (0.80) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 607.1349 (1.20) 607.1349 (1.20) 607.1349 (1.20) 0.0000 (1.0) 607.1349 (1.20) 0.0000 (1.0) 0;0 1.6471 (0.83) 1 1
test_partial_add-gc-cloud-noop[2.41.1] 603.5263 (1.19) 603.5263 (1.19) 603.5263 (1.19) 0.0000 (1.0) 603.5263 (1.19) 0.0000 (1.0) 0;0 1.6569 (0.84) 1 1
test_partial_add-gc-cloud-noop[2.45.0] 621.3018 (1.23) 621.3018 (1.23) 621.3018 (1.23) 0.0000 (1.0) 621.3018 (1.23) 0.0000 (1.0) 0;0 1.6095 (0.82) 1 1
test_partial_add-gc-cloud-noop[main] 700.6708 (1.38) 700.6708 (1.38) 700.6708 (1.38) 0.0000 (1.0) 700.6708 (1.38) 0.0000 (1.0) 0;0 1.4272 (0.72) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 472.5122 (1.0) 472.5122 (1.0) 472.5122 (1.0) 0.0000 (1.0) 472.5122 (1.0) 0.0000 (1.0) 0;0 2.1163 (1.0) 1 1
test_partial_add-gc-noop[2.18.1] 536.7445 (1.14) 536.7445 (1.14) 536.7445 (1.14) 0.0000 (1.0) 536.7445 (1.14) 0.0000 (1.0) 0;0 1.8631 (0.88) 1 1
test_partial_add-gc-noop[2.39.0] 573.2655 (1.21) 573.2655 (1.21) 573.2655 (1.21) 0.0000 (1.0) 573.2655 (1.21) 0.0000 (1.0) 0;0 1.7444 (0.82) 1 1
test_partial_add-gc-noop[2.40.0] 577.6433 (1.22) 577.6433 (1.22) 577.6433 (1.22) 0.0000 (1.0) 577.6433 (1.22) 0.0000 (1.0) 0;0 1.7312 (0.82) 1 1
test_partial_add-gc-noop[2.41.1] 571.0873 (1.21) 571.0873 (1.21) 571.0873 (1.21) 0.0000 (1.0) 571.0873 (1.21) 0.0000 (1.0) 0;0 1.7510 (0.83) 1 1
test_partial_add-gc-noop[2.45.0] 554.4187 (1.17) 554.4187 (1.17) 554.4187 (1.17) 0.0000 (1.0) 554.4187 (1.17) 0.0000 (1.0) 0;0 1.8037 (0.85) 1 1
test_partial_add-gc-noop[main] 642.4909 (1.36) 642.4909 (1.36) 642.4909 (1.36) 0.0000 (1.0) 642.4909 (1.36) 0.0000 (1.0) 0;0 1.5564 (0.74) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial-add': 7 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial-add[2.11.0] 535.9424 (1.0) 535.9424 (1.0) 535.9424 (1.0) 0.0000 (1.0) 535.9424 (1.0) 0.0000 (1.0) 0;0 1.8659 (1.0) 1 1
test_partial_add-push-partial-add[2.18.1] 2,588.5903 (4.83) 2,588.5903 (4.83) 2,588.5903 (4.83) 0.0000 (1.0) 2,588.5903 (4.83) 0.0000 (1.0) 0;0 0.3863 (0.21) 1 1
test_partial_add-push-partial-add[2.39.0] 3,121.7482 (5.82) 3,121.7482 (5.82) 3,121.7482 (5.82) 0.0000 (1.0) 3,121.7482 (5.82) 0.0000 (1.0) 0;0 0.3203 (0.17) 1 1
test_partial_add-push-partial-add[2.40.0] 588.0655 (1.10) 588.0655 (1.10) 588.0655 (1.10) 0.0000 (1.0) 588.0655 (1.10) 0.0000 (1.0) 0;0 1.7005 (0.91) 1 1
test_partial_add-push-partial-add[2.41.1] 594.3373 (1.11) 594.3373 (1.11) 594.3373 (1.11) 0.0000 (1.0) 594.3373 (1.11) 0.0000 (1.0) 0;0 1.6825 (0.90) 1 1
test_partial_add-push-partial-add[2.45.0] 2,259.4128 (4.22) 2,259.4128 (4.22) 2,259.4128 (4.22) 0.0000 (1.0) 2,259.4128 (4.22) 0.0000 (1.0) 0;0 0.4426 (0.24) 1 1
test_partial_add-push-partial-add[main] 642.0896 (1.20) 642.0896 (1.20) 642.0896 (1.20) 0.0000 (1.0) 642.0896 (1.20) 0.0000 (1.0) 0;0 1.5574 (0.83) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
efiop
commented
1 year ago @mjasion Works like charm, thank you! 🙏
From example workflows I see that it needs this set of permissions: