github-actions[bot]
commented
1 year ago
Fri May 5 11:56:31 UTC 2023
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.39.0] 1.4117 (1.18) 1.4279 (1.12) 1.4185 (1.15) 0.0078 (1.0) 1.4137 (1.15) 0.0139 (1.03) 1;0 0.7050 (0.87) 5 3
test_plots-plots-diff[2.40.0] 1.4019 (1.17) 1.4396 (1.13) 1.4243 (1.15) 0.0171 (2.19) 1.4308 (1.16) 0.0305 (2.26) 1;0 0.7021 (0.87) 5 3
test_plots-plots-diff[2.41.1] 1.4024 (1.17) 1.4266 (1.12) 1.4161 (1.15) 0.0095 (1.21) 1.4198 (1.15) 0.0135 (1.0) 2;0 0.7062 (0.87) 5 3
test_plots-plots-diff[2.45.0] 1.2920 (1.08) 1.3330 (1.04) 1.3137 (1.06) 0.0159 (2.03) 1.3175 (1.07) 0.0236 (1.75) 2;0 0.7612 (0.94) 5 3
test_plots-plots-diff[main] 1.1993 (1.0) 1.2792 (1.0) 1.2338 (1.0) 0.0297 (3.79) 1.2299 (1.0) 0.0363 (2.69) 2;0 0.8105 (1.0) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.39.0] 2.5219 (1.57) 2.5620 (1.56) 2.5432 (1.57) 0.0158 (1.12) 2.5492 (1.57) 0.0232 (1.80) 2;0 0.3932 (0.64) 5 3
test_plots-plots-diff-json[2.40.0] 2.5659 (1.60) 2.6281 (1.60) 2.5898 (1.60) 0.0242 (1.72) 2.5886 (1.60) 0.0316 (2.44) 1;0 0.3861 (0.63) 5 3
test_plots-plots-diff-json[2.41.1] 2.5199 (1.57) 2.5970 (1.58) 2.5598 (1.58) 0.0280 (1.99) 2.5631 (1.58) 0.0325 (2.52) 2;0 0.3907 (0.63) 5 3
test_plots-plots-diff-json[2.45.0] 2.2936 (1.43) 2.3580 (1.43) 2.3270 (1.43) 0.0234 (1.65) 2.3260 (1.43) 0.0266 (2.06) 2;0 0.4297 (0.70) 5 3
test_plots-plots-diff-json[main] 1.6038 (1.0) 1.6435 (1.0) 1.6235 (1.0) 0.0141 (1.0) 1.6225 (1.0) 0.0129 (1.0) 2;0 0.6159 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.39.0] 971.8126 (1.04) 993.0645 (1.04) 981.9670 (1.04) 8.9357 (1.01) 981.4276 (1.04) 15.5279 (1.36) 2;0 1.0184 (0.96) 5 3
test_plots-plots-show[2.40.0] 976.8799 (1.05) 1,006.8864 (1.05) 985.9791 (1.04) 12.5584 (1.41) 980.6343 (1.04) 15.8190 (1.38) 1;0 1.0142 (0.96) 5 3
test_plots-plots-show[2.41.1] 982.5913 (1.05) 1,042.5389 (1.09) 998.1271 (1.06) 25.2236 (2.84) 986.8157 (1.04) 22.4078 (1.96) 1;1 1.0019 (0.95) 5 3
test_plots-plots-show[2.45.0] 931.5216 (1.0) 955.5407 (1.0) 943.8661 (1.0) 8.8836 (1.0) 944.6753 (1.0) 11.4469 (1.0) 2;0 1.0595 (1.0) 5 3
test_plots-plots-show[main] 999.6903 (1.07) 1,035.5456 (1.08) 1,017.2632 (1.08) 13.0265 (1.47) 1,015.5495 (1.08) 14.9888 (1.31) 2;0 0.9830 (0.93) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.39.0] 1.5547 (1.28) 1.5683 (1.27) 1.5613 (1.28) 0.0058 (1.0) 1.5610 (1.28) 0.0101 (1.0) 2;0 0.6405 (0.78) 5 3
test_plots-plots-show-json[2.40.0] 1.5588 (1.28) 1.6128 (1.31) 1.5811 (1.29) 0.0228 (3.95) 1.5794 (1.29) 0.0384 (3.79) 1;0 0.6325 (0.77) 5 3
test_plots-plots-show-json[2.41.1] 1.5714 (1.29) 1.6268 (1.32) 1.5905 (1.30) 0.0213 (3.69) 1.5829 (1.30) 0.0196 (1.93) 1;0 0.6287 (0.77) 5 3
test_plots-plots-show-json[2.45.0] 1.4730 (1.21) 1.4934 (1.21) 1.4845 (1.21) 0.0090 (1.56) 1.4848 (1.22) 0.0164 (1.61) 1;0 0.6736 (0.82) 5 3
test_plots-plots-show-json[main] 1.2151 (1.0) 1.2354 (1.0) 1.2243 (1.0) 0.0081 (1.40) 1.2215 (1.0) 0.0121 (1.20) 2;0 0.8168 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.18.1] 1.1377 (1.0) 1.1377 (1.0) 1.1377 (1.0) 0.0000 (1.0) 1.1377 (1.0) 0.0000 (1.0) 0;0 0.8789 (1.0) 1 1
test_data_status_all_flags-data-changed[2.39.0] 1.1788 (1.04) 1.1788 (1.04) 1.1788 (1.04) 0.0000 (1.0) 1.1788 (1.04) 0.0000 (1.0) 0;0 0.8483 (0.97) 1 1
test_data_status_all_flags-data-changed[2.40.0] 1.1770 (1.03) 1.1770 (1.03) 1.1770 (1.03) 0.0000 (1.0) 1.1770 (1.03) 0.0000 (1.0) 0;0 0.8496 (0.97) 1 1
test_data_status_all_flags-data-changed[2.41.1] 1.1998 (1.05) 1.1998 (1.05) 1.1998 (1.05) 0.0000 (1.0) 1.1998 (1.05) 0.0000 (1.0) 0;0 0.8335 (0.95) 1 1
test_data_status_all_flags-data-changed[2.45.0] 1.1983 (1.05) 1.1983 (1.05) 1.1983 (1.05) 0.0000 (1.0) 1.1983 (1.05) 0.0000 (1.0) 0;0 0.8345 (0.95) 1 1
test_data_status_all_flags-data-changed[main] 1.2383 (1.09) 1.2383 (1.09) 1.2383 (1.09) 0.0000 (1.0) 1.2383 (1.09) 0.0000 (1.0) 0;0 0.8076 (0.92) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.18.1] 1.1441 (1.0) 1.1441 (1.0) 1.1441 (1.0) 0.0000 (1.0) 1.1441 (1.0) 0.0000 (1.0) 0;0 0.8740 (1.0) 1 1
test_data_status_all_flags-data-changed-noop[2.39.0] 1.1823 (1.03) 1.1823 (1.03) 1.1823 (1.03) 0.0000 (1.0) 1.1823 (1.03) 0.0000 (1.0) 0;0 0.8458 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[2.40.0] 1.1767 (1.03) 1.1767 (1.03) 1.1767 (1.03) 0.0000 (1.0) 1.1767 (1.03) 0.0000 (1.0) 0;0 0.8498 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[2.41.1] 1.2097 (1.06) 1.2097 (1.06) 1.2097 (1.06) 0.0000 (1.0) 1.2097 (1.06) 0.0000 (1.0) 0;0 0.8267 (0.95) 1 1
test_data_status_all_flags-data-changed-noop[2.45.0] 1.2075 (1.06) 1.2075 (1.06) 1.2075 (1.06) 0.0000 (1.0) 1.2075 (1.06) 0.0000 (1.0) 0;0 0.8281 (0.95) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.2349 (1.08) 1.2349 (1.08) 1.2349 (1.08) 0.0000 (1.0) 1.2349 (1.08) 0.0000 (1.0) 0;0 0.8098 (0.93) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.18.1] 1.9605 (1.01) 1.9605 (1.01) 1.9605 (1.01) 0.0000 (1.0) 1.9605 (1.01) 0.0000 (1.0) 0;0 0.5101 (0.99) 1 1
test_data_status_all_flags-data-new[2.39.0] 2.2233 (1.15) 2.2233 (1.15) 2.2233 (1.15) 0.0000 (1.0) 2.2233 (1.15) 0.0000 (1.0) 0;0 0.4498 (0.87) 1 1
test_data_status_all_flags-data-new[2.40.0] 2.6711 (1.38) 2.6711 (1.38) 2.6711 (1.38) 0.0000 (1.0) 2.6711 (1.38) 0.0000 (1.0) 0;0 0.3744 (0.72) 1 1
test_data_status_all_flags-data-new[2.41.1] 2.5155 (1.30) 2.5155 (1.30) 2.5155 (1.30) 0.0000 (1.0) 2.5155 (1.30) 0.0000 (1.0) 0;0 0.3975 (0.77) 1 1
test_data_status_all_flags-data-new[2.45.0] 1.9322 (1.0) 1.9322 (1.0) 1.9322 (1.0) 0.0000 (1.0) 1.9322 (1.0) 0.0000 (1.0) 0;0 0.5176 (1.0) 1 1
test_data_status_all_flags-data-new[main] 2.0347 (1.05) 2.0347 (1.05) 2.0347 (1.05) 0.0000 (1.0) 2.0347 (1.05) 0.0000 (1.0) 0;0 0.4915 (0.95) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.18.1] 1.1028 (1.0) 1.1028 (1.0) 1.1028 (1.0) 0.0000 (1.0) 1.1028 (1.0) 0.0000 (1.0) 0;0 0.9068 (1.0) 1 1
test_data_status_all_flags-data-noop[2.39.0] 1.1272 (1.02) 1.1272 (1.02) 1.1272 (1.02) 0.0000 (1.0) 1.1272 (1.02) 0.0000 (1.0) 0;0 0.8871 (0.98) 1 1
test_data_status_all_flags-data-noop[2.40.0] 1.1180 (1.01) 1.1180 (1.01) 1.1180 (1.01) 0.0000 (1.0) 1.1180 (1.01) 0.0000 (1.0) 0;0 0.8944 (0.99) 1 1
test_data_status_all_flags-data-noop[2.41.1] 1.1309 (1.03) 1.1309 (1.03) 1.1309 (1.03) 0.0000 (1.0) 1.1309 (1.03) 0.0000 (1.0) 0;0 0.8843 (0.98) 1 1
test_data_status_all_flags-data-noop[2.45.0] 1.1405 (1.03) 1.1405 (1.03) 1.1405 (1.03) 0.0000 (1.0) 1.1405 (1.03) 0.0000 (1.0) 0;0 0.8768 (0.97) 1 1
test_data_status_all_flags-data-noop[main] 1.2070 (1.09) 1.2070 (1.09) 1.2070 (1.09) 0.0000 (1.0) 1.2070 (1.09) 0.0000 (1.0) 0;0 0.8285 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 6.4771 (1.84) 6.4771 (1.84) 6.4771 (1.84) 0.0000 (1.0) 6.4771 (1.84) 0.0000 (1.0) 0;0 0.1544 (0.54) 1 1
test_sharing-add[2.18.1] 5.6506 (1.60) 5.6506 (1.60) 5.6506 (1.60) 0.0000 (1.0) 5.6506 (1.60) 0.0000 (1.0) 0;0 0.1770 (0.62) 1 1
test_sharing-add[2.39.0] 5.6530 (1.60) 5.6530 (1.60) 5.6530 (1.60) 0.0000 (1.0) 5.6530 (1.60) 0.0000 (1.0) 0;0 0.1769 (0.62) 1 1
test_sharing-add[2.40.0] 5.4232 (1.54) 5.4232 (1.54) 5.4232 (1.54) 0.0000 (1.0) 5.4232 (1.54) 0.0000 (1.0) 0;0 0.1844 (0.65) 1 1
test_sharing-add[2.41.1] 5.5674 (1.58) 5.5674 (1.58) 5.5674 (1.58) 0.0000 (1.0) 5.5674 (1.58) 0.0000 (1.0) 0;0 0.1796 (0.63) 1 1
test_sharing-add[2.45.0] 3.7210 (1.05) 3.7210 (1.05) 3.7210 (1.05) 0.0000 (1.0) 3.7210 (1.05) 0.0000 (1.0) 0;0 0.2687 (0.95) 1 1
test_sharing-add[main] 3.5292 (1.0) 3.5292 (1.0) 3.5292 (1.0) 0.0000 (1.0) 3.5292 (1.0) 0.0000 (1.0) 0;0 0.2834 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 3.1709 (1.46) 3.1709 (1.46) 3.1709 (1.46) 0.0000 (1.0) 3.1709 (1.46) 0.0000 (1.0) 0;0 0.3154 (0.69) 1 1
test_sharing-add-noop[2.18.1] 3.3513 (1.54) 3.3513 (1.54) 3.3513 (1.54) 0.0000 (1.0) 3.3513 (1.54) 0.0000 (1.0) 0;0 0.2984 (0.65) 1 1
test_sharing-add-noop[2.39.0] 2.1944 (1.01) 2.1944 (1.01) 2.1944 (1.01) 0.0000 (1.0) 2.1944 (1.01) 0.0000 (1.0) 0;0 0.4557 (0.99) 1 1
test_sharing-add-noop[2.40.0] 2.2344 (1.03) 2.2344 (1.03) 2.2344 (1.03) 0.0000 (1.0) 2.2344 (1.03) 0.0000 (1.0) 0;0 0.4475 (0.97) 1 1
test_sharing-add-noop[2.41.1] 2.1738 (1.0) 2.1738 (1.0) 2.1738 (1.0) 0.0000 (1.0) 2.1738 (1.0) 0.0000 (1.0) 0;0 0.4600 (1.0) 1 1
test_sharing-add-noop[2.45.0] 2.2653 (1.04) 2.2653 (1.04) 2.2653 (1.04) 0.0000 (1.0) 2.2653 (1.04) 0.0000 (1.0) 0;0 0.4414 (0.96) 1 1
test_sharing-add-noop[main] 2.3207 (1.07) 2.3207 (1.07) 2.3207 (1.07) 0.0000 (1.0) 2.3207 (1.07) 0.0000 (1.0) 0;0 0.4309 (0.94) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 471.9944 (1.0) 471.9944 (1.0) 471.9944 (1.0) 0.0000 (1.0) 471.9944 (1.0) 0.0000 (1.0) 0;0 2.1187 (1.0) 1 1
test_sharing-checkout-noop[2.18.1] 531.6979 (1.13) 531.6979 (1.13) 531.6979 (1.13) 0.0000 (1.0) 531.6979 (1.13) 0.0000 (1.0) 0;0 1.8808 (0.89) 1 1
test_sharing-checkout-noop[2.39.0] 557.2798 (1.18) 557.2798 (1.18) 557.2798 (1.18) 0.0000 (1.0) 557.2798 (1.18) 0.0000 (1.0) 0;0 1.7944 (0.85) 1 1
test_sharing-checkout-noop[2.40.0] 554.4520 (1.17) 554.4520 (1.17) 554.4520 (1.17) 0.0000 (1.0) 554.4520 (1.17) 0.0000 (1.0) 0;0 1.8036 (0.85) 1 1
test_sharing-checkout-noop[2.41.1] 552.3232 (1.17) 552.3232 (1.17) 552.3232 (1.17) 0.0000 (1.0) 552.3232 (1.17) 0.0000 (1.0) 0;0 1.8105 (0.85) 1 1
test_sharing-checkout-noop[2.45.0] 575.9820 (1.22) 575.9820 (1.22) 575.9820 (1.22) 0.0000 (1.0) 575.9820 (1.22) 0.0000 (1.0) 0;0 1.7362 (0.82) 1 1
test_sharing-checkout-noop[main] 644.0616 (1.36) 644.0616 (1.36) 644.0616 (1.36) 0.0000 (1.0) 644.0616 (1.36) 0.0000 (1.0) 0;0 1.5526 (0.73) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-pull': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 6.4498 (1.04) 6.4498 (1.04) 6.4498 (1.04) 0.0000 (1.0) 6.4498 (1.04) 0.0000 (1.0) 0;0 0.1550 (0.96) 1 1
test_sharing-pull[2.18.1] 6.5614 (1.06) 6.5614 (1.06) 6.5614 (1.06) 0.0000 (1.0) 6.5614 (1.06) 0.0000 (1.0) 0;0 0.1524 (0.95) 1 1
test_sharing-pull[2.39.0] 7.6869 (1.24) 7.6869 (1.24) 7.6869 (1.24) 0.0000 (1.0) 7.6869 (1.24) 0.0000 (1.0) 0;0 0.1301 (0.81) 1 1
test_sharing-pull[2.40.0] 7.7400 (1.24) 7.7400 (1.24) 7.7400 (1.24) 0.0000 (1.0) 7.7400 (1.24) 0.0000 (1.0) 0;0 0.1292 (0.80) 1 1
test_sharing-pull[2.41.1] 7.6967 (1.24) 7.6967 (1.24) 7.6967 (1.24) 0.0000 (1.0) 7.6967 (1.24) 0.0000 (1.0) 0;0 0.1299 (0.81) 1 1
test_sharing-pull[2.45.0] 6.2192 (1.0) 6.2192 (1.0) 6.2192 (1.0) 0.0000 (1.0) 6.2192 (1.0) 0.0000 (1.0) 0;0 0.1608 (1.0) 1 1
test_sharing-pull[main] 6.3028 (1.01) 6.3028 (1.01) 6.3028 (1.01) 0.0000 (1.0) 6.3028 (1.01) 0.0000 (1.0) 0;0 0.1587 (0.99) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 515.9783 (1.0) 515.9783 (1.0) 515.9783 (1.0) 0.0000 (1.0) 515.9783 (1.0) 0.0000 (1.0) 0;0 1.9381 (1.0) 1 1
test_sharing-pull-noop[2.18.1] 564.6121 (1.09) 564.6121 (1.09) 564.6121 (1.09) 0.0000 (1.0) 564.6121 (1.09) 0.0000 (1.0) 0;0 1.7711 (0.91) 1 1
test_sharing-pull-noop[2.39.0] 585.4252 (1.13) 585.4252 (1.13) 585.4252 (1.13) 0.0000 (1.0) 585.4252 (1.13) 0.0000 (1.0) 0;0 1.7082 (0.88) 1 1
test_sharing-pull-noop[2.40.0] 589.0164 (1.14) 589.0164 (1.14) 589.0164 (1.14) 0.0000 (1.0) 589.0164 (1.14) 0.0000 (1.0) 0;0 1.6977 (0.88) 1 1
test_sharing-pull-noop[2.41.1] 588.7022 (1.14) 588.7022 (1.14) 588.7022 (1.14) 0.0000 (1.0) 588.7022 (1.14) 0.0000 (1.0) 0;0 1.6987 (0.88) 1 1
test_sharing-pull-noop[2.45.0] 624.3452 (1.21) 624.3452 (1.21) 624.3452 (1.21) 0.0000 (1.0) 624.3452 (1.21) 0.0000 (1.0) 0;0 1.6017 (0.83) 1 1
test_sharing-pull-noop[main] 695.9889 (1.35) 695.9889 (1.35) 695.9889 (1.35) 0.0000 (1.0) 695.9889 (1.35) 0.0000 (1.0) 0;0 1.4368 (0.74) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 3.6474 (1.17) 3.6474 (1.17) 3.6474 (1.17) 0.0000 (1.0) 3.6474 (1.17) 0.0000 (1.0) 0;0 0.2742 (0.85) 1 1
test_sharing-push[2.18.1] 3.6234 (1.16) 3.6234 (1.16) 3.6234 (1.16) 0.0000 (1.0) 3.6234 (1.16) 0.0000 (1.0) 0;0 0.2760 (0.86) 1 1
test_sharing-push[2.39.0] 4.6652 (1.50) 4.6652 (1.50) 4.6652 (1.50) 0.0000 (1.0) 4.6652 (1.50) 0.0000 (1.0) 0;0 0.2144 (0.67) 1 1
test_sharing-push[2.40.0] 4.5846 (1.47) 4.5846 (1.47) 4.5846 (1.47) 0.0000 (1.0) 4.5846 (1.47) 0.0000 (1.0) 0;0 0.2181 (0.68) 1 1
test_sharing-push[2.41.1] 4.5919 (1.48) 4.5919 (1.48) 4.5919 (1.48) 0.0000 (1.0) 4.5919 (1.48) 0.0000 (1.0) 0;0 0.2178 (0.68) 1 1
test_sharing-push[2.45.0] 3.1107 (1.0) 3.1107 (1.0) 3.1107 (1.0) 0.0000 (1.0) 3.1107 (1.0) 0.0000 (1.0) 0;0 0.3215 (1.0) 1 1
test_sharing-push[main] 3.2595 (1.05) 3.2595 (1.05) 3.2595 (1.05) 0.0000 (1.0) 3.2595 (1.05) 0.0000 (1.0) 0;0 0.3068 (0.95) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 415.1577 (1.0) 415.1577 (1.0) 415.1577 (1.0) 0.0000 (1.0) 415.1577 (1.0) 0.0000 (1.0) 0;0 2.4087 (1.0) 1 1
test_sharing-push-noop[2.18.1] 419.3095 (1.01) 419.3095 (1.01) 419.3095 (1.01) 0.0000 (1.0) 419.3095 (1.01) 0.0000 (1.0) 0;0 2.3849 (0.99) 1 1
test_sharing-push-noop[2.39.0] 456.8925 (1.10) 456.8925 (1.10) 456.8925 (1.10) 0.0000 (1.0) 456.8925 (1.10) 0.0000 (1.0) 0;0 2.1887 (0.91) 1 1
test_sharing-push-noop[2.40.0] 455.7275 (1.10) 455.7275 (1.10) 455.7275 (1.10) 0.0000 (1.0) 455.7275 (1.10) 0.0000 (1.0) 0;0 2.1943 (0.91) 1 1
test_sharing-push-noop[2.41.1] 460.4949 (1.11) 460.4949 (1.11) 460.4949 (1.11) 0.0000 (1.0) 460.4949 (1.11) 0.0000 (1.0) 0;0 2.1716 (0.90) 1 1
test_sharing-push-noop[2.45.0] 458.0357 (1.10) 458.0357 (1.10) 458.0357 (1.10) 0.0000 (1.0) 458.0357 (1.10) 0.0000 (1.0) 0;0 2.1832 (0.91) 1 1
test_sharing-push-noop[main] 537.9220 (1.30) 537.9220 (1.30) 537.9220 (1.30) 0.0000 (1.0) 537.9220 (1.30) 0.0000 (1.0) 0;0 1.8590 (0.77) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 4.9430 (1.40) 4.9430 (1.40) 4.9430 (1.40) 0.0000 (1.0) 4.9430 (1.40) 0.0000 (1.0) 0;0 0.2023 (0.72) 1 1
test_get-get[2.18.1] 4.4872 (1.27) 4.4872 (1.27) 4.4872 (1.27) 0.0000 (1.0) 4.4872 (1.27) 0.0000 (1.0) 0;0 0.2229 (0.79) 1 1
test_get-get[2.39.0] 3.6356 (1.03) 3.6356 (1.03) 3.6356 (1.03) 0.0000 (1.0) 3.6356 (1.03) 0.0000 (1.0) 0;0 0.2751 (0.97) 1 1
test_get-get[2.40.0] 3.5749 (1.01) 3.5749 (1.01) 3.5749 (1.01) 0.0000 (1.0) 3.5749 (1.01) 0.0000 (1.0) 0;0 0.2797 (0.99) 1 1
test_get-get[2.41.1] 3.5411 (1.0) 3.5411 (1.0) 3.5411 (1.0) 0.0000 (1.0) 3.5411 (1.0) 0.0000 (1.0) 0;0 0.2824 (1.0) 1 1
test_get-get[2.45.0] 3.5919 (1.01) 3.5919 (1.01) 3.5919 (1.01) 0.0000 (1.0) 3.5919 (1.01) 0.0000 (1.0) 0;0 0.2784 (0.99) 1 1
test_get-get[main] 4.9351 (1.39) 4.9351 (1.39) 4.9351 (1.39) 0.0000 (1.0) 4.9351 (1.39) 0.0000 (1.0) 0;0 0.2026 (0.72) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 1.4242 (1.04) 1.4242 (1.04) 1.4242 (1.04) 0.0000 (1.0) 1.4242 (1.04) 0.0000 (1.0) 0;0 0.7021 (0.96) 1 1
test_checkout_symlink-checkout[2.18.1] 1.5895 (1.16) 1.5895 (1.16) 1.5895 (1.16) 0.0000 (1.0) 1.5895 (1.16) 0.0000 (1.0) 0;0 0.6291 (0.86) 1 1
test_checkout_symlink-checkout[2.39.0] 1.3945 (1.02) 1.3945 (1.02) 1.3945 (1.02) 0.0000 (1.0) 1.3945 (1.02) 0.0000 (1.0) 0;0 0.7171 (0.98) 1 1
test_checkout_symlink-checkout[2.40.0] 1.4606 (1.07) 1.4606 (1.07) 1.4606 (1.07) 0.0000 (1.0) 1.4606 (1.07) 0.0000 (1.0) 0;0 0.6847 (0.94) 1 1
test_checkout_symlink-checkout[2.41.1] 1.3681 (1.0) 1.3681 (1.0) 1.3681 (1.0) 0.0000 (1.0) 1.3681 (1.0) 0.0000 (1.0) 0;0 0.7309 (1.0) 1 1
test_checkout_symlink-checkout[2.45.0] 1.7144 (1.25) 1.7144 (1.25) 1.7144 (1.25) 0.0000 (1.0) 1.7144 (1.25) 0.0000 (1.0) 0;0 0.5833 (0.80) 1 1
test_checkout_symlink-checkout[main] 1.7130 (1.25) 1.7130 (1.25) 1.7130 (1.25) 0.0000 (1.0) 1.7130 (1.25) 0.0000 (1.0) 0;0 0.5838 (0.80) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 522.4368 (1.0) 522.4368 (1.0) 522.4368 (1.0) 0.0000 (1.0) 522.4368 (1.0) 0.0000 (1.0) 0;0 1.9141 (1.0) 1 1
test_checkout_symlink-checkout-noop[2.18.1] 571.9860 (1.09) 571.9860 (1.09) 571.9860 (1.09) 0.0000 (1.0) 571.9860 (1.09) 0.0000 (1.0) 0;0 1.7483 (0.91) 1 1
test_checkout_symlink-checkout-noop[2.39.0] 605.3951 (1.16) 605.3951 (1.16) 605.3951 (1.16) 0.0000 (1.0) 605.3951 (1.16) 0.0000 (1.0) 0;0 1.6518 (0.86) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 585.7331 (1.12) 585.7331 (1.12) 585.7331 (1.12) 0.0000 (1.0) 585.7331 (1.12) 0.0000 (1.0) 0;0 1.7073 (0.89) 1 1
test_checkout_symlink-checkout-noop[2.41.1] 593.8218 (1.14) 593.8218 (1.14) 593.8218 (1.14) 0.0000 (1.0) 593.8218 (1.14) 0.0000 (1.0) 0;0 1.6840 (0.88) 1 1
test_checkout_symlink-checkout-noop[2.45.0] 639.7469 (1.22) 639.7469 (1.22) 639.7469 (1.22) 0.0000 (1.0) 639.7469 (1.22) 0.0000 (1.0) 0;0 1.5631 (0.82) 1 1
test_checkout_symlink-checkout-noop[main] 705.2718 (1.35) 705.2718 (1.35) 705.2718 (1.35) 0.0000 (1.0) 705.2718 (1.35) 0.0000 (1.0) 0;0 1.4179 (0.74) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 1.4674 (2.16) 1.4674 (2.16) 1.4674 (2.16) 0.0000 (1.0) 1.4674 (2.16) 0.0000 (1.0) 0;0 0.6815 (0.46) 1 1
test_checkout_symlink-checkout-update[2.18.1] 0.6803 (1.00) 0.6803 (1.00) 0.6803 (1.00) 0.0000 (1.0) 0.6803 (1.00) 0.0000 (1.0) 0;0 1.4700 (1.00) 1 1
test_checkout_symlink-checkout-update[2.39.0] 0.7092 (1.04) 0.7092 (1.04) 0.7092 (1.04) 0.0000 (1.0) 0.7092 (1.04) 0.0000 (1.0) 0;0 1.4101 (0.96) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.6787 (1.0) 0.6787 (1.0) 0.6787 (1.0) 0.0000 (1.0) 0.6787 (1.0) 0.0000 (1.0) 0;0 1.4734 (1.0) 1 1
test_checkout_symlink-checkout-update[2.41.1] 0.6943 (1.02) 0.6943 (1.02) 0.6943 (1.02) 0.0000 (1.0) 0.6943 (1.02) 0.0000 (1.0) 0;0 1.4404 (0.98) 1 1
test_checkout_symlink-checkout-update[2.45.0] 1.1123 (1.64) 1.1123 (1.64) 1.1123 (1.64) 0.0000 (1.0) 1.1123 (1.64) 0.0000 (1.0) 0;0 0.8990 (0.61) 1 1
test_checkout_symlink-checkout-update[main] 0.7841 (1.16) 0.7841 (1.16) 0.7841 (1.16) 0.0000 (1.0) 0.7841 (1.16) 0.0000 (1.0) 0;0 1.2753 (0.87) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 426.0124 (1.0) 426.0124 (1.0) 426.0124 (1.0) 0.0000 (1.0) 426.0124 (1.0) 0.0000 (1.0) 0;0 2.3473 (1.0) 1 1
test_gc-gc[2.18.1] 441.5357 (1.04) 441.5357 (1.04) 441.5357 (1.04) 0.0000 (1.0) 441.5357 (1.04) 0.0000 (1.0) 0;0 2.2648 (0.96) 1 1
test_gc-gc[2.39.0] 470.2588 (1.10) 470.2588 (1.10) 470.2588 (1.10) 0.0000 (1.0) 470.2588 (1.10) 0.0000 (1.0) 0;0 2.1265 (0.91) 1 1
test_gc-gc[2.40.0] 469.5417 (1.10) 469.5417 (1.10) 469.5417 (1.10) 0.0000 (1.0) 469.5417 (1.10) 0.0000 (1.0) 0;0 2.1297 (0.91) 1 1
test_gc-gc[2.41.1] 478.6161 (1.12) 478.6161 (1.12) 478.6161 (1.12) 0.0000 (1.0) 478.6161 (1.12) 0.0000 (1.0) 0;0 2.0894 (0.89) 1 1
test_gc-gc[2.45.0] 467.4407 (1.10) 467.4407 (1.10) 467.4407 (1.10) 0.0000 (1.0) 467.4407 (1.10) 0.0000 (1.0) 0;0 2.1393 (0.91) 1 1
test_gc-gc[main] 536.1455 (1.26) 536.1455 (1.26) 536.1455 (1.26) 0.0000 (1.0) 536.1455 (1.26) 0.0000 (1.0) 0;0 1.8652 (0.79) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 2.7067 (1.0) 2.7067 (1.0) 2.7067 (1.0) 0.0000 (1.0) 2.7067 (1.0) 0.0000 (1.0) 0;0 0.3695 (1.0) 1 1
test_get_url-get-url[2.18.1] 2.7540 (1.02) 2.7540 (1.02) 2.7540 (1.02) 0.0000 (1.0) 2.7540 (1.02) 0.0000 (1.0) 0;0 0.3631 (0.98) 1 1
test_get_url-get-url[2.39.0] 2.7792 (1.03) 2.7792 (1.03) 2.7792 (1.03) 0.0000 (1.0) 2.7792 (1.03) 0.0000 (1.0) 0;0 0.3598 (0.97) 1 1
test_get_url-get-url[2.40.0] 2.7494 (1.02) 2.7494 (1.02) 2.7494 (1.02) 0.0000 (1.0) 2.7494 (1.02) 0.0000 (1.0) 0;0 0.3637 (0.98) 1 1
test_get_url-get-url[2.41.1] 2.7675 (1.02) 2.7675 (1.02) 2.7675 (1.02) 0.0000 (1.0) 2.7675 (1.02) 0.0000 (1.0) 0;0 0.3613 (0.98) 1 1
test_get_url-get-url[2.45.0] 2.7688 (1.02) 2.7688 (1.02) 2.7688 (1.02) 0.0000 (1.0) 2.7688 (1.02) 0.0000 (1.0) 0;0 0.3612 (0.98) 1 1
test_get_url-get-url[main] 2.8774 (1.06) 2.8774 (1.06) 2.8774 (1.06) 0.0000 (1.0) 2.8774 (1.06) 0.0000 (1.0) 0;0 0.3475 (0.94) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0] 7.5476 (1.89) 7.5476 (1.89) 7.5476 (1.89) 0.0000 (1.0) 7.5476 (1.89) 0.0000 (1.0) 0;0 0.1325 (0.53) 1 1
test_sharing_s3-add[2.18.1] 6.4275 (1.61) 6.4275 (1.61) 6.4275 (1.61) 0.0000 (1.0) 6.4275 (1.61) 0.0000 (1.0) 0;0 0.1556 (0.62) 1 1
test_sharing_s3-add[2.39.0] 5.9646 (1.49) 5.9646 (1.49) 5.9646 (1.49) 0.0000 (1.0) 5.9646 (1.49) 0.0000 (1.0) 0;0 0.1677 (0.67) 1 1
test_sharing_s3-add[2.40.0] 6.1071 (1.53) 6.1071 (1.53) 6.1071 (1.53) 0.0000 (1.0) 6.1071 (1.53) 0.0000 (1.0) 0;0 0.1637 (0.65) 1 1
test_sharing_s3-add[2.41.1] 5.8990 (1.48) 5.8990 (1.48) 5.8990 (1.48) 0.0000 (1.0) 5.8990 (1.48) 0.0000 (1.0) 0;0 0.1695 (0.68) 1 1
test_sharing_s3-add[2.45.0] 4.0599 (1.02) 4.0599 (1.02) 4.0599 (1.02) 0.0000 (1.0) 4.0599 (1.02) 0.0000 (1.0) 0;0 0.2463 (0.98) 1 1
test_sharing_s3-add[main] 3.9946 (1.0) 3.9946 (1.0) 3.9946 (1.0) 0.0000 (1.0) 3.9946 (1.0) 0.0000 (1.0) 0;0 0.2503 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0] 3.5200 (1.41) 3.5200 (1.41) 3.5200 (1.41) 0.0000 (1.0) 3.5200 (1.41) 0.0000 (1.0) 0;0 0.2841 (0.71) 1 1
test_sharing_s3-add-noop[2.18.1] 3.7061 (1.48) 3.7061 (1.48) 3.7061 (1.48) 0.0000 (1.0) 3.7061 (1.48) 0.0000 (1.0) 0;0 0.2698 (0.67) 1 1
test_sharing_s3-add-noop[2.39.0] 2.4968 (1.0) 2.4968 (1.0) 2.4968 (1.0) 0.0000 (1.0) 2.4968 (1.0) 0.0000 (1.0) 0;0 0.4005 (1.0) 1 1
test_sharing_s3-add-noop[2.40.0] 2.5039 (1.00) 2.5039 (1.00) 2.5039 (1.00) 0.0000 (1.0) 2.5039 (1.00) 0.0000 (1.0) 0;0 0.3994 (1.00) 1 1
test_sharing_s3-add-noop[2.41.1] 2.5108 (1.01) 2.5108 (1.01) 2.5108 (1.01) 0.0000 (1.0) 2.5108 (1.01) 0.0000 (1.0) 0;0 0.3983 (0.99) 1 1
test_sharing_s3-add-noop[2.45.0] 2.6327 (1.05) 2.6327 (1.05) 2.6327 (1.05) 0.0000 (1.0) 2.6327 (1.05) 0.0000 (1.0) 0;0 0.3798 (0.95) 1 1
test_sharing_s3-add-noop[main] 2.6978 (1.08) 2.6978 (1.08) 2.6978 (1.08) 0.0000 (1.0) 2.6978 (1.08) 0.0000 (1.0) 0;0 0.3707 (0.93) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0] 518.8464 (1.0) 518.8464 (1.0) 518.8464 (1.0) 0.0000 (1.0) 518.8464 (1.0) 0.0000 (1.0) 0;0 1.9274 (1.0) 1 1
test_sharing_s3-checkout-noop[2.18.1] 586.3070 (1.13) 586.3070 (1.13) 586.3070 (1.13) 0.0000 (1.0) 586.3070 (1.13) 0.0000 (1.0) 0;0 1.7056 (0.88) 1 1
test_sharing_s3-checkout-noop[2.39.0] 619.1463 (1.19) 619.1463 (1.19) 619.1463 (1.19) 0.0000 (1.0) 619.1463 (1.19) 0.0000 (1.0) 0;0 1.6151 (0.84) 1 1
test_sharing_s3-checkout-noop[2.40.0] 600.7412 (1.16) 600.7412 (1.16) 600.7412 (1.16) 0.0000 (1.0) 600.7412 (1.16) 0.0000 (1.0) 0;0 1.6646 (0.86) 1 1
test_sharing_s3-checkout-noop[2.41.1] 599.8394 (1.16) 599.8394 (1.16) 599.8394 (1.16) 0.0000 (1.0) 599.8394 (1.16) 0.0000 (1.0) 0;0 1.6671 (0.86) 1 1
test_sharing_s3-checkout-noop[2.45.0] 646.7797 (1.25) 646.7797 (1.25) 646.7797 (1.25) 0.0000 (1.0) 646.7797 (1.25) 0.0000 (1.0) 0;0 1.5461 (0.80) 1 1
test_sharing_s3-checkout-noop[main] 759.7155 (1.46) 759.7155 (1.46) 759.7155 (1.46) 0.0000 (1.0) 759.7155 (1.46) 0.0000 (1.0) 0;0 1.3163 (0.68) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0] 15.7572 (1.21) 15.7572 (1.21) 15.7572 (1.21) 0.0000 (1.0) 15.7572 (1.21) 0.0000 (1.0) 0;0 0.0635 (0.83) 1 1
test_sharing_s3-pull[2.18.1] 15.9065 (1.22) 15.9065 (1.22) 15.9065 (1.22) 0.0000 (1.0) 15.9065 (1.22) 0.0000 (1.0) 0;0 0.0629 (0.82) 1 1
test_sharing_s3-pull[2.39.0] 15.7331 (1.21) 15.7331 (1.21) 15.7331 (1.21) 0.0000 (1.0) 15.7331 (1.21) 0.0000 (1.0) 0;0 0.0636 (0.83) 1 1
test_sharing_s3-pull[2.40.0] 15.5164 (1.19) 15.5164 (1.19) 15.5164 (1.19) 0.0000 (1.0) 15.5164 (1.19) 0.0000 (1.0) 0;0 0.0644 (0.84) 1 1
test_sharing_s3-pull[2.41.1] 15.8367 (1.22) 15.8367 (1.22) 15.8367 (1.22) 0.0000 (1.0) 15.8367 (1.22) 0.0000 (1.0) 0;0 0.0631 (0.82) 1 1
test_sharing_s3-pull[2.45.0] 13.0308 (1.0) 13.0308 (1.0) 13.0308 (1.0) 0.0000 (1.0) 13.0308 (1.0) 0.0000 (1.0) 0;0 0.0767 (1.0) 1 1
test_sharing_s3-pull[main] 13.4408 (1.03) 13.4408 (1.03) 13.4408 (1.03) 0.0000 (1.0) 13.4408 (1.03) 0.0000 (1.0) 0;0 0.0744 (0.97) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0] 762.7839 (1.0) 762.7839 (1.0) 762.7839 (1.0) 0.0000 (1.0) 762.7839 (1.0) 0.0000 (1.0) 0;0 1.3110 (1.0) 1 1
test_sharing_s3-pull-noop[2.18.1] 843.2975 (1.11) 843.2975 (1.11) 843.2975 (1.11) 0.0000 (1.0) 843.2975 (1.11) 0.0000 (1.0) 0;0 1.1858 (0.90) 1 1
test_sharing_s3-pull-noop[2.39.0] 850.8510 (1.12) 850.8510 (1.12) 850.8510 (1.12) 0.0000 (1.0) 850.8510 (1.12) 0.0000 (1.0) 0;0 1.1753 (0.90) 1 1
test_sharing_s3-pull-noop[2.40.0] 833.5653 (1.09) 833.5653 (1.09) 833.5653 (1.09) 0.0000 (1.0) 833.5653 (1.09) 0.0000 (1.0) 0;0 1.1997 (0.92) 1 1
test_sharing_s3-pull-noop[2.41.1] 878.6653 (1.15) 878.6653 (1.15) 878.6653 (1.15) 0.0000 (1.0) 878.6653 (1.15) 0.0000 (1.0) 0;0 1.1381 (0.87) 1 1
test_sharing_s3-pull-noop[2.45.0] 930.4233 (1.22) 930.4233 (1.22) 930.4233 (1.22) 0.0000 (1.0) 930.4233 (1.22) 0.0000 (1.0) 0;0 1.0748 (0.82) 1 1
test_sharing_s3-pull-noop[main] 982.3610 (1.29) 982.3610 (1.29) 982.3610 (1.29) 0.0000 (1.0) 982.3610 (1.29) 0.0000 (1.0) 0;0 1.0180 (0.78) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0] 23.0840 (2.39) 23.0840 (2.39) 23.0840 (2.39) 0.0000 (1.0) 23.0840 (2.39) 0.0000 (1.0) 0;0 0.0433 (0.42) 1 1
test_sharing_s3-push[2.18.1] 23.6323 (2.45) 23.6323 (2.45) 23.6323 (2.45) 0.0000 (1.0) 23.6323 (2.45) 0.0000 (1.0) 0;0 0.0423 (0.41) 1 1
test_sharing_s3-push[2.39.0] 23.9661 (2.48) 23.9661 (2.48) 23.9661 (2.48) 0.0000 (1.0) 23.9661 (2.48) 0.0000 (1.0) 0;0 0.0417 (0.40) 1 1
test_sharing_s3-push[2.40.0] 23.7756 (2.46) 23.7756 (2.46) 23.7756 (2.46) 0.0000 (1.0) 23.7756 (2.46) 0.0000 (1.0) 0;0 0.0421 (0.41) 1 1
test_sharing_s3-push[2.41.1] 12.7291 (1.32) 12.7291 (1.32) 12.7291 (1.32) 0.0000 (1.0) 12.7291 (1.32) 0.0000 (1.0) 0;0 0.0786 (0.76) 1 1
test_sharing_s3-push[2.45.0] 9.6579 (1.0) 9.6579 (1.0) 9.6579 (1.0) 0.0000 (1.0) 9.6579 (1.0) 0.0000 (1.0) 0;0 0.1035 (1.0) 1 1
test_sharing_s3-push[main] 11.2402 (1.16) 11.2402 (1.16) 11.2402 (1.16) 0.0000 (1.0) 11.2402 (1.16) 0.0000 (1.0) 0;0 0.0890 (0.86) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0] 1.0219 (1.0) 1.0219 (1.0) 1.0219 (1.0) 0.0000 (1.0) 1.0219 (1.0) 0.0000 (1.0) 0;0 0.9786 (1.0) 1 1
test_sharing_s3-push-noop[2.18.1] 1.0405 (1.02) 1.0405 (1.02) 1.0405 (1.02) 0.0000 (1.0) 1.0405 (1.02) 0.0000 (1.0) 0;0 0.9611 (0.98) 1 1
test_sharing_s3-push-noop[2.39.0] 1.1524 (1.13) 1.1524 (1.13) 1.1524 (1.13) 0.0000 (1.0) 1.1524 (1.13) 0.0000 (1.0) 0;0 0.8677 (0.89) 1 1
test_sharing_s3-push-noop[2.40.0] 1.0563 (1.03) 1.0563 (1.03) 1.0563 (1.03) 0.0000 (1.0) 1.0563 (1.03) 0.0000 (1.0) 0;0 0.9467 (0.97) 1 1
test_sharing_s3-push-noop[2.41.1] 1.0666 (1.04) 1.0666 (1.04) 1.0666 (1.04) 0.0000 (1.0) 1.0666 (1.04) 0.0000 (1.0) 0;0 0.9375 (0.96) 1 1
test_sharing_s3-push-noop[2.45.0] 1.0434 (1.02) 1.0434 (1.02) 1.0434 (1.02) 0.0000 (1.0) 1.0434 (1.02) 0.0000 (1.0) 0;0 0.9584 (0.98) 1 1
test_sharing_s3-push-noop[main] 1.2577 (1.23) 1.2577 (1.23) 1.2577 (1.23) 0.0000 (1.0) 1.2577 (1.23) 0.0000 (1.0) 0;0 0.7951 (0.81) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 10.8410 (1.42) 10.8410 (1.42) 10.8410 (1.42) 0.0000 (1.0) 10.8410 (1.42) 0.0000 (1.0) 0;0 0.0922 (0.70) 1 1
test_import_url-import-url[2.18.1] 9.7551 (1.28) 9.7551 (1.28) 9.7551 (1.28) 0.0000 (1.0) 9.7551 (1.28) 0.0000 (1.0) 0;0 0.1025 (0.78) 1 1
test_import_url-import-url[2.39.0] 9.6945 (1.27) 9.6945 (1.27) 9.6945 (1.27) 0.0000 (1.0) 9.6945 (1.27) 0.0000 (1.0) 0;0 0.1032 (0.79) 1 1
test_import_url-import-url[2.40.0] 9.8492 (1.29) 9.8492 (1.29) 9.8492 (1.29) 0.0000 (1.0) 9.8492 (1.29) 0.0000 (1.0) 0;0 0.1015 (0.77) 1 1
test_import_url-import-url[2.41.1] 9.9411 (1.30) 9.9411 (1.30) 9.9411 (1.30) 0.0000 (1.0) 9.9411 (1.30) 0.0000 (1.0) 0;0 0.1006 (0.77) 1 1
test_import_url-import-url[2.45.0] 7.6255 (1.0) 7.6255 (1.0) 7.6255 (1.0) 0.0000 (1.0) 7.6255 (1.0) 0.0000 (1.0) 0;0 0.1311 (1.0) 1 1
test_import_url-import-url[main] 7.6737 (1.01) 7.6737 (1.01) 7.6737 (1.01) 0.0000 (1.0) 7.6737 (1.01) 0.0000 (1.0) 0;0 0.1303 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 2.7280 (1.58) 2.7280 (1.58) 2.7280 (1.58) 0.0000 (1.0) 2.7280 (1.58) 0.0000 (1.0) 0;0 0.3666 (0.63) 1 1
test_status-status[2.18.1] 1.7315 (1.0) 1.7315 (1.0) 1.7315 (1.0) 0.0000 (1.0) 1.7315 (1.0) 0.0000 (1.0) 0;0 0.5775 (1.0) 1 1
test_status-status[2.39.0] 1.7639 (1.02) 1.7639 (1.02) 1.7639 (1.02) 0.0000 (1.0) 1.7639 (1.02) 0.0000 (1.0) 0;0 0.5669 (0.98) 1 1
test_status-status[2.40.0] 1.8150 (1.05) 1.8150 (1.05) 1.8150 (1.05) 0.0000 (1.0) 1.8150 (1.05) 0.0000 (1.0) 0;0 0.5510 (0.95) 1 1
test_status-status[2.41.1] 1.7322 (1.00) 1.7322 (1.00) 1.7322 (1.00) 0.0000 (1.0) 1.7322 (1.00) 0.0000 (1.0) 0;0 0.5773 (1.00) 1 1
test_status-status[2.45.0] 1.7651 (1.02) 1.7651 (1.02) 1.7651 (1.02) 0.0000 (1.0) 1.7651 (1.02) 0.0000 (1.0) 0;0 0.5665 (0.98) 1 1
test_status-status[main] 1.8778 (1.08) 1.8778 (1.08) 1.8778 (1.08) 0.0000 (1.0) 1.8778 (1.08) 0.0000 (1.0) 0;0 0.5325 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 1.9600 (3.11) 1.9600 (3.11) 1.9600 (3.11) 0.0000 (1.0) 1.9600 (3.11) 0.0000 (1.0) 0;0 0.5102 (0.32) 1 1
test_status-status-changed[2.18.1] 0.6306 (1.0) 0.6306 (1.0) 0.6306 (1.0) 0.0000 (1.0) 0.6306 (1.0) 0.0000 (1.0) 0;0 1.5858 (1.0) 1 1
test_status-status-changed[2.39.0] 0.6407 (1.02) 0.6407 (1.02) 0.6407 (1.02) 0.0000 (1.0) 0.6407 (1.02) 0.0000 (1.0) 0;0 1.5609 (0.98) 1 1
test_status-status-changed[2.40.0] 0.7200 (1.14) 0.7200 (1.14) 0.7200 (1.14) 0.0000 (1.0) 0.7200 (1.14) 0.0000 (1.0) 0;0 1.3888 (0.88) 1 1
test_status-status-changed[2.41.1] 0.6840 (1.08) 0.6840 (1.08) 0.6840 (1.08) 0.0000 (1.0) 0.6840 (1.08) 0.0000 (1.0) 0;0 1.4621 (0.92) 1 1
test_status-status-changed[2.45.0] 0.6973 (1.11) 0.6973 (1.11) 0.6973 (1.11) 0.0000 (1.0) 0.6973 (1.11) 0.0000 (1.0) 0;0 1.4341 (0.90) 1 1
test_status-status-changed[main] 0.8165 (1.29) 0.8165 (1.29) 0.8165 (1.29) 0.0000 (1.0) 0.8165 (1.29) 0.0000 (1.0) 0;0 1.2248 (0.77) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 798.4418 (1.23) 798.4418 (1.23) 798.4418 (1.23) 0.0000 (1.0) 798.4418 (1.23) 0.0000 (1.0) 0;0 1.2524 (0.81) 1 1
test_status-status-changed-noop[2.18.1] 752.2756 (1.16) 752.2756 (1.16) 752.2756 (1.16) 0.0000 (1.0) 752.2756 (1.16) 0.0000 (1.0) 0;0 1.3293 (0.86) 1 1
test_status-status-changed-noop[2.39.0] 660.0242 (1.02) 660.0242 (1.02) 660.0242 (1.02) 0.0000 (1.0) 660.0242 (1.02) 0.0000 (1.0) 0;0 1.5151 (0.98) 1 1
test_status-status-changed-noop[2.40.0] 702.9513 (1.08) 702.9513 (1.08) 702.9513 (1.08) 0.0000 (1.0) 702.9513 (1.08) 0.0000 (1.0) 0;0 1.4226 (0.92) 1 1
test_status-status-changed-noop[2.41.1] 649.2177 (1.0) 649.2177 (1.0) 649.2177 (1.0) 0.0000 (1.0) 649.2177 (1.0) 0.0000 (1.0) 0;0 1.5403 (1.0) 1 1
test_status-status-changed-noop[2.45.0] 791.5307 (1.22) 791.5307 (1.22) 791.5307 (1.22) 0.0000 (1.0) 791.5307 (1.22) 0.0000 (1.0) 0;0 1.2634 (0.82) 1 1
test_status-status-changed-noop[main] 772.9729 (1.19) 772.9729 (1.19) 772.9729 (1.19) 0.0000 (1.0) 772.9729 (1.19) 0.0000 (1.0) 0;0 1.2937 (0.84) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 509.5422 (1.0) 509.5422 (1.0) 509.5422 (1.0) 0.0000 (1.0) 509.5422 (1.0) 0.0000 (1.0) 0;0 1.9625 (1.0) 1 1
test_status-status-noop[2.18.1] 631.8813 (1.24) 631.8813 (1.24) 631.8813 (1.24) 0.0000 (1.0) 631.8813 (1.24) 0.0000 (1.0) 0;0 1.5826 (0.81) 1 1
test_status-status-noop[2.39.0] 668.1510 (1.31) 668.1510 (1.31) 668.1510 (1.31) 0.0000 (1.0) 668.1510 (1.31) 0.0000 (1.0) 0;0 1.4967 (0.76) 1 1
test_status-status-noop[2.40.0] 708.3154 (1.39) 708.3154 (1.39) 708.3154 (1.39) 0.0000 (1.0) 708.3154 (1.39) 0.0000 (1.0) 0;0 1.4118 (0.72) 1 1
test_status-status-noop[2.41.1] 701.2742 (1.38) 701.2742 (1.38) 701.2742 (1.38) 0.0000 (1.0) 701.2742 (1.38) 0.0000 (1.0) 0;0 1.4260 (0.73) 1 1
test_status-status-noop[2.45.0] 802.3872 (1.57) 802.3872 (1.57) 802.3872 (1.57) 0.0000 (1.0) 802.3872 (1.57) 0.0000 (1.0) 0;0 1.2463 (0.64) 1 1
test_status-status-noop[main] 796.4464 (1.56) 796.4464 (1.56) 796.4464 (1.56) 0.0000 (1.0) 796.4464 (1.56) 0.0000 (1.0) 0;0 1.2556 (0.64) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_pull-pull': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 7.2713 (1.04) 7.2713 (1.04) 7.2713 (1.04) 0.0000 (1.0) 7.2713 (1.04) 0.0000 (1.0) 0;0 0.1375 (0.96) 1 1
test_pull-pull[2.18.1] 7.3362 (1.05) 7.3362 (1.05) 7.3362 (1.05) 0.0000 (1.0) 7.3362 (1.05) 0.0000 (1.0) 0;0 0.1363 (0.95) 1 1
test_pull-pull[2.39.0] 8.8674 (1.27) 8.8674 (1.27) 8.8674 (1.27) 0.0000 (1.0) 8.8674 (1.27) 0.0000 (1.0) 0;0 0.1128 (0.79) 1 1
test_pull-pull[2.40.0] 8.6425 (1.24) 8.6425 (1.24) 8.6425 (1.24) 0.0000 (1.0) 8.6425 (1.24) 0.0000 (1.0) 0;0 0.1157 (0.81) 1 1
test_pull-pull[2.41.1] 8.8052 (1.26) 8.8052 (1.26) 8.8052 (1.26) 0.0000 (1.0) 8.8052 (1.26) 0.0000 (1.0) 0;0 0.1136 (0.79) 1 1
test_pull-pull[2.45.0] 6.9930 (1.0) 6.9930 (1.0) 6.9930 (1.0) 0.0000 (1.0) 6.9930 (1.0) 0.0000 (1.0) 0;0 0.1430 (1.0) 1 1
test_pull-pull[main] 7.0395 (1.01) 7.0395 (1.01) 7.0395 (1.01) 0.0000 (1.0) 7.0395 (1.01) 0.0000 (1.0) 0;0 0.1421 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 9.4613 (1.90) 9.4613 (1.90) 9.4613 (1.90) 0.0000 (1.0) 9.4613 (1.90) 0.0000 (1.0) 0;0 0.1057 (0.53) 1 1
test_add-add[2.18.1] 8.2948 (1.67) 8.2948 (1.67) 8.2948 (1.67) 0.0000 (1.0) 8.2948 (1.67) 0.0000 (1.0) 0;0 0.1206 (0.60) 1 1
test_add-add[2.39.0] 8.0403 (1.61) 8.0403 (1.61) 8.0403 (1.61) 0.0000 (1.0) 8.0403 (1.61) 0.0000 (1.0) 0;0 0.1244 (0.62) 1 1
test_add-add[2.40.0] 7.7806 (1.56) 7.7806 (1.56) 7.7806 (1.56) 0.0000 (1.0) 7.7806 (1.56) 0.0000 (1.0) 0;0 0.1285 (0.64) 1 1
test_add-add[2.41.1] 8.1189 (1.63) 8.1189 (1.63) 8.1189 (1.63) 0.0000 (1.0) 8.1189 (1.63) 0.0000 (1.0) 0;0 0.1232 (0.61) 1 1
test_add-add[2.45.0] 4.9803 (1.0) 4.9803 (1.0) 4.9803 (1.0) 0.0000 (1.0) 4.9803 (1.0) 0.0000 (1.0) 0;0 0.2008 (1.0) 1 1
test_add-add[main] 5.2278 (1.05) 5.2278 (1.05) 5.2278 (1.05) 0.0000 (1.0) 5.2278 (1.05) 0.0000 (1.0) 0;0 0.1913 (0.95) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_init-init': 7 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 358.1403 (1.0) 583.1756 (1.22) 406.8973 (1.01) 41.1452 (1.62) 395.8720 (1.0) 44.5608 (1.35) 22;5 2.4576 (0.99) 100 1
test_init-init[2.18.1] 359.9747 (1.01) 479.7608 (1.0) 401.5626 (1.0) 27.2108 (1.07) 395.9953 (1.00) 33.0405 (1.00) 30;4 2.4903 (1.0) 100 1
test_init-init[2.39.0] 418.6562 (1.17) 544.1390 (1.13) 474.3179 (1.18) 25.4558 (1.0) 472.6449 (1.19) 41.5524 (1.26) 40;0 2.1083 (0.85) 100 1
test_init-init[2.40.0] 430.0960 (1.20) 598.1888 (1.25) 486.0181 (1.21) 26.3034 (1.03) 483.2020 (1.22) 32.8868 (1.0) 27;2 2.0575 (0.83) 100 1
test_init-init[2.41.1] 423.8964 (1.18) 664.5812 (1.39) 472.7315 (1.18) 32.7537 (1.29) 466.6670 (1.18) 38.0916 (1.16) 26;2 2.1154 (0.85) 100 1
test_init-init[2.45.0] 422.8476 (1.18) 580.7595 (1.21) 483.0943 (1.20) 31.4054 (1.23) 483.8196 (1.22) 43.6128 (1.33) 33;2 2.0700 (0.83) 100 1
test_init-init[main] 517.6510 (1.45) 683.5777 (1.42) 602.2625 (1.50) 34.9162 (1.37) 606.0592 (1.53) 49.0380 (1.49) 33;0 1.6604 (0.67) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 3.9191 (1.13) 3.9191 (1.13) 3.9191 (1.13) 0.0000 (1.0) 3.9191 (1.13) 0.0000 (1.0) 0;0 0.2552 (0.88) 1 1
test_push-push[2.18.1] 3.9124 (1.13) 3.9124 (1.13) 3.9124 (1.13) 0.0000 (1.0) 3.9124 (1.13) 0.0000 (1.0) 0;0 0.2556 (0.88) 1 1
test_push-push[2.39.0] 5.0117 (1.45) 5.0117 (1.45) 5.0117 (1.45) 0.0000 (1.0) 5.0117 (1.45) 0.0000 (1.0) 0;0 0.1995 (0.69) 1 1
test_push-push[2.40.0] 5.5012 (1.59) 5.5012 (1.59) 5.5012 (1.59) 0.0000 (1.0) 5.5012 (1.59) 0.0000 (1.0) 0;0 0.1818 (0.63) 1 1
test_push-push[2.41.1] 5.0123 (1.45) 5.0123 (1.45) 5.0123 (1.45) 0.0000 (1.0) 5.0123 (1.45) 0.0000 (1.0) 0;0 0.1995 (0.69) 1 1
test_push-push[2.45.0] 3.5680 (1.03) 3.5680 (1.03) 3.5680 (1.03) 0.0000 (1.0) 3.5680 (1.03) 0.0000 (1.0) 0;0 0.2803 (0.97) 1 1
test_push-push[main] 3.4607 (1.0) 3.4607 (1.0) 3.4607 (1.0) 0.0000 (1.0) 3.4607 (1.0) 0.0000 (1.0) 0;0 0.2890 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.2249 (1.02) 1.2249 (1.02) 1.2249 (1.02) 0.0000 (1.0) 1.2249 (1.02) 0.0000 (1.0) 0;0 0.8164 (0.98) 1 1
test_checkout_hardlink-checkout[2.18.1] 1.6116 (1.34) 1.6116 (1.34) 1.6116 (1.34) 0.0000 (1.0) 1.6116 (1.34) 0.0000 (1.0) 0;0 0.6205 (0.75) 1 1
test_checkout_hardlink-checkout[2.39.0] 1.2041 (1.0) 1.2041 (1.0) 1.2041 (1.0) 0.0000 (1.0) 1.2041 (1.0) 0.0000 (1.0) 0;0 0.8305 (1.0) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.2094 (1.00) 1.2094 (1.00) 1.2094 (1.00) 0.0000 (1.0) 1.2094 (1.00) 0.0000 (1.0) 0;0 0.8269 (1.00) 1 1
test_checkout_hardlink-checkout[2.41.1] 1.6508 (1.37) 1.6508 (1.37) 1.6508 (1.37) 0.0000 (1.0) 1.6508 (1.37) 0.0000 (1.0) 0;0 0.6058 (0.73) 1 1
test_checkout_hardlink-checkout[2.45.0] 1.5442 (1.28) 1.5442 (1.28) 1.5442 (1.28) 0.0000 (1.0) 1.5442 (1.28) 0.0000 (1.0) 0;0 0.6476 (0.78) 1 1
test_checkout_hardlink-checkout[main] 1.6137 (1.34) 1.6137 (1.34) 1.6137 (1.34) 0.0000 (1.0) 1.6137 (1.34) 0.0000 (1.0) 0;0 0.6197 (0.75) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 477.5478 (1.0) 477.5478 (1.0) 477.5478 (1.0) 0.0000 (1.0) 477.5478 (1.0) 0.0000 (1.0) 0;0 2.0940 (1.0) 1 1
test_checkout_hardlink-checkout-noop[2.18.1] 545.1725 (1.14) 545.1725 (1.14) 545.1725 (1.14) 0.0000 (1.0) 545.1725 (1.14) 0.0000 (1.0) 0;0 1.8343 (0.88) 1 1
test_checkout_hardlink-checkout-noop[2.39.0] 670.1065 (1.40) 670.1065 (1.40) 670.1065 (1.40) 0.0000 (1.0) 670.1065 (1.40) 0.0000 (1.0) 0;0 1.4923 (0.71) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 568.3219 (1.19) 568.3219 (1.19) 568.3219 (1.19) 0.0000 (1.0) 568.3219 (1.19) 0.0000 (1.0) 0;0 1.7596 (0.84) 1 1
test_checkout_hardlink-checkout-noop[2.41.1] 565.4317 (1.18) 565.4317 (1.18) 565.4317 (1.18) 0.0000 (1.0) 565.4317 (1.18) 0.0000 (1.0) 0;0 1.7686 (0.84) 1 1
test_checkout_hardlink-checkout-noop[2.45.0] 592.1617 (1.24) 592.1617 (1.24) 592.1617 (1.24) 0.0000 (1.0) 592.1617 (1.24) 0.0000 (1.0) 0;0 1.6887 (0.81) 1 1
test_checkout_hardlink-checkout-noop[main] 669.3022 (1.40) 669.3022 (1.40) 669.3022 (1.40) 0.0000 (1.0) 669.3022 (1.40) 0.0000 (1.0) 0;0 1.4941 (0.71) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.2384 (1.99) 1.2384 (1.99) 1.2384 (1.99) 0.0000 (1.0) 1.2384 (1.99) 0.0000 (1.0) 0;0 0.8075 (0.50) 1 1
test_checkout_hardlink-checkout-update[2.18.1] 0.6220 (1.0) 0.6220 (1.0) 0.6220 (1.0) 0.0000 (1.0) 0.6220 (1.0) 0.0000 (1.0) 0;0 1.6078 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.39.0] 0.6318 (1.02) 0.6318 (1.02) 0.6318 (1.02) 0.0000 (1.0) 0.6318 (1.02) 0.0000 (1.0) 0;0 1.5827 (0.98) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.6330 (1.02) 0.6330 (1.02) 0.6330 (1.02) 0.0000 (1.0) 0.6330 (1.02) 0.0000 (1.0) 0;0 1.5799 (0.98) 1 1
test_checkout_hardlink-checkout-update[2.41.1] 0.6351 (1.02) 0.6351 (1.02) 0.6351 (1.02) 0.0000 (1.0) 0.6351 (1.02) 0.0000 (1.0) 0;0 1.5745 (0.98) 1 1
test_checkout_hardlink-checkout-update[2.45.0] 0.6649 (1.07) 0.6649 (1.07) 0.6649 (1.07) 0.0000 (1.0) 0.6649 (1.07) 0.0000 (1.0) 0;0 1.5039 (0.94) 1 1
test_checkout_hardlink-checkout-update[main] 0.7297 (1.17) 0.7297 (1.17) 0.7297 (1.17) 0.0000 (1.0) 0.7297 (1.17) 0.0000 (1.0) 0;0 1.3704 (0.85) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 9.2003 (1.24) 9.2003 (1.24) 9.2003 (1.24) 0.0000 (1.0) 9.2003 (1.24) 0.0000 (1.0) 0;0 0.1087 (0.81) 1 1
test_update-update[2.18.1] 8.1969 (1.11) 8.1969 (1.11) 8.1969 (1.11) 0.0000 (1.0) 8.1969 (1.11) 0.0000 (1.0) 0;0 0.1220 (0.90) 1 1
test_update-update[2.39.0] 7.5588 (1.02) 7.5588 (1.02) 7.5588 (1.02) 0.0000 (1.0) 7.5588 (1.02) 0.0000 (1.0) 0;0 0.1323 (0.98) 1 1
test_update-update[2.40.0] 7.4684 (1.01) 7.4684 (1.01) 7.4684 (1.01) 0.0000 (1.0) 7.4684 (1.01) 0.0000 (1.0) 0;0 0.1339 (0.99) 1 1
test_update-update[2.41.1] 7.4178 (1.0) 7.4178 (1.0) 7.4178 (1.0) 0.0000 (1.0) 7.4178 (1.0) 0.0000 (1.0) 0;0 0.1348 (1.0) 1 1
test_update-update[2.45.0] 7.5364 (1.02) 7.5364 (1.02) 7.5364 (1.02) 0.0000 (1.0) 7.5364 (1.02) 0.0000 (1.0) 0;0 0.1327 (0.98) 1 1
test_update-update[main] 7.7503 (1.04) 7.7503 (1.04) 7.7503 (1.04) 0.0000 (1.0) 7.7503 (1.04) 0.0000 (1.0) 0;0 0.1290 (0.96) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 7 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 493.0004 (1.0) 493.0004 (1.0) 493.0004 (1.0) 0.0000 (1.0) 493.0004 (1.0) 0.0000 (1.0) 0;0 2.0284 (1.0) 1 1
test_update-update-noop[2.18.1] 650.2431 (1.32) 650.2431 (1.32) 650.2431 (1.32) 0.0000 (1.0) 650.2431 (1.32) 0.0000 (1.0) 0;0 1.5379 (0.76) 1 1
test_update-update-noop[2.39.0] 955.4355 (1.94) 955.4355 (1.94) 955.4355 (1.94) 0.0000 (1.0) 955.4355 (1.94) 0.0000 (1.0) 0;0 1.0466 (0.52) 1 1
test_update-update-noop[2.40.0] 1,023.0642 (2.08) 1,023.0642 (2.08) 1,023.0642 (2.08) 0.0000 (1.0) 1,023.0642 (2.08) 0.0000 (1.0) 0;0 0.9775 (0.48) 1 1
test_update-update-noop[2.41.1] 956.6511 (1.94) 956.6511 (1.94) 956.6511 (1.94) 0.0000 (1.0) 956.6511 (1.94) 0.0000 (1.0) 0;0 1.0453 (0.52) 1 1
test_update-update-noop[2.45.0] 1,063.8546 (2.16) 1,063.8546 (2.16) 1,063.8546 (2.16) 0.0000 (1.0) 1,063.8546 (2.16) 0.0000 (1.0) 0;0 0.9400 (0.46) 1 1
test_update-update-noop[main] 1,136.3585 (2.30) 1,136.3585 (2.30) 1,136.3585 (2.30) 0.0000 (1.0) 1,136.3585 (2.30) 0.0000 (1.0) 0;0 0.8800 (0.43) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.18.1] 901.7212 (1.0) 901.7212 (1.0) 901.7212 (1.0) 0.0000 (1.0) 901.7212 (1.0) 0.0000 (1.0) 0;0 1.1090 (1.0) 1 1
test_data_status-data-changed[2.39.0] 923.5463 (1.02) 923.5463 (1.02) 923.5463 (1.02) 0.0000 (1.0) 923.5463 (1.02) 0.0000 (1.0) 0;0 1.0828 (0.98) 1 1
test_data_status-data-changed[2.40.0] 920.9078 (1.02) 920.9078 (1.02) 920.9078 (1.02) 0.0000 (1.0) 920.9078 (1.02) 0.0000 (1.0) 0;0 1.0859 (0.98) 1 1
test_data_status-data-changed[2.41.1] 917.8160 (1.02) 917.8160 (1.02) 917.8160 (1.02) 0.0000 (1.0) 917.8160 (1.02) 0.0000 (1.0) 0;0 1.0895 (0.98) 1 1
test_data_status-data-changed[2.45.0] 902.5171 (1.00) 902.5171 (1.00) 902.5171 (1.00) 0.0000 (1.0) 902.5171 (1.00) 0.0000 (1.0) 0;0 1.1080 (1.00) 1 1
test_data_status-data-changed[main] 1,002.5827 (1.11) 1,002.5827 (1.11) 1,002.5827 (1.11) 0.0000 (1.0) 1,002.5827 (1.11) 0.0000 (1.0) 0;0 0.9974 (0.90) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.18.1] 927.2014 (1.04) 927.2014 (1.04) 927.2014 (1.04) 0.0000 (1.0) 927.2014 (1.04) 0.0000 (1.0) 0;0 1.0785 (0.96) 1 1
test_data_status-data-changed-noop[2.39.0] 913.8559 (1.03) 913.8559 (1.03) 913.8559 (1.03) 0.0000 (1.0) 913.8559 (1.03) 0.0000 (1.0) 0;0 1.0943 (0.97) 1 1
test_data_status-data-changed-noop[2.40.0] 946.5642 (1.06) 946.5642 (1.06) 946.5642 (1.06) 0.0000 (1.0) 946.5642 (1.06) 0.0000 (1.0) 0;0 1.0565 (0.94) 1 1
test_data_status-data-changed-noop[2.41.1] 925.1675 (1.04) 925.1675 (1.04) 925.1675 (1.04) 0.0000 (1.0) 925.1675 (1.04) 0.0000 (1.0) 0;0 1.0809 (0.96) 1 1
test_data_status-data-changed-noop[2.45.0] 890.9713 (1.0) 890.9713 (1.0) 890.9713 (1.0) 0.0000 (1.0) 890.9713 (1.0) 0.0000 (1.0) 0;0 1.1224 (1.0) 1 1
test_data_status-data-changed-noop[main] 980.0557 (1.10) 980.0557 (1.10) 980.0557 (1.10) 0.0000 (1.0) 980.0557 (1.10) 0.0000 (1.0) 0;0 1.0204 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.18.1] 2.7958 (1.40) 2.7958 (1.40) 2.7958 (1.40) 0.0000 (1.0) 2.7958 (1.40) 0.0000 (1.0) 0;0 0.3577 (0.71) 1 1
test_data_status-data-new[2.39.0] 2.0754 (1.04) 2.0754 (1.04) 2.0754 (1.04) 0.0000 (1.0) 2.0754 (1.04) 0.0000 (1.0) 0;0 0.4818 (0.96) 1 1
test_data_status-data-new[2.40.0] 2.0582 (1.03) 2.0582 (1.03) 2.0582 (1.03) 0.0000 (1.0) 2.0582 (1.03) 0.0000 (1.0) 0;0 0.4859 (0.97) 1 1
test_data_status-data-new[2.41.1] 2.7456 (1.38) 2.7456 (1.38) 2.7456 (1.38) 0.0000 (1.0) 2.7456 (1.38) 0.0000 (1.0) 0;0 0.3642 (0.73) 1 1
test_data_status-data-new[2.45.0] 2.0225 (1.01) 2.0225 (1.01) 2.0225 (1.01) 0.0000 (1.0) 2.0225 (1.01) 0.0000 (1.0) 0;0 0.4944 (0.99) 1 1
test_data_status-data-new[main] 1.9943 (1.0) 1.9943 (1.0) 1.9943 (1.0) 0.0000 (1.0) 1.9943 (1.0) 0.0000 (1.0) 0;0 0.5014 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.18.1] 889.2960 (1.0) 889.2960 (1.0) 889.2960 (1.0) 0.0000 (1.0) 889.2960 (1.0) 0.0000 (1.0) 0;0 1.1245 (1.0) 1 1
test_data_status-data-noop[2.39.0] 1,215.5897 (1.37) 1,215.5897 (1.37) 1,215.5897 (1.37) 0.0000 (1.0) 1,215.5897 (1.37) 0.0000 (1.0) 0;0 0.8226 (0.73) 1 1
test_data_status-data-noop[2.40.0] 910.2053 (1.02) 910.2053 (1.02) 910.2053 (1.02) 0.0000 (1.0) 910.2053 (1.02) 0.0000 (1.0) 0;0 1.0987 (0.98) 1 1
test_data_status-data-noop[2.41.1] 908.1923 (1.02) 908.1923 (1.02) 908.1923 (1.02) 0.0000 (1.0) 908.1923 (1.02) 0.0000 (1.0) 0;0 1.1011 (0.98) 1 1
test_data_status-data-noop[2.45.0] 902.3479 (1.01) 902.3479 (1.01) 902.3479 (1.01) 0.0000 (1.0) 902.3479 (1.01) 0.0000 (1.0) 0;0 1.1082 (0.99) 1 1
test_data_status-data-noop[main] 986.0282 (1.11) 986.0282 (1.11) 986.0282 (1.11) 0.0000 (1.0) 986.0282 (1.11) 0.0000 (1.0) 0;0 1.0142 (0.90) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.11.0] 3.7504 (1.12) 3.7504 (1.12) 3.7504 (1.12) 0.0000 (1.0) 3.7504 (1.12) 0.0000 (1.0) 0;0 0.2666 (0.89) 1 1
test_exp_show-exp[2.18.1] 3.8464 (1.15) 3.8464 (1.15) 3.8464 (1.15) 0.0000 (1.0) 3.8464 (1.15) 0.0000 (1.0) 0;0 0.2600 (0.87) 1 1
test_exp_show-exp[2.39.0] 3.3452 (1.0) 3.3452 (1.0) 3.3452 (1.0) 0.0000 (1.0) 3.3452 (1.0) 0.0000 (1.0) 0;0 0.2989 (1.0) 1 1
test_exp_show-exp[2.40.0] 3.3682 (1.01) 3.3682 (1.01) 3.3682 (1.01) 0.0000 (1.0) 3.3682 (1.01) 0.0000 (1.0) 0;0 0.2969 (0.99) 1 1
test_exp_show-exp[2.41.1] 3.3820 (1.01) 3.3820 (1.01) 3.3820 (1.01) 0.0000 (1.0) 3.3820 (1.01) 0.0000 (1.0) 0;0 0.2957 (0.99) 1 1
test_exp_show-exp[2.45.0] 3.5173 (1.05) 3.5173 (1.05) 3.5173 (1.05) 0.0000 (1.0) 3.5173 (1.05) 0.0000 (1.0) 0;0 0.2843 (0.95) 1 1
test_exp_show-exp[main] 4.4403 (1.33) 4.4403 (1.33) 4.4403 (1.33) 0.0000 (1.0) 4.4403 (1.33) 0.0000 (1.0) 0;0 0.2252 (0.75) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 453.1621 (1.08) 453.1621 (1.08) 453.1621 (1.08) 0.0000 (1.0) 453.1621 (1.08) 0.0000 (1.0) 0;0 2.2067 (0.92) 1 1
test_list-list[2.18.1] 418.5044 (1.0) 418.5044 (1.0) 418.5044 (1.0) 0.0000 (1.0) 418.5044 (1.0) 0.0000 (1.0) 0;0 2.3895 (1.0) 1 1
test_list-list[2.39.0] 437.2986 (1.04) 437.2986 (1.04) 437.2986 (1.04) 0.0000 (1.0) 437.2986 (1.04) 0.0000 (1.0) 0;0 2.2868 (0.96) 1 1
test_list-list[2.40.0] 445.8486 (1.07) 445.8486 (1.07) 445.8486 (1.07) 0.0000 (1.0) 445.8486 (1.07) 0.0000 (1.0) 0;0 2.2429 (0.94) 1 1
test_list-list[2.41.1] 446.2437 (1.07) 446.2437 (1.07) 446.2437 (1.07) 0.0000 (1.0) 446.2437 (1.07) 0.0000 (1.0) 0;0 2.2409 (0.94) 1 1
test_list-list[2.45.0] 465.6651 (1.11) 465.6651 (1.11) 465.6651 (1.11) 0.0000 (1.0) 465.6651 (1.11) 0.0000 (1.0) 0;0 2.1475 (0.90) 1 1
test_list-list[main] 562.1309 (1.34) 562.1309 (1.34) 562.1309 (1.34) 0.0000 (1.0) 562.1309 (1.34) 0.0000 (1.0) 0;0 1.7789 (0.74) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 446.4313 (1.08) 446.4313 (1.08) 446.4313 (1.08) 0.0000 (1.0) 446.4313 (1.08) 0.0000 (1.0) 0;0 2.2400 (0.93) 1 1
test_list-list-dvc-only[2.18.1] 413.9305 (1.0) 413.9305 (1.0) 413.9305 (1.0) 0.0000 (1.0) 413.9305 (1.0) 0.0000 (1.0) 0;0 2.4159 (1.0) 1 1
test_list-list-dvc-only[2.39.0] 433.3798 (1.05) 433.3798 (1.05) 433.3798 (1.05) 0.0000 (1.0) 433.3798 (1.05) 0.0000 (1.0) 0;0 2.3074 (0.96) 1 1
test_list-list-dvc-only[2.40.0] 415.6768 (1.00) 415.6768 (1.00) 415.6768 (1.00) 0.0000 (1.0) 415.6768 (1.00) 0.0000 (1.0) 0;0 2.4057 (1.00) 1 1
test_list-list-dvc-only[2.41.1] 429.6112 (1.04) 429.6112 (1.04) 429.6112 (1.04) 0.0000 (1.0) 429.6112 (1.04) 0.0000 (1.0) 0;0 2.3277 (0.96) 1 1
test_list-list-dvc-only[2.45.0] 454.2543 (1.10) 454.2543 (1.10) 454.2543 (1.10) 0.0000 (1.0) 454.2543 (1.10) 0.0000 (1.0) 0;0 2.2014 (0.91) 1 1
test_list-list-dvc-only[main] 546.7253 (1.32) 546.7253 (1.32) 546.7253 (1.32) 0.0000 (1.0) 546.7253 (1.32) 0.0000 (1.0) 0;0 1.8291 (0.76) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.7170 (3.50) 1.7170 (3.50) 1.7170 (3.50) 0.0000 (1.0) 1.7170 (3.50) 0.0000 (1.0) 0;0 0.5824 (0.29) 1 1
test_list-list-recursive[2.18.1] 2.3816 (4.85) 2.3816 (4.85) 2.3816 (4.85) 0.0000 (1.0) 2.3816 (4.85) 0.0000 (1.0) 0;0 0.4199 (0.21) 1 1
test_list-list-recursive[2.39.0] 0.8181 (1.67) 0.8181 (1.67) 0.8181 (1.67) 0.0000 (1.0) 0.8181 (1.67) 0.0000 (1.0) 0;0 1.2224 (0.60) 1 1
test_list-list-recursive[2.40.0] 0.4906 (1.0) 0.4906 (1.0) 0.4906 (1.0) 0.0000 (1.0) 0.4906 (1.0) 0.0000 (1.0) 0;0 2.0383 (1.0) 1 1
test_list-list-recursive[2.41.1] 0.4983 (1.02) 0.4983 (1.02) 0.4983 (1.02) 0.0000 (1.0) 0.4983 (1.02) 0.0000 (1.0) 0;0 2.0069 (0.98) 1 1
test_list-list-recursive[2.45.0] 0.5270 (1.07) 0.5270 (1.07) 0.5270 (1.07) 0.0000 (1.0) 0.5270 (1.07) 0.0000 (1.0) 0;0 1.8975 (0.93) 1 1
test_list-list-recursive[main] 0.6799 (1.39) 0.6799 (1.39) 0.6799 (1.39) 0.0000 (1.0) 0.6799 (1.39) 0.0000 (1.0) 0;0 1.4708 (0.72) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 438.9904 (1.04) 438.9904 (1.04) 438.9904 (1.04) 0.0000 (1.0) 438.9904 (1.04) 0.0000 (1.0) 0;0 2.2780 (0.96) 1 1
test_list-list-shallow[2.18.1] 423.1148 (1.0) 423.1148 (1.0) 423.1148 (1.0) 0.0000 (1.0) 423.1148 (1.0) 0.0000 (1.0) 0;0 2.3634 (1.0) 1 1
test_list-list-shallow[2.39.0] 463.3748 (1.10) 463.3748 (1.10) 463.3748 (1.10) 0.0000 (1.0) 463.3748 (1.10) 0.0000 (1.0) 0;0 2.1581 (0.91) 1 1
test_list-list-shallow[2.40.0] 462.1589 (1.09) 462.1589 (1.09) 462.1589 (1.09) 0.0000 (1.0) 462.1589 (1.09) 0.0000 (1.0) 0;0 2.1638 (0.92) 1 1
test_list-list-shallow[2.41.1] 461.6848 (1.09) 461.6848 (1.09) 461.6848 (1.09) 0.0000 (1.0) 461.6848 (1.09) 0.0000 (1.0) 0;0 2.1660 (0.92) 1 1
test_list-list-shallow[2.45.0] 475.6800 (1.12) 475.6800 (1.12) 475.6800 (1.12) 0.0000 (1.0) 475.6800 (1.12) 0.0000 (1.0) 0;0 2.1023 (0.89) 1 1
test_list-list-shallow[main] 550.6515 (1.30) 550.6515 (1.30) 550.6515 (1.30) 0.0000 (1.0) 550.6515 (1.30) 0.0000 (1.0) 0;0 1.8160 (0.77) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 7 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 181.0717 (1.0) 216.0928 (1.0) 188.2611 (1.0) 5.6225 (1.10) 186.9129 (1.0) 5.0647 (1.0) 20;6 5.3118 (1.0) 100 1
test_help---help[2.18.1] 185.9525 (1.03) 229.1034 (1.06) 196.5648 (1.04) 7.2636 (1.43) 194.8813 (1.04) 7.2438 (1.43) 17;6 5.0874 (0.96) 100 1
test_help---help[2.39.0] 238.1459 (1.32) 281.5976 (1.30) 247.8748 (1.32) 7.7945 (1.53) 246.2137 (1.32) 7.6843 (1.52) 20;5 4.0343 (0.76) 100 1
test_help---help[2.40.0] 238.7857 (1.32) 262.8453 (1.22) 247.8159 (1.32) 5.2686 (1.03) 246.5821 (1.32) 6.2886 (1.24) 29;4 4.0353 (0.76) 100 1
test_help---help[2.41.1] 241.0632 (1.33) 267.1110 (1.24) 252.1163 (1.34) 5.4647 (1.07) 251.7035 (1.35) 6.7899 (1.34) 31;2 3.9664 (0.75) 100 1
test_help---help[2.45.0] 193.7598 (1.07) 223.4609 (1.03) 202.7764 (1.08) 5.0960 (1.0) 201.9680 (1.08) 5.4030 (1.07) 22;4 4.9315 (0.93) 100 1
test_help---help[main] 195.4717 (1.08) 227.9190 (1.05) 208.5700 (1.11) 7.1404 (1.40) 207.6909 (1.11) 10.2106 (2.02) 33;0 4.7946 (0.90) 100 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 1.6522 (1.22) 1.6522 (1.22) 1.6522 (1.22) 0.0000 (1.0) 1.6522 (1.22) 0.0000 (1.0) 0;0 0.6053 (0.82) 1 1
test_diff-diff[2.18.1] 1.3492 (1.0) 1.3492 (1.0) 1.3492 (1.0) 0.0000 (1.0) 1.3492 (1.0) 0.0000 (1.0) 0;0 0.7412 (1.0) 1 1
test_diff-diff[2.39.0] 1.3848 (1.03) 1.3848 (1.03) 1.3848 (1.03) 0.0000 (1.0) 1.3848 (1.03) 0.0000 (1.0) 0;0 0.7221 (0.97) 1 1
test_diff-diff[2.40.0] 1.3747 (1.02) 1.3747 (1.02) 1.3747 (1.02) 0.0000 (1.0) 1.3747 (1.02) 0.0000 (1.0) 0;0 0.7275 (0.98) 1 1
test_diff-diff[2.41.1] 1.3716 (1.02) 1.3716 (1.02) 1.3716 (1.02) 0.0000 (1.0) 1.3716 (1.02) 0.0000 (1.0) 0;0 0.7291 (0.98) 1 1
test_diff-diff[2.45.0] 1.3770 (1.02) 1.3770 (1.02) 1.3770 (1.02) 0.0000 (1.0) 1.3770 (1.02) 0.0000 (1.0) 0;0 0.7262 (0.98) 1 1
test_diff-diff[main] 1.3655 (1.01) 1.3655 (1.01) 1.3655 (1.01) 0.0000 (1.0) 1.3655 (1.01) 0.0000 (1.0) 0;0 0.7323 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.0992 (1.70) 1.0992 (1.70) 1.0992 (1.70) 0.0000 (1.0) 1.0992 (1.70) 0.0000 (1.0) 0;0 0.9097 (0.59) 1 1
test_diff-diff-changed[2.18.1] 0.6459 (1.0) 0.6459 (1.0) 0.6459 (1.0) 0.0000 (1.0) 0.6459 (1.0) 0.0000 (1.0) 0;0 1.5482 (1.0) 1 1
test_diff-diff-changed[2.39.0] 0.6589 (1.02) 0.6589 (1.02) 0.6589 (1.02) 0.0000 (1.0) 0.6589 (1.02) 0.0000 (1.0) 0;0 1.5176 (0.98) 1 1
test_diff-diff-changed[2.40.0] 0.6632 (1.03) 0.6632 (1.03) 0.6632 (1.03) 0.0000 (1.0) 0.6632 (1.03) 0.0000 (1.0) 0;0 1.5078 (0.97) 1 1
test_diff-diff-changed[2.41.1] 0.6533 (1.01) 0.6533 (1.01) 0.6533 (1.01) 0.0000 (1.0) 0.6533 (1.01) 0.0000 (1.0) 0;0 1.5307 (0.99) 1 1
test_diff-diff-changed[2.45.0] 0.6862 (1.06) 0.6862 (1.06) 0.6862 (1.06) 0.0000 (1.0) 0.6862 (1.06) 0.0000 (1.0) 0;0 1.4572 (0.94) 1 1
test_diff-diff-changed[main] 0.7622 (1.18) 0.7622 (1.18) 0.7622 (1.18) 0.0000 (1.0) 0.7622 (1.18) 0.0000 (1.0) 0;0 1.3120 (0.85) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 498.7017 (1.0) 498.7017 (1.0) 498.7017 (1.0) 0.0000 (1.0) 498.7017 (1.0) 0.0000 (1.0) 0;0 2.0052 (1.0) 1 1
test_diff-diff-changed-noop[2.18.1] 640.3671 (1.28) 640.3671 (1.28) 640.3671 (1.28) 0.0000 (1.0) 640.3671 (1.28) 0.0000 (1.0) 0;0 1.5616 (0.78) 1 1
test_diff-diff-changed-noop[2.39.0] 661.8026 (1.33) 661.8026 (1.33) 661.8026 (1.33) 0.0000 (1.0) 661.8026 (1.33) 0.0000 (1.0) 0;0 1.5110 (0.75) 1 1
test_diff-diff-changed-noop[2.40.0] 929.4742 (1.86) 929.4742 (1.86) 929.4742 (1.86) 0.0000 (1.0) 929.4742 (1.86) 0.0000 (1.0) 0;0 1.0759 (0.54) 1 1
test_diff-diff-changed-noop[2.41.1] 654.8258 (1.31) 654.8258 (1.31) 654.8258 (1.31) 0.0000 (1.0) 654.8258 (1.31) 0.0000 (1.0) 0;0 1.5271 (0.76) 1 1
test_diff-diff-changed-noop[2.45.0] 685.0916 (1.37) 685.0916 (1.37) 685.0916 (1.37) 0.0000 (1.0) 685.0916 (1.37) 0.0000 (1.0) 0;0 1.4597 (0.73) 1 1
test_diff-diff-changed-noop[main] 720.8260 (1.45) 720.8260 (1.45) 720.8260 (1.45) 0.0000 (1.0) 720.8260 (1.45) 0.0000 (1.0) 0;0 1.3873 (0.69) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 459.4435 (1.0) 459.4435 (1.0) 459.4435 (1.0) 0.0000 (1.0) 459.4435 (1.0) 0.0000 (1.0) 0;0 2.1765 (1.0) 1 1
test_diff-diff-noop[2.18.1] 596.1671 (1.30) 596.1671 (1.30) 596.1671 (1.30) 0.0000 (1.0) 596.1671 (1.30) 0.0000 (1.0) 0;0 1.6774 (0.77) 1 1
test_diff-diff-noop[2.39.0] 625.1601 (1.36) 625.1601 (1.36) 625.1601 (1.36) 0.0000 (1.0) 625.1601 (1.36) 0.0000 (1.0) 0;0 1.5996 (0.73) 1 1
test_diff-diff-noop[2.40.0] 624.8289 (1.36) 624.8289 (1.36) 624.8289 (1.36) 0.0000 (1.0) 624.8289 (1.36) 0.0000 (1.0) 0;0 1.6004 (0.74) 1 1
test_diff-diff-noop[2.41.1] 624.5090 (1.36) 624.5090 (1.36) 624.5090 (1.36) 0.0000 (1.0) 624.5090 (1.36) 0.0000 (1.0) 0;0 1.6013 (0.74) 1 1
test_diff-diff-noop[2.45.0] 644.3176 (1.40) 644.3176 (1.40) 644.3176 (1.40) 0.0000 (1.0) 644.3176 (1.40) 0.0000 (1.0) 0;0 1.5520 (0.71) 1 1
test_diff-diff-noop[main] 685.8780 (1.49) 685.8780 (1.49) 685.8780 (1.49) 0.0000 (1.0) 685.8780 (1.49) 0.0000 (1.0) 0;0 1.4580 (0.67) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 4.3509 (1.01) 4.3509 (1.01) 4.3509 (1.01) 0.0000 (1.0) 4.3509 (1.01) 0.0000 (1.0) 0;0 0.2298 (0.99) 1 1
test_checkout_copy-checkout[2.18.1] 4.3085 (1.0) 4.3085 (1.0) 4.3085 (1.0) 0.0000 (1.0) 4.3085 (1.0) 0.0000 (1.0) 0;0 0.2321 (1.0) 1 1
test_checkout_copy-checkout[2.39.0] 4.4392 (1.03) 4.4392 (1.03) 4.4392 (1.03) 0.0000 (1.0) 4.4392 (1.03) 0.0000 (1.0) 0;0 0.2253 (0.97) 1 1
test_checkout_copy-checkout[2.40.0] 4.3914 (1.02) 4.3914 (1.02) 4.3914 (1.02) 0.0000 (1.0) 4.3914 (1.02) 0.0000 (1.0) 0;0 0.2277 (0.98) 1 1
test_checkout_copy-checkout[2.41.1] 4.4756 (1.04) 4.4756 (1.04) 4.4756 (1.04) 0.0000 (1.0) 4.4756 (1.04) 0.0000 (1.0) 0;0 0.2234 (0.96) 1 1
test_checkout_copy-checkout[2.45.0] 4.6257 (1.07) 4.6257 (1.07) 4.6257 (1.07) 0.0000 (1.0) 4.6257 (1.07) 0.0000 (1.0) 0;0 0.2162 (0.93) 1 1
test_checkout_copy-checkout[main] 4.9317 (1.14) 4.9317 (1.14) 4.9317 (1.14) 0.0000 (1.0) 4.9317 (1.14) 0.0000 (1.0) 0;0 0.2028 (0.87) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 643.1655 (1.0) 643.1655 (1.0) 643.1655 (1.0) 0.0000 (1.0) 643.1655 (1.0) 0.0000 (1.0) 0;0 1.5548 (1.0) 1 1
test_checkout_copy-checkout-noop[2.18.1] 751.3403 (1.17) 751.3403 (1.17) 751.3403 (1.17) 0.0000 (1.0) 751.3403 (1.17) 0.0000 (1.0) 0;0 1.3310 (0.86) 1 1
test_checkout_copy-checkout-noop[2.39.0] 820.6581 (1.28) 820.6581 (1.28) 820.6581 (1.28) 0.0000 (1.0) 820.6581 (1.28) 0.0000 (1.0) 0;0 1.2185 (0.78) 1 1
test_checkout_copy-checkout-noop[2.40.0] 832.9163 (1.30) 832.9163 (1.30) 832.9163 (1.30) 0.0000 (1.0) 832.9163 (1.30) 0.0000 (1.0) 0;0 1.2006 (0.77) 1 1
test_checkout_copy-checkout-noop[2.41.1] 814.7557 (1.27) 814.7557 (1.27) 814.7557 (1.27) 0.0000 (1.0) 814.7557 (1.27) 0.0000 (1.0) 0;0 1.2274 (0.79) 1 1
test_checkout_copy-checkout-noop[2.45.0] 860.4508 (1.34) 860.4508 (1.34) 860.4508 (1.34) 0.0000 (1.0) 860.4508 (1.34) 0.0000 (1.0) 0;0 1.1622 (0.75) 1 1
test_checkout_copy-checkout-noop[main] 971.7846 (1.51) 971.7846 (1.51) 971.7846 (1.51) 0.0000 (1.0) 971.7846 (1.51) 0.0000 (1.0) 0;0 1.0290 (0.66) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.7636 (2.01) 1.7636 (2.01) 1.7636 (2.01) 0.0000 (1.0) 1.7636 (2.01) 0.0000 (1.0) 0;0 0.5670 (0.50) 1 1
test_checkout_copy-checkout-update[2.18.1] 0.8782 (1.0) 0.8782 (1.0) 0.8782 (1.0) 0.0000 (1.0) 0.8782 (1.0) 0.0000 (1.0) 0;0 1.1387 (1.0) 1 1
test_checkout_copy-checkout-update[2.39.0] 0.9097 (1.04) 0.9097 (1.04) 0.9097 (1.04) 0.0000 (1.0) 0.9097 (1.04) 0.0000 (1.0) 0;0 1.0993 (0.97) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.9063 (1.03) 0.9063 (1.03) 0.9063 (1.03) 0.0000 (1.0) 0.9063 (1.03) 0.0000 (1.0) 0;0 1.1034 (0.97) 1 1
test_checkout_copy-checkout-update[2.41.1] 0.8839 (1.01) 0.8839 (1.01) 0.8839 (1.01) 0.0000 (1.0) 0.8839 (1.01) 0.0000 (1.0) 0;0 1.1313 (0.99) 1 1
test_checkout_copy-checkout-update[2.45.0] 0.9174 (1.04) 0.9174 (1.04) 0.9174 (1.04) 0.0000 (1.0) 0.9174 (1.04) 0.0000 (1.0) 0;0 1.0901 (0.96) 1 1
test_checkout_copy-checkout-update[main] 1.0899 (1.24) 1.0899 (1.24) 1.0899 (1.24) 0.0000 (1.0) 1.0899 (1.24) 0.0000 (1.0) 0;0 0.9175 (0.81) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 17.6089 (1.53) 17.6089 (1.53) 17.6089 (1.53) 0.0000 (1.0) 17.6089 (1.53) 0.0000 (1.0) 0;0 0.0568 (0.66) 1 1
test_import-import[2.18.1] 16.7376 (1.45) 16.7376 (1.45) 16.7376 (1.45) 0.0000 (1.0) 16.7376 (1.45) 0.0000 (1.0) 0;0 0.0597 (0.69) 1 1
test_import-import[2.39.0] 15.0785 (1.31) 15.0785 (1.31) 15.0785 (1.31) 0.0000 (1.0) 15.0785 (1.31) 0.0000 (1.0) 0;0 0.0663 (0.77) 1 1
test_import-import[2.40.0] 14.5964 (1.26) 14.5964 (1.26) 14.5964 (1.26) 0.0000 (1.0) 14.5964 (1.26) 0.0000 (1.0) 0;0 0.0685 (0.79) 1 1
test_import-import[2.41.1] 14.5047 (1.26) 14.5047 (1.26) 14.5047 (1.26) 0.0000 (1.0) 14.5047 (1.26) 0.0000 (1.0) 0;0 0.0689 (0.80) 1 1
test_import-import[2.45.0] 11.5464 (1.0) 11.5464 (1.0) 11.5464 (1.0) 0.0000 (1.0) 11.5464 (1.0) 0.0000 (1.0) 0;0 0.0866 (1.0) 1 1
test_import-import[main] 12.4166 (1.08) 12.4166 (1.08) 12.4166 (1.08) 0.0000 (1.0) 12.4166 (1.08) 0.0000 (1.0) 0;0 0.0805 (0.93) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 6.4076 (3.34) 6.4076 (3.34) 6.4076 (3.34) 0.0000 (1.0) 6.4076 (3.34) 0.0000 (1.0) 0;0 0.1561 (0.30) 1 1
test_partial_remove-add[2.18.1] 3.1513 (1.64) 3.1513 (1.64) 3.1513 (1.64) 0.0000 (1.0) 3.1513 (1.64) 0.0000 (1.0) 0;0 0.3173 (0.61) 1 1
test_partial_remove-add[2.39.0] 2.3284 (1.21) 2.3284 (1.21) 2.3284 (1.21) 0.0000 (1.0) 2.3284 (1.21) 0.0000 (1.0) 0;0 0.4295 (0.82) 1 1
test_partial_remove-add[2.40.0] 3.9360 (2.05) 3.9360 (2.05) 3.9360 (2.05) 0.0000 (1.0) 3.9360 (2.05) 0.0000 (1.0) 0;0 0.2541 (0.49) 1 1
test_partial_remove-add[2.41.1] 2.3566 (1.23) 2.3566 (1.23) 2.3566 (1.23) 0.0000 (1.0) 2.3566 (1.23) 0.0000 (1.0) 0;0 0.4243 (0.81) 1 1
test_partial_remove-add[2.45.0] 4.0869 (2.13) 4.0869 (2.13) 4.0869 (2.13) 0.0000 (1.0) 4.0869 (2.13) 0.0000 (1.0) 0;0 0.2447 (0.47) 1 1
test_partial_remove-add[main] 1.9194 (1.0) 1.9194 (1.0) 1.9194 (1.0) 0.0000 (1.0) 1.9194 (1.0) 0.0000 (1.0) 0;0 0.5210 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 513.1981 (1.0) 513.1981 (1.0) 513.1981 (1.0) 0.0000 (1.0) 513.1981 (1.0) 0.0000 (1.0) 0;0 1.9486 (1.0) 1 1
test_partial_remove-gc[2.18.1] 617.7345 (1.20) 617.7345 (1.20) 617.7345 (1.20) 0.0000 (1.0) 617.7345 (1.20) 0.0000 (1.0) 0;0 1.6188 (0.83) 1 1
test_partial_remove-gc[2.39.0] 621.6210 (1.21) 621.6210 (1.21) 621.6210 (1.21) 0.0000 (1.0) 621.6210 (1.21) 0.0000 (1.0) 0;0 1.6087 (0.83) 1 1
test_partial_remove-gc[2.40.0] 606.9957 (1.18) 606.9957 (1.18) 606.9957 (1.18) 0.0000 (1.0) 606.9957 (1.18) 0.0000 (1.0) 0;0 1.6475 (0.85) 1 1
test_partial_remove-gc[2.41.1] 614.2686 (1.20) 614.2686 (1.20) 614.2686 (1.20) 0.0000 (1.0) 614.2686 (1.20) 0.0000 (1.0) 0;0 1.6280 (0.84) 1 1
test_partial_remove-gc[2.45.0] 614.5535 (1.20) 614.5535 (1.20) 614.5535 (1.20) 0.0000 (1.0) 614.5535 (1.20) 0.0000 (1.0) 0;0 1.6272 (0.84) 1 1
test_partial_remove-gc[main] 700.2652 (1.36) 700.2652 (1.36) 700.2652 (1.36) 0.0000 (1.0) 700.2652 (1.36) 0.0000 (1.0) 0;0 1.4280 (0.73) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 556.6895 (1.0) 556.6895 (1.0) 556.6895 (1.0) 0.0000 (1.0) 556.6895 (1.0) 0.0000 (1.0) 0;0 1.7963 (1.0) 1 1
test_partial_remove-gc-cloud[2.18.1] 662.1481 (1.19) 662.1481 (1.19) 662.1481 (1.19) 0.0000 (1.0) 662.1481 (1.19) 0.0000 (1.0) 0;0 1.5102 (0.84) 1 1
test_partial_remove-gc-cloud[2.39.0] 645.2205 (1.16) 645.2205 (1.16) 645.2205 (1.16) 0.0000 (1.0) 645.2205 (1.16) 0.0000 (1.0) 0;0 1.5499 (0.86) 1 1
test_partial_remove-gc-cloud[2.40.0] 646.5248 (1.16) 646.5248 (1.16) 646.5248 (1.16) 0.0000 (1.0) 646.5248 (1.16) 0.0000 (1.0) 0;0 1.5467 (0.86) 1 1
test_partial_remove-gc-cloud[2.41.1] 643.6163 (1.16) 643.6163 (1.16) 643.6163 (1.16) 0.0000 (1.0) 643.6163 (1.16) 0.0000 (1.0) 0;0 1.5537 (0.86) 1 1
test_partial_remove-gc-cloud[2.45.0] 650.9094 (1.17) 650.9094 (1.17) 650.9094 (1.17) 0.0000 (1.0) 650.9094 (1.17) 0.0000 (1.0) 0;0 1.5363 (0.86) 1 1
test_partial_remove-gc-cloud[main] 717.3615 (1.29) 717.3615 (1.29) 717.3615 (1.29) 0.0000 (1.0) 717.3615 (1.29) 0.0000 (1.0) 0;0 1.3940 (0.78) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 568.5700 (1.0) 568.5700 (1.0) 568.5700 (1.0) 0.0000 (1.0) 568.5700 (1.0) 0.0000 (1.0) 0;0 1.7588 (1.0) 1 1
test_partial_remove-push[2.18.1] 569.2285 (1.00) 569.2285 (1.00) 569.2285 (1.00) 0.0000 (1.0) 569.2285 (1.00) 0.0000 (1.0) 0;0 1.7568 (1.00) 1 1
test_partial_remove-push[2.39.0] 576.3427 (1.01) 576.3427 (1.01) 576.3427 (1.01) 0.0000 (1.0) 576.3427 (1.01) 0.0000 (1.0) 0;0 1.7351 (0.99) 1 1
test_partial_remove-push[2.40.0] 612.1418 (1.08) 612.1418 (1.08) 612.1418 (1.08) 0.0000 (1.0) 612.1418 (1.08) 0.0000 (1.0) 0;0 1.6336 (0.93) 1 1
test_partial_remove-push[2.41.1] 584.5395 (1.03) 584.5395 (1.03) 584.5395 (1.03) 0.0000 (1.0) 584.5395 (1.03) 0.0000 (1.0) 0;0 1.7107 (0.97) 1 1
test_partial_remove-push[2.45.0] 638.1025 (1.12) 638.1025 (1.12) 638.1025 (1.12) 0.0000 (1.0) 638.1025 (1.12) 0.0000 (1.0) 0;0 1.5671 (0.89) 1 1
test_partial_remove-push[main] 763.1905 (1.34) 763.1905 (1.34) 763.1905 (1.34) 0.0000 (1.0) 763.1905 (1.34) 0.0000 (1.0) 0;0 1.3103 (0.74) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial-add[2.11.0] 9.3243 (1.92) 9.3243 (1.92) 9.3243 (1.92) 0.0000 (1.0) 9.3243 (1.92) 0.0000 (1.0) 0;0 0.1072 (0.52) 1 1
test_partial_add-add-partial-add[2.18.1] 7.8301 (1.61) 7.8301 (1.61) 7.8301 (1.61) 0.0000 (1.0) 7.8301 (1.61) 0.0000 (1.0) 0;0 0.1277 (0.62) 1 1
test_partial_add-add-partial-add[2.39.0] 8.9397 (1.84) 8.9397 (1.84) 8.9397 (1.84) 0.0000 (1.0) 8.9397 (1.84) 0.0000 (1.0) 0;0 0.1119 (0.54) 1 1
test_partial_add-add-partial-add[2.40.0] 6.7593 (1.39) 6.7593 (1.39) 6.7593 (1.39) 0.0000 (1.0) 6.7593 (1.39) 0.0000 (1.0) 0;0 0.1479 (0.72) 1 1
test_partial_add-add-partial-add[2.41.1] 8.6966 (1.79) 8.6966 (1.79) 8.6966 (1.79) 0.0000 (1.0) 8.6966 (1.79) 0.0000 (1.0) 0;0 0.1150 (0.56) 1 1
test_partial_add-add-partial-add[2.45.0] 5.4099 (1.12) 5.4099 (1.12) 5.4099 (1.12) 0.0000 (1.0) 5.4099 (1.12) 0.0000 (1.0) 0;0 0.1848 (0.90) 1 1
test_partial_add-add-partial-add[main] 4.8489 (1.0) 4.8489 (1.0) 4.8489 (1.0) 0.0000 (1.0) 4.8489 (1.0) 0.0000 (1.0) 0;0 0.2062 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 641.6977 (1.0) 641.6977 (1.0) 641.6977 (1.0) 0.0000 (1.0) 641.6977 (1.0) 0.0000 (1.0) 0;0 1.5584 (1.0) 1 1
test_partial_add-gc-cloud-noop[2.18.1] 676.3991 (1.05) 676.3991 (1.05) 676.3991 (1.05) 0.0000 (1.0) 676.3991 (1.05) 0.0000 (1.0) 0;0 1.4784 (0.95) 1 1
test_partial_add-gc-cloud-noop[2.39.0] 766.5304 (1.19) 766.5304 (1.19) 766.5304 (1.19) 0.0000 (1.0) 766.5304 (1.19) 0.0000 (1.0) 0;0 1.3046 (0.84) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 750.5488 (1.17) 750.5488 (1.17) 750.5488 (1.17) 0.0000 (1.0) 750.5488 (1.17) 0.0000 (1.0) 0;0 1.3324 (0.85) 1 1
test_partial_add-gc-cloud-noop[2.41.1] 735.1171 (1.15) 735.1171 (1.15) 735.1171 (1.15) 0.0000 (1.0) 735.1171 (1.15) 0.0000 (1.0) 0;0 1.3603 (0.87) 1 1
test_partial_add-gc-cloud-noop[2.45.0] 746.4566 (1.16) 746.4566 (1.16) 746.4566 (1.16) 0.0000 (1.0) 746.4566 (1.16) 0.0000 (1.0) 0;0 1.3397 (0.86) 1 1
test_partial_add-gc-cloud-noop[main] 855.5319 (1.33) 855.5319 (1.33) 855.5319 (1.33) 0.0000 (1.0) 855.5319 (1.33) 0.0000 (1.0) 0;0 1.1689 (0.75) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 548.2910 (1.0) 548.2910 (1.0) 548.2910 (1.0) 0.0000 (1.0) 548.2910 (1.0) 0.0000 (1.0) 0;0 1.8238 (1.0) 1 1
test_partial_add-gc-noop[2.18.1] 598.3047 (1.09) 598.3047 (1.09) 598.3047 (1.09) 0.0000 (1.0) 598.3047 (1.09) 0.0000 (1.0) 0;0 1.6714 (0.92) 1 1
test_partial_add-gc-noop[2.39.0] 660.0242 (1.20) 660.0242 (1.20) 660.0242 (1.20) 0.0000 (1.0) 660.0242 (1.20) 0.0000 (1.0) 0;0 1.5151 (0.83) 1 1
test_partial_add-gc-noop[2.40.0] 666.3123 (1.22) 666.3123 (1.22) 666.3123 (1.22) 0.0000 (1.0) 666.3123 (1.22) 0.0000 (1.0) 0;0 1.5008 (0.82) 1 1
test_partial_add-gc-noop[2.41.1] 678.7212 (1.24) 678.7212 (1.24) 678.7212 (1.24) 0.0000 (1.0) 678.7212 (1.24) 0.0000 (1.0) 0;0 1.4734 (0.81) 1 1
test_partial_add-gc-noop[2.45.0] 656.6170 (1.20) 656.6170 (1.20) 656.6170 (1.20) 0.0000 (1.0) 656.6170 (1.20) 0.0000 (1.0) 0;0 1.5230 (0.84) 1 1
test_partial_add-gc-noop[main] 738.9504 (1.35) 738.9504 (1.35) 738.9504 (1.35) 0.0000 (1.0) 738.9504 (1.35) 0.0000 (1.0) 0;0 1.3533 (0.74) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial-add[2.11.0] 3.2871 (1.13) 3.2871 (1.13) 3.2871 (1.13) 0.0000 (1.0) 3.2871 (1.13) 0.0000 (1.0) 0;0 0.3042 (0.88) 1 1
test_partial_add-push-partial-add[2.18.1] 3.1533 (1.08) 3.1533 (1.08) 3.1533 (1.08) 0.0000 (1.0) 3.1533 (1.08) 0.0000 (1.0) 0;0 0.3171 (0.92) 1 1
test_partial_add-push-partial-add[2.39.0] 7.4471 (2.56) 7.4471 (2.56) 7.4471 (2.56) 0.0000 (1.0) 7.4471 (2.56) 0.0000 (1.0) 0;0 0.1343 (0.39) 1 1
test_partial_add-push-partial-add[2.40.0] 3.9173 (1.35) 3.9173 (1.35) 3.9173 (1.35) 0.0000 (1.0) 3.9173 (1.35) 0.0000 (1.0) 0;0 0.2553 (0.74) 1 1
test_partial_add-push-partial-add[2.41.1] 7.2478 (2.49) 7.2478 (2.49) 7.2478 (2.49) 0.0000 (1.0) 7.2478 (2.49) 0.0000 (1.0) 0;0 0.1380 (0.40) 1 1
test_partial_add-push-partial-add[2.45.0] 2.9080 (1.0) 2.9080 (1.0) 2.9080 (1.0) 0.0000 (1.0) 2.9080 (1.0) 0.0000 (1.0) 0;0 0.3439 (1.0) 1 1
test_partial_add-push-partial-add[main] 2.9738 (1.02) 2.9738 (1.02) 2.9738 (1.02) 0.0000 (1.0) 2.9738 (1.02) 0.0000 (1.0) 0;0 0.3363 (0.98) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
Adds S3 (
dvc_s3.tests.benchmarksto thedvc-benchCI test suite). Daily builds are run against real S3, otherwise moto will be used