github-actions[bot]
commented
1 year ago
Thu May 4 10:18:21 UTC 2023
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.39.0] 1.2701 (1.11) 1.3272 (1.14) 1.2944 (1.12) 0.0213 (2.61) 1.2904 (1.12) 0.0257 (2.62) 2;0 0.7726 (0.89) 5 3
test_plots-plots-diff[2.40.0] 1.2644 (1.10) 1.3059 (1.12) 1.2779 (1.11) 0.0171 (2.09) 1.2706 (1.10) 0.0218 (2.21) 1;0 0.7826 (0.90) 5 3
test_plots-plots-diff[2.41.1] 1.2881 (1.12) 1.3153 (1.12) 1.2975 (1.12) 0.0111 (1.36) 1.2922 (1.12) 0.0149 (1.52) 1;0 0.7707 (0.89) 5 3
test_plots-plots-diff[2.45.0] 1.1644 (1.01) 1.1994 (1.03) 1.1875 (1.03) 0.0139 (1.70) 1.1939 (1.03) 0.0157 (1.59) 1;0 0.8421 (0.97) 5 3
test_plots-plots-diff[main] 1.1490 (1.0) 1.1694 (1.0) 1.1559 (1.0) 0.0082 (1.0) 1.1555 (1.0) 0.0098 (1.0) 1;0 0.8651 (1.0) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.39.0] 2.3708 (1.57) 2.4082 (1.56) 2.3891 (1.56) 0.0148 (1.47) 2.3905 (1.57) 0.0232 (2.29) 2;0 0.4186 (0.64) 5 3
test_plots-plots-diff-json[2.40.0] 2.3779 (1.57) 2.4105 (1.56) 2.3911 (1.56) 0.0142 (1.42) 2.3875 (1.56) 0.0247 (2.44) 1;0 0.4182 (0.64) 5 3
test_plots-plots-diff-json[2.41.1] 2.3650 (1.56) 2.4286 (1.57) 2.4027 (1.57) 0.0235 (2.34) 2.4069 (1.58) 0.0248 (2.45) 2;0 0.4162 (0.64) 5 3
test_plots-plots-diff-json[2.45.0] 2.1137 (1.40) 2.1414 (1.38) 2.1294 (1.39) 0.0100 (1.0) 2.1305 (1.40) 0.0101 (1.0) 2;0 0.4696 (0.72) 5 3
test_plots-plots-diff-json[main] 1.5139 (1.0) 1.5479 (1.0) 1.5307 (1.0) 0.0139 (1.38) 1.5261 (1.0) 0.0221 (2.18) 2;0 0.6533 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.39.0] 857.3360 (1.06) 883.1585 (1.06) 871.3562 (1.06) 12.6317 (1.43) 874.7062 (1.07) 24.5340 (2.08) 1;0 1.1476 (0.94) 5 3
test_plots-plots-show[2.40.0] 866.4994 (1.07) 894.9690 (1.08) 880.5521 (1.07) 10.3245 (1.17) 879.4766 (1.08) 11.8189 (1.0) 2;0 1.1357 (0.93) 5 3
test_plots-plots-show[2.41.1] 868.1902 (1.07) 886.7038 (1.07) 878.3653 (1.07) 8.8138 (1.0) 882.5817 (1.08) 16.1043 (1.36) 2;0 1.1385 (0.93) 5 3
test_plots-plots-show[2.45.0] 811.8531 (1.0) 832.5185 (1.0) 819.2078 (1.0) 8.8919 (1.01) 815.2346 (1.0) 13.8642 (1.17) 1;0 1.2207 (1.0) 5 3
test_plots-plots-show[main] 929.0483 (1.14) 954.3353 (1.15) 939.7993 (1.15) 10.2538 (1.16) 936.3397 (1.15) 15.9064 (1.35) 2;0 1.0641 (0.87) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.39.0] 1.4303 (1.26) 1.4846 (1.27) 1.4647 (1.27) 0.0218 (2.75) 1.4697 (1.27) 0.0301 (3.14) 1;0 0.6827 (0.79) 5 3
test_plots-plots-show-json[2.40.0] 1.4297 (1.26) 1.4550 (1.25) 1.4441 (1.25) 0.0103 (1.29) 1.4458 (1.25) 0.0164 (1.72) 2;0 0.6925 (0.80) 5 3
test_plots-plots-show-json[2.41.1] 1.4569 (1.28) 1.4777 (1.26) 1.4696 (1.27) 0.0079 (1.0) 1.4717 (1.27) 0.0096 (1.0) 2;0 0.6805 (0.78) 5 3
test_plots-plots-show-json[2.45.0] 1.3491 (1.19) 1.3753 (1.18) 1.3591 (1.18) 0.0111 (1.40) 1.3537 (1.17) 0.0171 (1.79) 1;0 0.7358 (0.85) 5 3
test_plots-plots-show-json[main] 1.1353 (1.0) 1.1686 (1.0) 1.1528 (1.0) 0.0122 (1.54) 1.1556 (1.0) 0.0140 (1.46) 2;0 0.8674 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.18.1] 1.6536 (1.0) 1.6536 (1.0) 1.6536 (1.0) 0.0000 (1.0) 1.6536 (1.0) 0.0000 (1.0) 0;0 0.6047 (1.0) 1 1
test_data_status_all_flags-data-changed[2.39.0] 1.7001 (1.03) 1.7001 (1.03) 1.7001 (1.03) 0.0000 (1.0) 1.7001 (1.03) 0.0000 (1.0) 0;0 0.5882 (0.97) 1 1
test_data_status_all_flags-data-changed[2.40.0] 1.6787 (1.02) 1.6787 (1.02) 1.6787 (1.02) 0.0000 (1.0) 1.6787 (1.02) 0.0000 (1.0) 0;0 0.5957 (0.99) 1 1
test_data_status_all_flags-data-changed[2.41.1] 1.7097 (1.03) 1.7097 (1.03) 1.7097 (1.03) 0.0000 (1.0) 1.7097 (1.03) 0.0000 (1.0) 0;0 0.5849 (0.97) 1 1
test_data_status_all_flags-data-changed[2.45.0] 1.6843 (1.02) 1.6843 (1.02) 1.6843 (1.02) 0.0000 (1.0) 1.6843 (1.02) 0.0000 (1.0) 0;0 0.5937 (0.98) 1 1
test_data_status_all_flags-data-changed[main] 1.7475 (1.06) 1.7475 (1.06) 1.7475 (1.06) 0.0000 (1.0) 1.7475 (1.06) 0.0000 (1.0) 0;0 0.5722 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.18.1] 1.6418 (1.0) 1.6418 (1.0) 1.6418 (1.0) 0.0000 (1.0) 1.6418 (1.0) 0.0000 (1.0) 0;0 0.6091 (1.0) 1 1
test_data_status_all_flags-data-changed-noop[2.39.0] 1.6929 (1.03) 1.6929 (1.03) 1.6929 (1.03) 0.0000 (1.0) 1.6929 (1.03) 0.0000 (1.0) 0;0 0.5907 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[2.40.0] 1.6963 (1.03) 1.6963 (1.03) 1.6963 (1.03) 0.0000 (1.0) 1.6963 (1.03) 0.0000 (1.0) 0;0 0.5895 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[2.41.1] 1.6650 (1.01) 1.6650 (1.01) 1.6650 (1.01) 0.0000 (1.0) 1.6650 (1.01) 0.0000 (1.0) 0;0 0.6006 (0.99) 1 1
test_data_status_all_flags-data-changed-noop[2.45.0] 1.7260 (1.05) 1.7260 (1.05) 1.7260 (1.05) 0.0000 (1.0) 1.7260 (1.05) 0.0000 (1.0) 0;0 0.5794 (0.95) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.7703 (1.08) 1.7703 (1.08) 1.7703 (1.08) 0.0000 (1.0) 1.7703 (1.08) 0.0000 (1.0) 0;0 0.5649 (0.93) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.18.1] 2.8837 (1.03) 2.8837 (1.03) 2.8837 (1.03) 0.0000 (1.0) 2.8837 (1.03) 0.0000 (1.0) 0;0 0.3468 (0.97) 1 1
test_data_status_all_flags-data-new[2.39.0] 2.8916 (1.04) 2.8916 (1.04) 2.8916 (1.04) 0.0000 (1.0) 2.8916 (1.04) 0.0000 (1.0) 0;0 0.3458 (0.96) 1 1
test_data_status_all_flags-data-new[2.40.0] 2.8598 (1.03) 2.8598 (1.03) 2.8598 (1.03) 0.0000 (1.0) 2.8598 (1.03) 0.0000 (1.0) 0;0 0.3497 (0.98) 1 1
test_data_status_all_flags-data-new[2.41.1] 2.8809 (1.03) 2.8809 (1.03) 2.8809 (1.03) 0.0000 (1.0) 2.8809 (1.03) 0.0000 (1.0) 0;0 0.3471 (0.97) 1 1
test_data_status_all_flags-data-new[2.45.0] 2.7892 (1.0) 2.7892 (1.0) 2.7892 (1.0) 0.0000 (1.0) 2.7892 (1.0) 0.0000 (1.0) 0;0 0.3585 (1.0) 1 1
test_data_status_all_flags-data-new[main] 2.9510 (1.06) 2.9510 (1.06) 2.9510 (1.06) 0.0000 (1.0) 2.9510 (1.06) 0.0000 (1.0) 0;0 0.3389 (0.95) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.18.1] 1.6428 (1.01) 1.6428 (1.01) 1.6428 (1.01) 0.0000 (1.0) 1.6428 (1.01) 0.0000 (1.0) 0;0 0.6087 (0.99) 1 1
test_data_status_all_flags-data-noop[2.39.0] 1.6246 (1.00) 1.6246 (1.00) 1.6246 (1.00) 0.0000 (1.0) 1.6246 (1.00) 0.0000 (1.0) 0;0 0.6156 (1.00) 1 1
test_data_status_all_flags-data-noop[2.40.0] 1.6285 (1.00) 1.6285 (1.00) 1.6285 (1.00) 0.0000 (1.0) 1.6285 (1.00) 0.0000 (1.0) 0;0 0.6141 (1.00) 1 1
test_data_status_all_flags-data-noop[2.41.1] 1.6235 (1.0) 1.6235 (1.0) 1.6235 (1.0) 0.0000 (1.0) 1.6235 (1.0) 0.0000 (1.0) 0;0 0.6160 (1.0) 1 1
test_data_status_all_flags-data-noop[2.45.0] 1.7211 (1.06) 1.7211 (1.06) 1.7211 (1.06) 0.0000 (1.0) 1.7211 (1.06) 0.0000 (1.0) 0;0 0.5810 (0.94) 1 1
test_data_status_all_flags-data-noop[main] 1.6668 (1.03) 1.6668 (1.03) 1.6668 (1.03) 0.0000 (1.0) 1.6668 (1.03) 0.0000 (1.0) 0;0 0.5999 (0.97) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 8.3158 (1.95) 8.3158 (1.95) 8.3158 (1.95) 0.0000 (1.0) 8.3158 (1.95) 0.0000 (1.0) 0;0 0.1203 (0.51) 1 1
test_sharing-add[2.18.1] 7.0993 (1.67) 7.0993 (1.67) 7.0993 (1.67) 0.0000 (1.0) 7.0993 (1.67) 0.0000 (1.0) 0;0 0.1409 (0.60) 1 1
test_sharing-add[2.39.0] 6.7959 (1.60) 6.7959 (1.60) 6.7959 (1.60) 0.0000 (1.0) 6.7959 (1.60) 0.0000 (1.0) 0;0 0.1471 (0.63) 1 1
test_sharing-add[2.40.0] 6.5472 (1.54) 6.5472 (1.54) 6.5472 (1.54) 0.0000 (1.0) 6.5472 (1.54) 0.0000 (1.0) 0;0 0.1527 (0.65) 1 1
test_sharing-add[2.41.1] 6.6019 (1.55) 6.6019 (1.55) 6.6019 (1.55) 0.0000 (1.0) 6.6019 (1.55) 0.0000 (1.0) 0;0 0.1515 (0.64) 1 1
test_sharing-add[2.45.0] 4.2546 (1.0) 4.2546 (1.0) 4.2546 (1.0) 0.0000 (1.0) 4.2546 (1.0) 0.0000 (1.0) 0;0 0.2350 (1.0) 1 1
test_sharing-add[2.6.3] 9.7974 (2.30) 9.7974 (2.30) 9.7974 (2.30) 0.0000 (1.0) 9.7974 (2.30) 0.0000 (1.0) 0;0 0.1021 (0.43) 1 1
test_sharing-add[main] 4.3187 (1.02) 4.3187 (1.02) 4.3187 (1.02) 0.0000 (1.0) 4.3187 (1.02) 0.0000 (1.0) 0;0 0.2315 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 3.8523 (3.89) 3.8523 (3.89) 3.8523 (3.89) 0.0000 (1.0) 3.8523 (3.89) 0.0000 (1.0) 0;0 0.2596 (0.26) 1 1
test_sharing-add-noop[2.18.1] 3.9702 (4.01) 3.9702 (4.01) 3.9702 (4.01) 0.0000 (1.0) 3.9702 (4.01) 0.0000 (1.0) 0;0 0.2519 (0.25) 1 1
test_sharing-add-noop[2.39.0] 2.7067 (2.74) 2.7067 (2.74) 2.7067 (2.74) 0.0000 (1.0) 2.7067 (2.74) 0.0000 (1.0) 0;0 0.3695 (0.37) 1 1
test_sharing-add-noop[2.40.0] 2.6784 (2.71) 2.6784 (2.71) 2.6784 (2.71) 0.0000 (1.0) 2.6784 (2.71) 0.0000 (1.0) 0;0 0.3734 (0.37) 1 1
test_sharing-add-noop[2.41.1] 2.7139 (2.74) 2.7139 (2.74) 2.7139 (2.74) 0.0000 (1.0) 2.7139 (2.74) 0.0000 (1.0) 0;0 0.3685 (0.36) 1 1
test_sharing-add-noop[2.45.0] 2.7437 (2.77) 2.7437 (2.77) 2.7437 (2.77) 0.0000 (1.0) 2.7437 (2.77) 0.0000 (1.0) 0;0 0.3645 (0.36) 1 1
test_sharing-add-noop[2.6.3] 0.9892 (1.0) 0.9892 (1.0) 0.9892 (1.0) 0.0000 (1.0) 0.9892 (1.0) 0.0000 (1.0) 0;0 1.0109 (1.0) 1 1
test_sharing-add-noop[main] 2.8001 (2.83) 2.8001 (2.83) 2.8001 (2.83) 0.0000 (1.0) 2.8001 (2.83) 0.0000 (1.0) 0;0 0.3571 (0.35) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 531.5035 (1.27) 531.5035 (1.27) 531.5035 (1.27) 0.0000 (1.0) 531.5035 (1.27) 0.0000 (1.0) 0;0 1.8815 (0.79) 1 1
test_sharing-checkout-noop[2.18.1] 607.6094 (1.45) 607.6094 (1.45) 607.6094 (1.45) 0.0000 (1.0) 607.6094 (1.45) 0.0000 (1.0) 0;0 1.6458 (0.69) 1 1
test_sharing-checkout-noop[2.39.0] 615.5314 (1.47) 615.5314 (1.47) 615.5314 (1.47) 0.0000 (1.0) 615.5314 (1.47) 0.0000 (1.0) 0;0 1.6246 (0.68) 1 1
test_sharing-checkout-noop[2.40.0] 623.6560 (1.49) 623.6560 (1.49) 623.6560 (1.49) 0.0000 (1.0) 623.6560 (1.49) 0.0000 (1.0) 0;0 1.6034 (0.67) 1 1
test_sharing-checkout-noop[2.41.1] 628.2079 (1.50) 628.2079 (1.50) 628.2079 (1.50) 0.0000 (1.0) 628.2079 (1.50) 0.0000 (1.0) 0;0 1.5918 (0.67) 1 1
test_sharing-checkout-noop[2.45.0] 648.6158 (1.54) 648.6158 (1.54) 648.6158 (1.54) 0.0000 (1.0) 648.6158 (1.54) 0.0000 (1.0) 0;0 1.5417 (0.65) 1 1
test_sharing-checkout-noop[2.6.3] 419.8775 (1.0) 419.8775 (1.0) 419.8775 (1.0) 0.0000 (1.0) 419.8775 (1.0) 0.0000 (1.0) 0;0 2.3816 (1.0) 1 1
test_sharing-checkout-noop[main] 717.6067 (1.71) 717.6067 (1.71) 717.6067 (1.71) 0.0000 (1.0) 717.6067 (1.71) 0.0000 (1.0) 0;0 1.3935 (0.59) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-pull': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 7.7904 (1.22) 7.7904 (1.22) 7.7904 (1.22) 0.0000 (1.0) 7.7904 (1.22) 0.0000 (1.0) 0;0 0.1284 (0.82) 1 1
test_sharing-pull[2.18.1] 7.8295 (1.22) 7.8295 (1.22) 7.8295 (1.22) 0.0000 (1.0) 7.8295 (1.22) 0.0000 (1.0) 0;0 0.1277 (0.82) 1 1
test_sharing-pull[2.39.0] 9.2787 (1.45) 9.2787 (1.45) 9.2787 (1.45) 0.0000 (1.0) 9.2787 (1.45) 0.0000 (1.0) 0;0 0.1078 (0.69) 1 1
test_sharing-pull[2.40.0] 9.2719 (1.45) 9.2719 (1.45) 9.2719 (1.45) 0.0000 (1.0) 9.2719 (1.45) 0.0000 (1.0) 0;0 0.1079 (0.69) 1 1
test_sharing-pull[2.41.1] 9.3356 (1.46) 9.3356 (1.46) 9.3356 (1.46) 0.0000 (1.0) 9.3356 (1.46) 0.0000 (1.0) 0;0 0.1071 (0.69) 1 1
test_sharing-pull[2.45.0] 7.3980 (1.16) 7.3980 (1.16) 7.3980 (1.16) 0.0000 (1.0) 7.3980 (1.16) 0.0000 (1.0) 0;0 0.1352 (0.87) 1 1
test_sharing-pull[2.6.3] 6.3998 (1.0) 6.3998 (1.0) 6.3998 (1.0) 0.0000 (1.0) 6.3998 (1.0) 0.0000 (1.0) 0;0 0.1563 (1.0) 1 1
test_sharing-pull[main] 7.6650 (1.20) 7.6650 (1.20) 7.6650 (1.20) 0.0000 (1.0) 7.6650 (1.20) 0.0000 (1.0) 0;0 0.1305 (0.83) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 571.2662 (1.27) 571.2662 (1.27) 571.2662 (1.27) 0.0000 (1.0) 571.2662 (1.27) 0.0000 (1.0) 0;0 1.7505 (0.79) 1 1
test_sharing-pull-noop[2.18.1] 649.4851 (1.44) 649.4851 (1.44) 649.4851 (1.44) 0.0000 (1.0) 649.4851 (1.44) 0.0000 (1.0) 0;0 1.5397 (0.69) 1 1
test_sharing-pull-noop[2.39.0] 661.0244 (1.47) 661.0244 (1.47) 661.0244 (1.47) 0.0000 (1.0) 661.0244 (1.47) 0.0000 (1.0) 0;0 1.5128 (0.68) 1 1
test_sharing-pull-noop[2.40.0] 655.3217 (1.45) 655.3217 (1.45) 655.3217 (1.45) 0.0000 (1.0) 655.3217 (1.45) 0.0000 (1.0) 0;0 1.5260 (0.69) 1 1
test_sharing-pull-noop[2.41.1] 660.1796 (1.46) 660.1796 (1.46) 660.1796 (1.46) 0.0000 (1.0) 660.1796 (1.46) 0.0000 (1.0) 0;0 1.5147 (0.68) 1 1
test_sharing-pull-noop[2.45.0] 699.4150 (1.55) 699.4150 (1.55) 699.4150 (1.55) 0.0000 (1.0) 699.4150 (1.55) 0.0000 (1.0) 0;0 1.4298 (0.64) 1 1
test_sharing-pull-noop[2.6.3] 450.7051 (1.0) 450.7051 (1.0) 450.7051 (1.0) 0.0000 (1.0) 450.7051 (1.0) 0.0000 (1.0) 0;0 2.2187 (1.0) 1 1
test_sharing-pull-noop[main] 785.3031 (1.74) 785.3031 (1.74) 785.3031 (1.74) 0.0000 (1.0) 785.3031 (1.74) 0.0000 (1.0) 0;0 1.2734 (0.57) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 4.4146 (1.21) 4.4146 (1.21) 4.4146 (1.21) 0.0000 (1.0) 4.4146 (1.21) 0.0000 (1.0) 0;0 0.2265 (0.83) 1 1
test_sharing-push[2.18.1] 4.2409 (1.16) 4.2409 (1.16) 4.2409 (1.16) 0.0000 (1.0) 4.2409 (1.16) 0.0000 (1.0) 0;0 0.2358 (0.86) 1 1
test_sharing-push[2.39.0] 5.5331 (1.52) 5.5331 (1.52) 5.5331 (1.52) 0.0000 (1.0) 5.5331 (1.52) 0.0000 (1.0) 0;0 0.1807 (0.66) 1 1
test_sharing-push[2.40.0] 5.4497 (1.50) 5.4497 (1.50) 5.4497 (1.50) 0.0000 (1.0) 5.4497 (1.50) 0.0000 (1.0) 0;0 0.1835 (0.67) 1 1
test_sharing-push[2.41.1] 5.5772 (1.53) 5.5772 (1.53) 5.5772 (1.53) 0.0000 (1.0) 5.5772 (1.53) 0.0000 (1.0) 0;0 0.1793 (0.65) 1 1
test_sharing-push[2.45.0] 3.7738 (1.04) 3.7738 (1.04) 3.7738 (1.04) 0.0000 (1.0) 3.7738 (1.04) 0.0000 (1.0) 0;0 0.2650 (0.97) 1 1
test_sharing-push[2.6.3] 3.6424 (1.0) 3.6424 (1.0) 3.6424 (1.0) 0.0000 (1.0) 3.6424 (1.0) 0.0000 (1.0) 0;0 0.2745 (1.0) 1 1
test_sharing-push[main] 3.8600 (1.06) 3.8600 (1.06) 3.8600 (1.06) 0.0000 (1.0) 3.8600 (1.06) 0.0000 (1.0) 0;0 0.2591 (0.94) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 481.6607 (1.07) 481.6607 (1.07) 481.6607 (1.07) 0.0000 (1.0) 481.6607 (1.07) 0.0000 (1.0) 0;0 2.0762 (0.93) 1 1
test_sharing-push-noop[2.18.1] 465.4011 (1.04) 465.4011 (1.04) 465.4011 (1.04) 0.0000 (1.0) 465.4011 (1.04) 0.0000 (1.0) 0;0 2.1487 (0.97) 1 1
test_sharing-push-noop[2.39.0] 508.1581 (1.13) 508.1581 (1.13) 508.1581 (1.13) 0.0000 (1.0) 508.1581 (1.13) 0.0000 (1.0) 0;0 1.9679 (0.88) 1 1
test_sharing-push-noop[2.40.0] 512.9174 (1.14) 512.9174 (1.14) 512.9174 (1.14) 0.0000 (1.0) 512.9174 (1.14) 0.0000 (1.0) 0;0 1.9496 (0.88) 1 1
test_sharing-push-noop[2.41.1] 538.8984 (1.20) 538.8984 (1.20) 538.8984 (1.20) 0.0000 (1.0) 538.8984 (1.20) 0.0000 (1.0) 0;0 1.8556 (0.83) 1 1
test_sharing-push-noop[2.45.0] 510.7015 (1.14) 510.7015 (1.14) 510.7015 (1.14) 0.0000 (1.0) 510.7015 (1.14) 0.0000 (1.0) 0;0 1.9581 (0.88) 1 1
test_sharing-push-noop[2.6.3] 449.4307 (1.0) 449.4307 (1.0) 449.4307 (1.0) 0.0000 (1.0) 449.4307 (1.0) 0.0000 (1.0) 0;0 2.2250 (1.0) 1 1
test_sharing-push-noop[main] 613.7016 (1.37) 613.7016 (1.37) 613.7016 (1.37) 0.0000 (1.0) 613.7016 (1.37) 0.0000 (1.0) 0;0 1.6295 (0.73) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 6.3688 (1.38) 6.3688 (1.38) 6.3688 (1.38) 0.0000 (1.0) 6.3688 (1.38) 0.0000 (1.0) 0;0 0.1570 (0.72) 1 1
test_get-get[2.18.1] 5.8913 (1.28) 5.8913 (1.28) 5.8913 (1.28) 0.0000 (1.0) 5.8913 (1.28) 0.0000 (1.0) 0;0 0.1697 (0.78) 1 1
test_get-get[2.39.0] 4.7619 (1.04) 4.7619 (1.04) 4.7619 (1.04) 0.0000 (1.0) 4.7619 (1.04) 0.0000 (1.0) 0;0 0.2100 (0.97) 1 1
test_get-get[2.40.0] 4.6568 (1.01) 4.6568 (1.01) 4.6568 (1.01) 0.0000 (1.0) 4.6568 (1.01) 0.0000 (1.0) 0;0 0.2147 (0.99) 1 1
test_get-get[2.41.1] 4.5988 (1.0) 4.5988 (1.0) 4.5988 (1.0) 0.0000 (1.0) 4.5988 (1.0) 0.0000 (1.0) 0;0 0.2174 (1.0) 1 1
test_get-get[2.45.0] 4.6539 (1.01) 4.6539 (1.01) 4.6539 (1.01) 0.0000 (1.0) 4.6539 (1.01) 0.0000 (1.0) 0;0 0.2149 (0.99) 1 1
test_get-get[2.6.3] 4.8225 (1.05) 4.8225 (1.05) 4.8225 (1.05) 0.0000 (1.0) 4.8225 (1.05) 0.0000 (1.0) 0;0 0.2074 (0.95) 1 1
test_get-get[main] 6.2540 (1.36) 6.2540 (1.36) 6.2540 (1.36) 0.0000 (1.0) 6.2540 (1.36) 0.0000 (1.0) 0;0 0.1599 (0.74) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 1.3386 (1.35) 1.3386 (1.35) 1.3386 (1.35) 0.0000 (1.0) 1.3386 (1.35) 0.0000 (1.0) 0;0 0.7470 (0.74) 1 1
test_checkout_symlink-checkout[2.18.1] 1.3418 (1.35) 1.3418 (1.35) 1.3418 (1.35) 0.0000 (1.0) 1.3418 (1.35) 0.0000 (1.0) 0;0 0.7453 (0.74) 1 1
test_checkout_symlink-checkout[2.39.0] 1.3334 (1.35) 1.3334 (1.35) 1.3334 (1.35) 0.0000 (1.0) 1.3334 (1.35) 0.0000 (1.0) 0;0 0.7500 (0.74) 1 1
test_checkout_symlink-checkout[2.40.0] 1.3625 (1.37) 1.3625 (1.37) 1.3625 (1.37) 0.0000 (1.0) 1.3625 (1.37) 0.0000 (1.0) 0;0 0.7339 (0.73) 1 1
test_checkout_symlink-checkout[2.41.1] 1.4236 (1.44) 1.4236 (1.44) 1.4236 (1.44) 0.0000 (1.0) 1.4236 (1.44) 0.0000 (1.0) 0;0 0.7024 (0.70) 1 1
test_checkout_symlink-checkout[2.45.0] 1.6352 (1.65) 1.6352 (1.65) 1.6352 (1.65) 0.0000 (1.0) 1.6352 (1.65) 0.0000 (1.0) 0;0 0.6115 (0.61) 1 1
test_checkout_symlink-checkout[2.6.3] 0.9909 (1.0) 0.9909 (1.0) 0.9909 (1.0) 0.0000 (1.0) 0.9909 (1.0) 0.0000 (1.0) 0;0 1.0091 (1.0) 1 1
test_checkout_symlink-checkout[main] 1.6727 (1.69) 1.6727 (1.69) 1.6727 (1.69) 0.0000 (1.0) 1.6727 (1.69) 0.0000 (1.0) 0;0 0.5978 (0.59) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 547.9059 (1.22) 547.9059 (1.22) 547.9059 (1.22) 0.0000 (1.0) 547.9059 (1.22) 0.0000 (1.0) 0;0 1.8251 (0.82) 1 1
test_checkout_symlink-checkout-noop[2.18.1] 578.7484 (1.28) 578.7484 (1.28) 578.7484 (1.28) 0.0000 (1.0) 578.7484 (1.28) 0.0000 (1.0) 0;0 1.7279 (0.78) 1 1
test_checkout_symlink-checkout-noop[2.39.0] 625.4220 (1.39) 625.4220 (1.39) 625.4220 (1.39) 0.0000 (1.0) 625.4220 (1.39) 0.0000 (1.0) 0;0 1.5989 (0.72) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 634.9521 (1.41) 634.9521 (1.41) 634.9521 (1.41) 0.0000 (1.0) 634.9521 (1.41) 0.0000 (1.0) 0;0 1.5749 (0.71) 1 1
test_checkout_symlink-checkout-noop[2.41.1] 616.6905 (1.37) 616.6905 (1.37) 616.6905 (1.37) 0.0000 (1.0) 616.6905 (1.37) 0.0000 (1.0) 0;0 1.6216 (0.73) 1 1
test_checkout_symlink-checkout-noop[2.45.0] 661.3478 (1.47) 661.3478 (1.47) 661.3478 (1.47) 0.0000 (1.0) 661.3478 (1.47) 0.0000 (1.0) 0;0 1.5121 (0.68) 1 1
test_checkout_symlink-checkout-noop[2.6.3] 450.8670 (1.0) 450.8670 (1.0) 450.8670 (1.0) 0.0000 (1.0) 450.8670 (1.0) 0.0000 (1.0) 0;0 2.2179 (1.0) 1 1
test_checkout_symlink-checkout-noop[main] 747.0774 (1.66) 747.0774 (1.66) 747.0774 (1.66) 0.0000 (1.0) 747.0774 (1.66) 0.0000 (1.0) 0;0 1.3385 (0.60) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 1.4865 (2.13) 1.4865 (2.13) 1.4865 (2.13) 0.0000 (1.0) 1.4865 (2.13) 0.0000 (1.0) 0;0 0.6727 (0.47) 1 1
test_checkout_symlink-checkout-update[2.18.1] 0.6979 (1.0) 0.6979 (1.0) 0.6979 (1.0) 0.0000 (1.0) 0.6979 (1.0) 0.0000 (1.0) 0;0 1.4328 (1.0) 1 1
test_checkout_symlink-checkout-update[2.39.0] 0.8985 (1.29) 0.8985 (1.29) 0.8985 (1.29) 0.0000 (1.0) 0.8985 (1.29) 0.0000 (1.0) 0;0 1.1130 (0.78) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.7481 (1.07) 0.7481 (1.07) 0.7481 (1.07) 0.0000 (1.0) 0.7481 (1.07) 0.0000 (1.0) 0;0 1.3368 (0.93) 1 1
test_checkout_symlink-checkout-update[2.41.1] 0.7282 (1.04) 0.7282 (1.04) 0.7282 (1.04) 0.0000 (1.0) 0.7282 (1.04) 0.0000 (1.0) 0;0 1.3733 (0.96) 1 1
test_checkout_symlink-checkout-update[2.45.0] 0.7666 (1.10) 0.7666 (1.10) 0.7666 (1.10) 0.0000 (1.0) 0.7666 (1.10) 0.0000 (1.0) 0;0 1.3044 (0.91) 1 1
test_checkout_symlink-checkout-update[2.6.3] 3.2663 (4.68) 3.2663 (4.68) 3.2663 (4.68) 0.0000 (1.0) 3.2663 (4.68) 0.0000 (1.0) 0;0 0.3062 (0.21) 1 1
test_checkout_symlink-checkout-update[main] 0.8524 (1.22) 0.8524 (1.22) 0.8524 (1.22) 0.0000 (1.0) 0.8524 (1.22) 0.0000 (1.0) 0;0 1.1732 (0.82) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 446.6676 (1.0) 446.6676 (1.0) 446.6676 (1.0) 0.0000 (1.0) 446.6676 (1.0) 0.0000 (1.0) 0;0 2.2388 (1.0) 1 1
test_gc-gc[2.18.1] 452.4131 (1.01) 452.4131 (1.01) 452.4131 (1.01) 0.0000 (1.0) 452.4131 (1.01) 0.0000 (1.0) 0;0 2.2104 (0.99) 1 1
test_gc-gc[2.39.0] 487.2662 (1.09) 487.2662 (1.09) 487.2662 (1.09) 0.0000 (1.0) 487.2662 (1.09) 0.0000 (1.0) 0;0 2.0523 (0.92) 1 1
test_gc-gc[2.40.0] 495.4838 (1.11) 495.4838 (1.11) 495.4838 (1.11) 0.0000 (1.0) 495.4838 (1.11) 0.0000 (1.0) 0;0 2.0182 (0.90) 1 1
test_gc-gc[2.41.1] 488.3559 (1.09) 488.3559 (1.09) 488.3559 (1.09) 0.0000 (1.0) 488.3559 (1.09) 0.0000 (1.0) 0;0 2.0477 (0.91) 1 1
test_gc-gc[2.45.0] 476.6288 (1.07) 476.6288 (1.07) 476.6288 (1.07) 0.0000 (1.0) 476.6288 (1.07) 0.0000 (1.0) 0;0 2.0981 (0.94) 1 1
test_gc-gc[2.6.3] 501.3626 (1.12) 501.3626 (1.12) 501.3626 (1.12) 0.0000 (1.0) 501.3626 (1.12) 0.0000 (1.0) 0;0 1.9946 (0.89) 1 1
test_gc-gc[main] 553.9520 (1.24) 553.9520 (1.24) 553.9520 (1.24) 0.0000 (1.0) 553.9520 (1.24) 0.0000 (1.0) 0;0 1.8052 (0.81) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 3.9246 (1.73) 3.9246 (1.73) 3.9246 (1.73) 0.0000 (1.0) 3.9246 (1.73) 0.0000 (1.0) 0;0 0.2548 (0.58) 1 1
test_get_url-get-url[2.18.1] 3.5083 (1.55) 3.5083 (1.55) 3.5083 (1.55) 0.0000 (1.0) 3.5083 (1.55) 0.0000 (1.0) 0;0 0.2850 (0.65) 1 1
test_get_url-get-url[2.39.0] 3.9948 (1.76) 3.9948 (1.76) 3.9948 (1.76) 0.0000 (1.0) 3.9948 (1.76) 0.0000 (1.0) 0;0 0.2503 (0.57) 1 1
test_get_url-get-url[2.40.0] 4.0863 (1.80) 4.0863 (1.80) 4.0863 (1.80) 0.0000 (1.0) 4.0863 (1.80) 0.0000 (1.0) 0;0 0.2447 (0.55) 1 1
test_get_url-get-url[2.41.1] 3.9531 (1.74) 3.9531 (1.74) 3.9531 (1.74) 0.0000 (1.0) 3.9531 (1.74) 0.0000 (1.0) 0;0 0.2530 (0.57) 1 1
test_get_url-get-url[2.45.0] 3.9565 (1.75) 3.9565 (1.75) 3.9565 (1.75) 0.0000 (1.0) 3.9565 (1.75) 0.0000 (1.0) 0;0 0.2527 (0.57) 1 1
test_get_url-get-url[2.6.3] 2.2662 (1.0) 2.2662 (1.0) 2.2662 (1.0) 0.0000 (1.0) 2.2662 (1.0) 0.0000 (1.0) 0;0 0.4413 (1.0) 1 1
test_get_url-get-url[main] 3.7858 (1.67) 3.7858 (1.67) 3.7858 (1.67) 0.0000 (1.0) 3.7858 (1.67) 0.0000 (1.0) 0;0 0.2641 (0.60) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 8 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 10.0240 (1.44) 10.0240 (1.44) 10.0240 (1.44) 0.0000 (1.0) 10.0240 (1.44) 0.0000 (1.0) 0;0 0.0998 (0.70) 1 1
test_import_url-import-url[2.18.1] 9.2500 (1.33) 9.2500 (1.33) 9.2500 (1.33) 0.0000 (1.0) 9.2500 (1.33) 0.0000 (1.0) 0;0 0.1081 (0.75) 1 1
test_import_url-import-url[2.39.0] 9.1705 (1.31) 9.1705 (1.31) 9.1705 (1.31) 0.0000 (1.0) 9.1705 (1.31) 0.0000 (1.0) 0;0 0.1090 (0.76) 1 1
test_import_url-import-url[2.40.0] 9.0192 (1.29) 9.0192 (1.29) 9.0192 (1.29) 0.0000 (1.0) 9.0192 (1.29) 0.0000 (1.0) 0;0 0.1109 (0.77) 1 1
test_import_url-import-url[2.41.1] 8.9971 (1.29) 8.9971 (1.29) 8.9971 (1.29) 0.0000 (1.0) 8.9971 (1.29) 0.0000 (1.0) 0;0 0.1111 (0.78) 1 1
test_import_url-import-url[2.45.0] 7.0123 (1.01) 7.0123 (1.01) 7.0123 (1.01) 0.0000 (1.0) 7.0123 (1.01) 0.0000 (1.0) 0;0 0.1426 (0.99) 1 1
test_import_url-import-url[2.6.3] 10.7504 (1.54) 10.7504 (1.54) 10.7504 (1.54) 0.0000 (1.0) 10.7504 (1.54) 0.0000 (1.0) 0;0 0.0930 (0.65) 1 1
test_import_url-import-url[main] 6.9745 (1.0) 6.9745 (1.0) 6.9745 (1.0) 0.0000 (1.0) 6.9745 (1.0) 0.0000 (1.0) 0;0 0.1434 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 2.2534 (1.63) 2.2534 (1.63) 2.2534 (1.63) 0.0000 (1.0) 2.2534 (1.63) 0.0000 (1.0) 0;0 0.4438 (0.61) 1 1
test_status-status[2.18.1] 1.3825 (1.0) 1.3825 (1.0) 1.3825 (1.0) 0.0000 (1.0) 1.3825 (1.0) 0.0000 (1.0) 0;0 0.7233 (1.0) 1 1
test_status-status[2.39.0] 1.4268 (1.03) 1.4268 (1.03) 1.4268 (1.03) 0.0000 (1.0) 1.4268 (1.03) 0.0000 (1.0) 0;0 0.7009 (0.97) 1 1
test_status-status[2.40.0] 1.4068 (1.02) 1.4068 (1.02) 1.4068 (1.02) 0.0000 (1.0) 1.4068 (1.02) 0.0000 (1.0) 0;0 0.7108 (0.98) 1 1
test_status-status[2.41.1] 1.4170 (1.02) 1.4170 (1.02) 1.4170 (1.02) 0.0000 (1.0) 1.4170 (1.02) 0.0000 (1.0) 0;0 0.7057 (0.98) 1 1
test_status-status[2.45.0] 1.4065 (1.02) 1.4065 (1.02) 1.4065 (1.02) 0.0000 (1.0) 1.4065 (1.02) 0.0000 (1.0) 0;0 0.7110 (0.98) 1 1
test_status-status[2.6.3] 3.5881 (2.60) 3.5881 (2.60) 3.5881 (2.60) 0.0000 (1.0) 3.5881 (2.60) 0.0000 (1.0) 0;0 0.2787 (0.39) 1 1
test_status-status[main] 1.4477 (1.05) 1.4477 (1.05) 1.4477 (1.05) 0.0000 (1.0) 1.4477 (1.05) 0.0000 (1.0) 0;0 0.6907 (0.95) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 1.5817 (3.05) 1.5817 (3.05) 1.5817 (3.05) 0.0000 (1.0) 1.5817 (3.05) 0.0000 (1.0) 0;0 0.6322 (0.33) 1 1
test_status-status-changed[2.18.1] 0.5183 (1.0) 0.5183 (1.0) 0.5183 (1.0) 0.0000 (1.0) 0.5183 (1.0) 0.0000 (1.0) 0;0 1.9295 (1.0) 1 1
test_status-status-changed[2.39.0] 0.5541 (1.07) 0.5541 (1.07) 0.5541 (1.07) 0.0000 (1.0) 0.5541 (1.07) 0.0000 (1.0) 0;0 1.8048 (0.94) 1 1
test_status-status-changed[2.40.0] 0.6504 (1.25) 0.6504 (1.25) 0.6504 (1.25) 0.0000 (1.0) 0.6504 (1.25) 0.0000 (1.0) 0;0 1.5376 (0.80) 1 1
test_status-status-changed[2.41.1] 0.5550 (1.07) 0.5550 (1.07) 0.5550 (1.07) 0.0000 (1.0) 0.5550 (1.07) 0.0000 (1.0) 0;0 1.8017 (0.93) 1 1
test_status-status-changed[2.45.0] 0.5762 (1.11) 0.5762 (1.11) 0.5762 (1.11) 0.0000 (1.0) 0.5762 (1.11) 0.0000 (1.0) 0;0 1.7357 (0.90) 1 1
test_status-status-changed[2.6.3] 3.4461 (6.65) 3.4461 (6.65) 3.4461 (6.65) 0.0000 (1.0) 3.4461 (6.65) 0.0000 (1.0) 0;0 0.2902 (0.15) 1 1
test_status-status-changed[main] 0.6679 (1.29) 0.6679 (1.29) 0.6679 (1.29) 0.0000 (1.0) 0.6679 (1.29) 0.0000 (1.0) 0;0 1.4972 (0.78) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 8 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 675.5155 (1.31) 675.5155 (1.31) 675.5155 (1.31) 0.0000 (1.0) 675.5155 (1.31) 0.0000 (1.0) 0;0 1.4804 (0.76) 1 1
test_status-status-changed-noop[2.18.1] 516.1387 (1.0) 516.1387 (1.0) 516.1387 (1.0) 0.0000 (1.0) 516.1387 (1.0) 0.0000 (1.0) 0;0 1.9375 (1.0) 1 1
test_status-status-changed-noop[2.39.0] 546.2912 (1.06) 546.2912 (1.06) 546.2912 (1.06) 0.0000 (1.0) 546.2912 (1.06) 0.0000 (1.0) 0;0 1.8305 (0.94) 1 1
test_status-status-changed-noop[2.40.0] 672.8622 (1.30) 672.8622 (1.30) 672.8622 (1.30) 0.0000 (1.0) 672.8622 (1.30) 0.0000 (1.0) 0;0 1.4862 (0.77) 1 1
test_status-status-changed-noop[2.41.1] 553.5158 (1.07) 553.5158 (1.07) 553.5158 (1.07) 0.0000 (1.0) 553.5158 (1.07) 0.0000 (1.0) 0;0 1.8066 (0.93) 1 1
test_status-status-changed-noop[2.45.0] 576.7077 (1.12) 576.7077 (1.12) 576.7077 (1.12) 0.0000 (1.0) 576.7077 (1.12) 0.0000 (1.0) 0;0 1.7340 (0.89) 1 1
test_status-status-changed-noop[2.6.3] 2,646.3964 (5.13) 2,646.3964 (5.13) 2,646.3964 (5.13) 0.0000 (1.0) 2,646.3964 (5.13) 0.0000 (1.0) 0;0 0.3779 (0.20) 1 1
test_status-status-changed-noop[main] 652.1321 (1.26) 652.1321 (1.26) 652.1321 (1.26) 0.0000 (1.0) 652.1321 (1.26) 0.0000 (1.0) 0;0 1.5334 (0.79) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 444.3181 (1.06) 444.3181 (1.06) 444.3181 (1.06) 0.0000 (1.0) 444.3181 (1.06) 0.0000 (1.0) 0;0 2.2506 (0.94) 1 1
test_status-status-noop[2.18.1] 524.0519 (1.26) 524.0519 (1.26) 524.0519 (1.26) 0.0000 (1.0) 524.0519 (1.26) 0.0000 (1.0) 0;0 1.9082 (0.80) 1 1
test_status-status-noop[2.39.0] 555.5959 (1.33) 555.5959 (1.33) 555.5959 (1.33) 0.0000 (1.0) 555.5959 (1.33) 0.0000 (1.0) 0;0 1.7999 (0.75) 1 1
test_status-status-noop[2.40.0] 566.0116 (1.36) 566.0116 (1.36) 566.0116 (1.36) 0.0000 (1.0) 566.0116 (1.36) 0.0000 (1.0) 0;0 1.7667 (0.74) 1 1
test_status-status-noop[2.41.1] 553.0987 (1.33) 553.0987 (1.33) 553.0987 (1.33) 0.0000 (1.0) 553.0987 (1.33) 0.0000 (1.0) 0;0 1.8080 (0.75) 1 1
test_status-status-noop[2.45.0] 583.7667 (1.40) 583.7667 (1.40) 583.7667 (1.40) 0.0000 (1.0) 583.7667 (1.40) 0.0000 (1.0) 0;0 1.7130 (0.71) 1 1
test_status-status-noop[2.6.3] 417.2873 (1.0) 417.2873 (1.0) 417.2873 (1.0) 0.0000 (1.0) 417.2873 (1.0) 0.0000 (1.0) 0;0 2.3964 (1.0) 1 1
test_status-status-noop[main] 659.0839 (1.58) 659.0839 (1.58) 659.0839 (1.58) 0.0000 (1.0) 659.0839 (1.58) 0.0000 (1.0) 0;0 1.5173 (0.63) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_pull-pull': 8 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 9.5111 (1.29) 9.5111 (1.29) 9.5111 (1.29) 0.0000 (1.0) 9.5111 (1.29) 0.0000 (1.0) 0;0 0.1051 (0.78) 1 1
test_pull-pull[2.18.1] 9.0336 (1.22) 9.0336 (1.22) 9.0336 (1.22) 0.0000 (1.0) 9.0336 (1.22) 0.0000 (1.0) 0;0 0.1107 (0.82) 1 1
test_pull-pull[2.39.0] 10.9756 (1.49) 10.9756 (1.49) 10.9756 (1.49) 0.0000 (1.0) 10.9756 (1.49) 0.0000 (1.0) 0;0 0.0911 (0.67) 1 1
test_pull-pull[2.40.0] 10.5395 (1.43) 10.5395 (1.43) 10.5395 (1.43) 0.0000 (1.0) 10.5395 (1.43) 0.0000 (1.0) 0;0 0.0949 (0.70) 1 1
test_pull-pull[2.41.1] 10.7954 (1.46) 10.7954 (1.46) 10.7954 (1.46) 0.0000 (1.0) 10.7954 (1.46) 0.0000 (1.0) 0;0 0.0926 (0.68) 1 1
test_pull-pull[2.45.0] 8.6815 (1.18) 8.6815 (1.18) 8.6815 (1.18) 0.0000 (1.0) 8.6815 (1.18) 0.0000 (1.0) 0;0 0.1152 (0.85) 1 1
test_pull-pull[2.6.3] 7.3765 (1.0) 7.3765 (1.0) 7.3765 (1.0) 0.0000 (1.0) 7.3765 (1.0) 0.0000 (1.0) 0;0 0.1356 (1.0) 1 1
test_pull-pull[main] 8.8233 (1.20) 8.8233 (1.20) 8.8233 (1.20) 0.0000 (1.0) 8.8233 (1.20) 0.0000 (1.0) 0;0 0.1133 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add-add': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 7.1834 (1.84) 7.1834 (1.84) 7.1834 (1.84) 0.0000 (1.0) 7.1834 (1.84) 0.0000 (1.0) 0;0 0.1392 (0.54) 1 1
test_add-add[2.18.1] 6.6121 (1.69) 6.6121 (1.69) 6.6121 (1.69) 0.0000 (1.0) 6.6121 (1.69) 0.0000 (1.0) 0;0 0.1512 (0.59) 1 1
test_add-add[2.39.0] 6.0917 (1.56) 6.0917 (1.56) 6.0917 (1.56) 0.0000 (1.0) 6.0917 (1.56) 0.0000 (1.0) 0;0 0.1642 (0.64) 1 1
test_add-add[2.40.0] 6.1700 (1.58) 6.1700 (1.58) 6.1700 (1.58) 0.0000 (1.0) 6.1700 (1.58) 0.0000 (1.0) 0;0 0.1621 (0.63) 1 1
test_add-add[2.41.1] 5.9737 (1.53) 5.9737 (1.53) 5.9737 (1.53) 0.0000 (1.0) 5.9737 (1.53) 0.0000 (1.0) 0;0 0.1674 (0.66) 1 1
test_add-add[2.45.0] 3.9143 (1.0) 3.9143 (1.0) 3.9143 (1.0) 0.0000 (1.0) 3.9143 (1.0) 0.0000 (1.0) 0;0 0.2555 (1.0) 1 1
test_add-add[2.6.3] 8.2119 (2.10) 8.2119 (2.10) 8.2119 (2.10) 0.0000 (1.0) 8.2119 (2.10) 0.0000 (1.0) 0;0 0.1218 (0.48) 1 1
test_add-add[main] 3.9832 (1.02) 3.9832 (1.02) 3.9832 (1.02) 0.0000 (1.0) 3.9832 (1.02) 0.0000 (1.0) 0;0 0.2511 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_init-init': 8 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 326.6185 (1.07) 422.5165 (1.18) 335.6643 (1.07) 10.3027 (2.19) 333.4785 (1.07) 7.1562 (1.38) 5;3 2.9792 (0.94) 100 1
test_init-init[2.18.1] 335.1637 (1.10) 359.0911 (1.0) 342.4784 (1.09) 4.6990 (1.0) 341.5493 (1.09) 5.1689 (1.0) 27;4 2.9199 (0.92) 100 1
test_init-init[2.39.0] 388.6531 (1.27) 437.0877 (1.22) 402.3091 (1.28) 7.3217 (1.56) 401.3128 (1.29) 6.9107 (1.34) 25;5 2.4857 (0.78) 100 1
test_init-init[2.40.0] 389.6989 (1.28) 429.2913 (1.20) 405.1306 (1.29) 6.8100 (1.45) 404.0202 (1.29) 9.4038 (1.82) 32;1 2.4683 (0.78) 100 1
test_init-init[2.41.1] 389.6454 (1.28) 435.3612 (1.21) 403.4088 (1.28) 9.1381 (1.94) 401.2213 (1.29) 12.7579 (2.47) 29;2 2.4789 (0.78) 100 1
test_init-init[2.45.0] 391.7323 (1.28) 430.0002 (1.20) 406.4570 (1.29) 7.7888 (1.66) 406.0187 (1.30) 11.5238 (2.23) 35;1 2.4603 (0.77) 100 1
test_init-init[2.6.3] 304.9327 (1.0) 396.8547 (1.11) 314.3060 (1.0) 9.7914 (2.08) 312.0104 (1.0) 6.2458 (1.21) 5;4 3.1816 (1.0) 100 1
test_init-init[main] 469.8555 (1.54) 537.3436 (1.50) 482.5641 (1.54) 9.0835 (1.93) 479.7316 (1.54) 10.5445 (2.04) 20;1 2.0723 (0.65) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 5.9299 (1.26) 5.9299 (1.26) 5.9299 (1.26) 0.0000 (1.0) 5.9299 (1.26) 0.0000 (1.0) 0;0 0.1686 (0.79) 1 1
test_push-push[2.18.1] 5.7650 (1.22) 5.7650 (1.22) 5.7650 (1.22) 0.0000 (1.0) 5.7650 (1.22) 0.0000 (1.0) 0;0 0.1735 (0.82) 1 1
test_push-push[2.39.0] 7.2071 (1.53) 7.2071 (1.53) 7.2071 (1.53) 0.0000 (1.0) 7.2071 (1.53) 0.0000 (1.0) 0;0 0.1388 (0.65) 1 1
test_push-push[2.40.0] 6.9688 (1.48) 6.9688 (1.48) 6.9688 (1.48) 0.0000 (1.0) 6.9688 (1.48) 0.0000 (1.0) 0;0 0.1435 (0.68) 1 1
test_push-push[2.41.1] 7.5044 (1.59) 7.5044 (1.59) 7.5044 (1.59) 0.0000 (1.0) 7.5044 (1.59) 0.0000 (1.0) 0;0 0.1333 (0.63) 1 1
test_push-push[2.45.0] 4.7073 (1.0) 4.7073 (1.0) 4.7073 (1.0) 0.0000 (1.0) 4.7073 (1.0) 0.0000 (1.0) 0;0 0.2124 (1.0) 1 1
test_push-push[2.6.3] 4.7757 (1.01) 4.7757 (1.01) 4.7757 (1.01) 0.0000 (1.0) 4.7757 (1.01) 0.0000 (1.0) 0;0 0.2094 (0.99) 1 1
test_push-push[main] 5.1511 (1.09) 5.1511 (1.09) 5.1511 (1.09) 0.0000 (1.0) 5.1511 (1.09) 0.0000 (1.0) 0;0 0.1941 (0.91) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.2316 (1.48) 1.2316 (1.48) 1.2316 (1.48) 0.0000 (1.0) 1.2316 (1.48) 0.0000 (1.0) 0;0 0.8120 (0.68) 1 1
test_checkout_hardlink-checkout[2.18.1] 1.2136 (1.46) 1.2136 (1.46) 1.2136 (1.46) 0.0000 (1.0) 1.2136 (1.46) 0.0000 (1.0) 0;0 0.8240 (0.69) 1 1
test_checkout_hardlink-checkout[2.39.0] 1.2051 (1.45) 1.2051 (1.45) 1.2051 (1.45) 0.0000 (1.0) 1.2051 (1.45) 0.0000 (1.0) 0;0 0.8298 (0.69) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.2003 (1.44) 1.2003 (1.44) 1.2003 (1.44) 0.0000 (1.0) 1.2003 (1.44) 0.0000 (1.0) 0;0 0.8331 (0.69) 1 1
test_checkout_hardlink-checkout[2.41.1] 1.5384 (1.85) 1.5384 (1.85) 1.5384 (1.85) 0.0000 (1.0) 1.5384 (1.85) 0.0000 (1.0) 0;0 0.6500 (0.54) 1 1
test_checkout_hardlink-checkout[2.45.0] 1.5489 (1.86) 1.5489 (1.86) 1.5489 (1.86) 0.0000 (1.0) 1.5489 (1.86) 0.0000 (1.0) 0;0 0.6456 (0.54) 1 1
test_checkout_hardlink-checkout[2.6.3] 0.8335 (1.0) 0.8335 (1.0) 0.8335 (1.0) 0.0000 (1.0) 0.8335 (1.0) 0.0000 (1.0) 0;0 1.1997 (1.0) 1 1
test_checkout_hardlink-checkout[main] 1.5795 (1.89) 1.5795 (1.89) 1.5795 (1.89) 0.0000 (1.0) 1.5795 (1.89) 0.0000 (1.0) 0;0 0.6331 (0.53) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 480.6771 (1.27) 480.6771 (1.27) 480.6771 (1.27) 0.0000 (1.0) 480.6771 (1.27) 0.0000 (1.0) 0;0 2.0804 (0.79) 1 1
test_checkout_hardlink-checkout-noop[2.18.1] 548.5936 (1.45) 548.5936 (1.45) 548.5936 (1.45) 0.0000 (1.0) 548.5936 (1.45) 0.0000 (1.0) 0;0 1.8228 (0.69) 1 1
test_checkout_hardlink-checkout-noop[2.39.0] 568.1179 (1.50) 568.1179 (1.50) 568.1179 (1.50) 0.0000 (1.0) 568.1179 (1.50) 0.0000 (1.0) 0;0 1.7602 (0.67) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 569.0336 (1.50) 569.0336 (1.50) 569.0336 (1.50) 0.0000 (1.0) 569.0336 (1.50) 0.0000 (1.0) 0;0 1.7574 (0.67) 1 1
test_checkout_hardlink-checkout-noop[2.41.1] 575.3746 (1.52) 575.3746 (1.52) 575.3746 (1.52) 0.0000 (1.0) 575.3746 (1.52) 0.0000 (1.0) 0;0 1.7380 (0.66) 1 1
test_checkout_hardlink-checkout-noop[2.45.0] 596.1192 (1.57) 596.1192 (1.57) 596.1192 (1.57) 0.0000 (1.0) 596.1192 (1.57) 0.0000 (1.0) 0;0 1.6775 (0.64) 1 1
test_checkout_hardlink-checkout-noop[2.6.3] 378.6662 (1.0) 378.6662 (1.0) 378.6662 (1.0) 0.0000 (1.0) 378.6662 (1.0) 0.0000 (1.0) 0;0 2.6408 (1.0) 1 1
test_checkout_hardlink-checkout-noop[main] 660.4695 (1.74) 660.4695 (1.74) 660.4695 (1.74) 0.0000 (1.0) 660.4695 (1.74) 0.0000 (1.0) 0;0 1.5141 (0.57) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.2423 (1.98) 1.2423 (1.98) 1.2423 (1.98) 0.0000 (1.0) 1.2423 (1.98) 0.0000 (1.0) 0;0 0.8050 (0.51) 1 1
test_checkout_hardlink-checkout-update[2.18.1] 0.6290 (1.0) 0.6290 (1.0) 0.6290 (1.0) 0.0000 (1.0) 0.6290 (1.0) 0.0000 (1.0) 0;0 1.5899 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.39.0] 0.6418 (1.02) 0.6418 (1.02) 0.6418 (1.02) 0.0000 (1.0) 0.6418 (1.02) 0.0000 (1.0) 0;0 1.5580 (0.98) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.8390 (1.33) 0.8390 (1.33) 0.8390 (1.33) 0.0000 (1.0) 0.8390 (1.33) 0.0000 (1.0) 0;0 1.1920 (0.75) 1 1
test_checkout_hardlink-checkout-update[2.41.1] 0.6375 (1.01) 0.6375 (1.01) 0.6375 (1.01) 0.0000 (1.0) 0.6375 (1.01) 0.0000 (1.0) 0;0 1.5685 (0.99) 1 1
test_checkout_hardlink-checkout-update[2.45.0] 0.6627 (1.05) 0.6627 (1.05) 0.6627 (1.05) 0.0000 (1.0) 0.6627 (1.05) 0.0000 (1.0) 0;0 1.5089 (0.95) 1 1
test_checkout_hardlink-checkout-update[2.6.3] 3.0744 (4.89) 3.0744 (4.89) 3.0744 (4.89) 0.0000 (1.0) 3.0744 (4.89) 0.0000 (1.0) 0;0 0.3253 (0.20) 1 1
test_checkout_hardlink-checkout-update[main] 0.7281 (1.16) 0.7281 (1.16) 0.7281 (1.16) 0.0000 (1.0) 0.7281 (1.16) 0.0000 (1.0) 0;0 1.3733 (0.86) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_update-update': 8 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 9.4605 (1.27) 9.4605 (1.27) 9.4605 (1.27) 0.0000 (1.0) 9.4605 (1.27) 0.0000 (1.0) 0;0 0.1057 (0.79) 1 1
test_update-update[2.18.1] 8.4532 (1.13) 8.4532 (1.13) 8.4532 (1.13) 0.0000 (1.0) 8.4532 (1.13) 0.0000 (1.0) 0;0 0.1183 (0.88) 1 1
test_update-update[2.39.0] 7.5385 (1.01) 7.5385 (1.01) 7.5385 (1.01) 0.0000 (1.0) 7.5385 (1.01) 0.0000 (1.0) 0;0 0.1327 (0.99) 1 1
test_update-update[2.40.0] 7.6117 (1.02) 7.6117 (1.02) 7.6117 (1.02) 0.0000 (1.0) 7.6117 (1.02) 0.0000 (1.0) 0;0 0.1314 (0.98) 1 1
test_update-update[2.41.1] 7.4727 (1.0) 7.4727 (1.0) 7.4727 (1.0) 0.0000 (1.0) 7.4727 (1.0) 0.0000 (1.0) 0;0 0.1338 (1.0) 1 1
test_update-update[2.45.0] 7.6350 (1.02) 7.6350 (1.02) 7.6350 (1.02) 0.0000 (1.0) 7.6350 (1.02) 0.0000 (1.0) 0;0 0.1310 (0.98) 1 1
test_update-update[2.6.3] 10.1538 (1.36) 10.1538 (1.36) 10.1538 (1.36) 0.0000 (1.0) 10.1538 (1.36) 0.0000 (1.0) 0;0 0.0985 (0.74) 1 1
test_update-update[main] 7.7693 (1.04) 7.7693 (1.04) 7.7693 (1.04) 0.0000 (1.0) 7.7693 (1.04) 0.0000 (1.0) 0;0 0.1287 (0.96) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 8 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 517.8688 (1.0) 517.8688 (1.0) 517.8688 (1.0) 0.0000 (1.0) 517.8688 (1.0) 0.0000 (1.0) 0;0 1.9310 (1.0) 1 1
test_update-update-noop[2.18.1] 672.7302 (1.30) 672.7302 (1.30) 672.7302 (1.30) 0.0000 (1.0) 672.7302 (1.30) 0.0000 (1.0) 0;0 1.4865 (0.77) 1 1
test_update-update-noop[2.39.0] 973.8000 (1.88) 973.8000 (1.88) 973.8000 (1.88) 0.0000 (1.0) 973.8000 (1.88) 0.0000 (1.0) 0;0 1.0269 (0.53) 1 1
test_update-update-noop[2.40.0] 972.8309 (1.88) 972.8309 (1.88) 972.8309 (1.88) 0.0000 (1.0) 972.8309 (1.88) 0.0000 (1.0) 0;0 1.0279 (0.53) 1 1
test_update-update-noop[2.41.1] 971.8176 (1.88) 971.8176 (1.88) 971.8176 (1.88) 0.0000 (1.0) 971.8176 (1.88) 0.0000 (1.0) 0;0 1.0290 (0.53) 1 1
test_update-update-noop[2.45.0] 1,070.6748 (2.07) 1,070.6748 (2.07) 1,070.6748 (2.07) 0.0000 (1.0) 1,070.6748 (2.07) 0.0000 (1.0) 0;0 0.9340 (0.48) 1 1
test_update-update-noop[2.6.3] 526.0147 (1.02) 526.0147 (1.02) 526.0147 (1.02) 0.0000 (1.0) 526.0147 (1.02) 0.0000 (1.0) 0;0 1.9011 (0.98) 1 1
test_update-update-noop[main] 1,159.3840 (2.24) 1,159.3840 (2.24) 1,159.3840 (2.24) 0.0000 (1.0) 1,159.3840 (2.24) 0.0000 (1.0) 0;0 0.8625 (0.45) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.18.1] 632.5921 (1.01) 632.5921 (1.01) 632.5921 (1.01) 0.0000 (1.0) 632.5921 (1.01) 0.0000 (1.0) 0;0 1.5808 (0.99) 1 1
test_data_status-data-changed[2.39.0] 664.2601 (1.06) 664.2601 (1.06) 664.2601 (1.06) 0.0000 (1.0) 664.2601 (1.06) 0.0000 (1.0) 0;0 1.5054 (0.94) 1 1
test_data_status-data-changed[2.40.0] 666.8353 (1.07) 666.8353 (1.07) 666.8353 (1.07) 0.0000 (1.0) 666.8353 (1.07) 0.0000 (1.0) 0;0 1.4996 (0.94) 1 1
test_data_status-data-changed[2.41.1] 661.6519 (1.06) 661.6519 (1.06) 661.6519 (1.06) 0.0000 (1.0) 661.6519 (1.06) 0.0000 (1.0) 0;0 1.5114 (0.95) 1 1
test_data_status-data-changed[2.45.0] 626.0595 (1.0) 626.0595 (1.0) 626.0595 (1.0) 0.0000 (1.0) 626.0595 (1.0) 0.0000 (1.0) 0;0 1.5973 (1.0) 1 1
test_data_status-data-changed[main] 684.9018 (1.09) 684.9018 (1.09) 684.9018 (1.09) 0.0000 (1.0) 684.9018 (1.09) 0.0000 (1.0) 0;0 1.4601 (0.91) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.18.1] 642.9257 (1.03) 642.9257 (1.03) 642.9257 (1.03) 0.0000 (1.0) 642.9257 (1.03) 0.0000 (1.0) 0;0 1.5554 (0.97) 1 1
test_data_status-data-changed-noop[2.39.0] 666.0281 (1.07) 666.0281 (1.07) 666.0281 (1.07) 0.0000 (1.0) 666.0281 (1.07) 0.0000 (1.0) 0;0 1.5014 (0.94) 1 1
test_data_status-data-changed-noop[2.40.0] 662.5722 (1.06) 662.5722 (1.06) 662.5722 (1.06) 0.0000 (1.0) 662.5722 (1.06) 0.0000 (1.0) 0;0 1.5093 (0.94) 1 1
test_data_status-data-changed-noop[2.41.1] 664.1895 (1.06) 664.1895 (1.06) 664.1895 (1.06) 0.0000 (1.0) 664.1895 (1.06) 0.0000 (1.0) 0;0 1.5056 (0.94) 1 1
test_data_status-data-changed-noop[2.45.0] 623.7532 (1.0) 623.7532 (1.0) 623.7532 (1.0) 0.0000 (1.0) 623.7532 (1.0) 0.0000 (1.0) 0;0 1.6032 (1.0) 1 1
test_data_status-data-changed-noop[main] 682.3583 (1.09) 682.3583 (1.09) 682.3583 (1.09) 0.0000 (1.0) 682.3583 (1.09) 0.0000 (1.0) 0;0 1.4655 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.18.1] 2.0731 (1.58) 2.0731 (1.58) 2.0731 (1.58) 0.0000 (1.0) 2.0731 (1.58) 0.0000 (1.0) 0;0 0.4824 (0.63) 1 1
test_data_status-data-new[2.39.0] 1.4145 (1.08) 1.4145 (1.08) 1.4145 (1.08) 0.0000 (1.0) 1.4145 (1.08) 0.0000 (1.0) 0;0 0.7070 (0.93) 1 1
test_data_status-data-new[2.40.0] 1.5009 (1.14) 1.5009 (1.14) 1.5009 (1.14) 0.0000 (1.0) 1.5009 (1.14) 0.0000 (1.0) 0;0 0.6663 (0.88) 1 1
test_data_status-data-new[2.41.1] 2.0284 (1.54) 2.0284 (1.54) 2.0284 (1.54) 0.0000 (1.0) 2.0284 (1.54) 0.0000 (1.0) 0;0 0.4930 (0.65) 1 1
test_data_status-data-new[2.45.0] 1.3156 (1.0) 1.3156 (1.0) 1.3156 (1.0) 0.0000 (1.0) 1.3156 (1.0) 0.0000 (1.0) 0;0 0.7601 (1.0) 1 1
test_data_status-data-new[main] 1.3703 (1.04) 1.3703 (1.04) 1.3703 (1.04) 0.0000 (1.0) 1.3703 (1.04) 0.0000 (1.0) 0;0 0.7298 (0.96) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.18.1] 625.8585 (1.01) 625.8585 (1.01) 625.8585 (1.01) 0.0000 (1.0) 625.8585 (1.01) 0.0000 (1.0) 0;0 1.5978 (0.99) 1 1
test_data_status-data-noop[2.39.0] 653.5403 (1.05) 653.5403 (1.05) 653.5403 (1.05) 0.0000 (1.0) 653.5403 (1.05) 0.0000 (1.0) 0;0 1.5301 (0.95) 1 1
test_data_status-data-noop[2.40.0] 653.2918 (1.05) 653.2918 (1.05) 653.2918 (1.05) 0.0000 (1.0) 653.2918 (1.05) 0.0000 (1.0) 0;0 1.5307 (0.95) 1 1
test_data_status-data-noop[2.41.1] 651.0699 (1.05) 651.0699 (1.05) 651.0699 (1.05) 0.0000 (1.0) 651.0699 (1.05) 0.0000 (1.0) 0;0 1.5359 (0.95) 1 1
test_data_status-data-noop[2.45.0] 621.7625 (1.0) 621.7625 (1.0) 621.7625 (1.0) 0.0000 (1.0) 621.7625 (1.0) 0.0000 (1.0) 0;0 1.6083 (1.0) 1 1
test_data_status-data-noop[main] 679.3202 (1.09) 679.3202 (1.09) 679.3202 (1.09) 0.0000 (1.0) 679.3202 (1.09) 0.0000 (1.0) 0;0 1.4721 (0.92) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.11.0] 3.6394 (1.09) 3.6394 (1.09) 3.6394 (1.09) 0.0000 (1.0) 3.6394 (1.09) 0.0000 (1.0) 0;0 0.2748 (0.91) 1 1
test_exp_show-exp[2.18.1] 3.7087 (1.12) 3.7087 (1.12) 3.7087 (1.12) 0.0000 (1.0) 3.7087 (1.12) 0.0000 (1.0) 0;0 0.2696 (0.90) 1 1
test_exp_show-exp[2.39.0] 3.3244 (1.0) 3.3244 (1.0) 3.3244 (1.0) 0.0000 (1.0) 3.3244 (1.0) 0.0000 (1.0) 0;0 0.3008 (1.0) 1 1
test_exp_show-exp[2.40.0] 3.3845 (1.02) 3.3845 (1.02) 3.3845 (1.02) 0.0000 (1.0) 3.3845 (1.02) 0.0000 (1.0) 0;0 0.2955 (0.98) 1 1
test_exp_show-exp[2.41.1] 3.3270 (1.00) 3.3270 (1.00) 3.3270 (1.00) 0.0000 (1.0) 3.3270 (1.00) 0.0000 (1.0) 0;0 0.3006 (1.00) 1 1
test_exp_show-exp[2.45.0] 3.4754 (1.05) 3.4754 (1.05) 3.4754 (1.05) 0.0000 (1.0) 3.4754 (1.05) 0.0000 (1.0) 0;0 0.2877 (0.96) 1 1
test_exp_show-exp[main] 6.2551 (1.88) 6.2551 (1.88) 6.2551 (1.88) 0.0000 (1.0) 6.2551 (1.88) 0.0000 (1.0) 0;0 0.1599 (0.53) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 402.7509 (1.11) 402.7509 (1.11) 402.7509 (1.11) 0.0000 (1.0) 402.7509 (1.11) 0.0000 (1.0) 0;0 2.4829 (0.90) 1 1
test_list-list[2.18.1] 363.9493 (1.0) 363.9493 (1.0) 363.9493 (1.0) 0.0000 (1.0) 363.9493 (1.0) 0.0000 (1.0) 0;0 2.7476 (1.0) 1 1
test_list-list[2.39.0] 395.3846 (1.09) 395.3846 (1.09) 395.3846 (1.09) 0.0000 (1.0) 395.3846 (1.09) 0.0000 (1.0) 0;0 2.5292 (0.92) 1 1
test_list-list[2.40.0] 392.9476 (1.08) 392.9476 (1.08) 392.9476 (1.08) 0.0000 (1.0) 392.9476 (1.08) 0.0000 (1.0) 0;0 2.5449 (0.93) 1 1
test_list-list[2.41.1] 526.6073 (1.45) 526.6073 (1.45) 526.6073 (1.45) 0.0000 (1.0) 526.6073 (1.45) 0.0000 (1.0) 0;0 1.8989 (0.69) 1 1
test_list-list[2.45.0] 405.3026 (1.11) 405.3026 (1.11) 405.3026 (1.11) 0.0000 (1.0) 405.3026 (1.11) 0.0000 (1.0) 0;0 2.4673 (0.90) 1 1
test_list-list[2.6.3] 496.3525 (1.36) 496.3525 (1.36) 496.3525 (1.36) 0.0000 (1.0) 496.3525 (1.36) 0.0000 (1.0) 0;0 2.0147 (0.73) 1 1
test_list-list[main] 483.9148 (1.33) 483.9148 (1.33) 483.9148 (1.33) 0.0000 (1.0) 483.9148 (1.33) 0.0000 (1.0) 0;0 2.0665 (0.75) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 399.9045 (1.13) 399.9045 (1.13) 399.9045 (1.13) 0.0000 (1.0) 399.9045 (1.13) 0.0000 (1.0) 0;0 2.5006 (0.89) 1 1
test_list-list-dvc-only[2.18.1] 354.7450 (1.0) 354.7450 (1.0) 354.7450 (1.0) 0.0000 (1.0) 354.7450 (1.0) 0.0000 (1.0) 0;0 2.8189 (1.0) 1 1
test_list-list-dvc-only[2.39.0] 386.8800 (1.09) 386.8800 (1.09) 386.8800 (1.09) 0.0000 (1.0) 386.8800 (1.09) 0.0000 (1.0) 0;0 2.5848 (0.92) 1 1
test_list-list-dvc-only[2.40.0] 381.8918 (1.08) 381.8918 (1.08) 381.8918 (1.08) 0.0000 (1.0) 381.8918 (1.08) 0.0000 (1.0) 0;0 2.6185 (0.93) 1 1
test_list-list-dvc-only[2.41.1] 382.8605 (1.08) 382.8605 (1.08) 382.8605 (1.08) 0.0000 (1.0) 382.8605 (1.08) 0.0000 (1.0) 0;0 2.6119 (0.93) 1 1
test_list-list-dvc-only[2.45.0] 394.8504 (1.11) 394.8504 (1.11) 394.8504 (1.11) 0.0000 (1.0) 394.8504 (1.11) 0.0000 (1.0) 0;0 2.5326 (0.90) 1 1
test_list-list-dvc-only[2.6.3] 419.7845 (1.18) 419.7845 (1.18) 419.7845 (1.18) 0.0000 (1.0) 419.7845 (1.18) 0.0000 (1.0) 0;0 2.3822 (0.85) 1 1
test_list-list-dvc-only[main] 478.9243 (1.35) 478.9243 (1.35) 478.9243 (1.35) 0.0000 (1.0) 478.9243 (1.35) 0.0000 (1.0) 0;0 2.0880 (0.74) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.6623 (3.71) 1.6623 (3.71) 1.6623 (3.71) 0.0000 (1.0) 1.6623 (3.71) 0.0000 (1.0) 0;0 0.6016 (0.27) 1 1
test_list-list-recursive[2.18.1] 2.3563 (5.25) 2.3563 (5.25) 2.3563 (5.25) 0.0000 (1.0) 2.3563 (5.25) 0.0000 (1.0) 0;0 0.4244 (0.19) 1 1
test_list-list-recursive[2.39.0] 0.7621 (1.70) 0.7621 (1.70) 0.7621 (1.70) 0.0000 (1.0) 0.7621 (1.70) 0.0000 (1.0) 0;0 1.3121 (0.59) 1 1
test_list-list-recursive[2.40.0] 0.4486 (1.0) 0.4486 (1.0) 0.4486 (1.0) 0.0000 (1.0) 0.4486 (1.0) 0.0000 (1.0) 0;0 2.2292 (1.0) 1 1
test_list-list-recursive[2.41.1] 0.4488 (1.00) 0.4488 (1.00) 0.4488 (1.00) 0.0000 (1.0) 0.4488 (1.00) 0.0000 (1.0) 0;0 2.2283 (1.00) 1 1
test_list-list-recursive[2.45.0] 0.4569 (1.02) 0.4569 (1.02) 0.4569 (1.02) 0.0000 (1.0) 0.4569 (1.02) 0.0000 (1.0) 0;0 2.1888 (0.98) 1 1
test_list-list-recursive[2.6.3] 0.9827 (2.19) 0.9827 (2.19) 0.9827 (2.19) 0.0000 (1.0) 0.9827 (2.19) 0.0000 (1.0) 0;0 1.0176 (0.46) 1 1
test_list-list-recursive[main] 0.5735 (1.28) 0.5735 (1.28) 0.5735 (1.28) 0.0000 (1.0) 0.5735 (1.28) 0.0000 (1.0) 0;0 1.7438 (0.78) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 393.3161 (1.03) 393.3161 (1.03) 393.3161 (1.03) 0.0000 (1.0) 393.3161 (1.03) 0.0000 (1.0) 0;0 2.5425 (0.97) 1 1
test_list-list-shallow[2.18.1] 380.5262 (1.0) 380.5262 (1.0) 380.5262 (1.0) 0.0000 (1.0) 380.5262 (1.0) 0.0000 (1.0) 0;0 2.6279 (1.0) 1 1
test_list-list-shallow[2.39.0] 412.0092 (1.08) 412.0092 (1.08) 412.0092 (1.08) 0.0000 (1.0) 412.0092 (1.08) 0.0000 (1.0) 0;0 2.4271 (0.92) 1 1
test_list-list-shallow[2.40.0] 410.4512 (1.08) 410.4512 (1.08) 410.4512 (1.08) 0.0000 (1.0) 410.4512 (1.08) 0.0000 (1.0) 0;0 2.4363 (0.93) 1 1
test_list-list-shallow[2.41.1] 410.1398 (1.08) 410.1398 (1.08) 410.1398 (1.08) 0.0000 (1.0) 410.1398 (1.08) 0.0000 (1.0) 0;0 2.4382 (0.93) 1 1
test_list-list-shallow[2.45.0] 426.0363 (1.12) 426.0363 (1.12) 426.0363 (1.12) 0.0000 (1.0) 426.0363 (1.12) 0.0000 (1.0) 0;0 2.3472 (0.89) 1 1
test_list-list-shallow[2.6.3] 434.7696 (1.14) 434.7696 (1.14) 434.7696 (1.14) 0.0000 (1.0) 434.7696 (1.14) 0.0000 (1.0) 0;0 2.3001 (0.88) 1 1
test_list-list-shallow[main] 475.8532 (1.25) 475.8532 (1.25) 475.8532 (1.25) 0.0000 (1.0) 475.8532 (1.25) 0.0000 (1.0) 0;0 2.1015 (0.80) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 144.2699 (1.0) 150.7884 (1.0) 146.2327 (1.0) 0.9983 (1.0) 146.1626 (1.0) 1.1973 (1.0) 31;1 6.8384 (1.0) 100 1
test_help---help[2.18.1] 149.0164 (1.03) 154.3149 (1.02) 151.7777 (1.04) 1.0805 (1.08) 151.6694 (1.04) 1.4223 (1.19) 31;0 6.5886 (0.96) 100 1
test_help---help[2.39.0] 188.2895 (1.31) 195.3616 (1.30) 191.4985 (1.31) 1.6569 (1.66) 191.6188 (1.31) 2.4362 (2.03) 30;0 5.2220 (0.76) 100 1
test_help---help[2.40.0] 186.3749 (1.29) 197.8855 (1.31) 190.1850 (1.30) 1.9529 (1.96) 190.1909 (1.30) 2.5582 (2.14) 30;1 5.2580 (0.77) 100 1
test_help---help[2.41.1] 187.4951 (1.30) 200.5814 (1.33) 191.8611 (1.31) 2.2821 (2.29) 191.7900 (1.31) 2.8711 (2.40) 32;2 5.2121 (0.76) 100 1
test_help---help[2.45.0] 150.5482 (1.04) 170.2068 (1.13) 153.3353 (1.05) 2.1620 (2.17) 153.0561 (1.05) 1.7125 (1.43) 12;2 6.5217 (0.95) 100 1
test_help---help[2.6.3] 187.8054 (1.30) 209.9390 (1.39) 194.3477 (1.33) 2.6401 (2.64) 193.9897 (1.33) 2.3921 (2.00) 16;4 5.1454 (0.75) 100 1
test_help---help[main] 148.1872 (1.03) 157.6324 (1.05) 151.0606 (1.03) 1.3379 (1.34) 151.1602 (1.03) 1.6600 (1.39) 29;1 6.6199 (0.97) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 1.6275 (1.23) 1.6275 (1.23) 1.6275 (1.23) 0.0000 (1.0) 1.6275 (1.23) 0.0000 (1.0) 0;0 0.6144 (0.82) 1 1
test_diff-diff[2.18.1] 1.3276 (1.0) 1.3276 (1.0) 1.3276 (1.0) 0.0000 (1.0) 1.3276 (1.0) 0.0000 (1.0) 0;0 0.7532 (1.0) 1 1
test_diff-diff[2.39.0] 1.3679 (1.03) 1.3679 (1.03) 1.3679 (1.03) 0.0000 (1.0) 1.3679 (1.03) 0.0000 (1.0) 0;0 0.7311 (0.97) 1 1
test_diff-diff[2.40.0] 1.3694 (1.03) 1.3694 (1.03) 1.3694 (1.03) 0.0000 (1.0) 1.3694 (1.03) 0.0000 (1.0) 0;0 0.7303 (0.97) 1 1
test_diff-diff[2.41.1] 1.3752 (1.04) 1.3752 (1.04) 1.3752 (1.04) 0.0000 (1.0) 1.3752 (1.04) 0.0000 (1.0) 0;0 0.7271 (0.97) 1 1
test_diff-diff[2.45.0] 1.3591 (1.02) 1.3591 (1.02) 1.3591 (1.02) 0.0000 (1.0) 1.3591 (1.02) 0.0000 (1.0) 0;0 0.7358 (0.98) 1 1
test_diff-diff[2.6.3] 3.0781 (2.32) 3.0781 (2.32) 3.0781 (2.32) 0.0000 (1.0) 3.0781 (2.32) 0.0000 (1.0) 0;0 0.3249 (0.43) 1 1
test_diff-diff[main] 1.3472 (1.01) 1.3472 (1.01) 1.3472 (1.01) 0.0000 (1.0) 1.3472 (1.01) 0.0000 (1.0) 0;0 0.7423 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.0871 (1.72) 1.0871 (1.72) 1.0871 (1.72) 0.0000 (1.0) 1.0871 (1.72) 0.0000 (1.0) 0;0 0.9199 (0.58) 1 1
test_diff-diff-changed[2.18.1] 0.6303 (1.0) 0.6303 (1.0) 0.6303 (1.0) 0.0000 (1.0) 0.6303 (1.0) 0.0000 (1.0) 0;0 1.5867 (1.0) 1 1
test_diff-diff-changed[2.39.0] 0.6530 (1.04) 0.6530 (1.04) 0.6530 (1.04) 0.0000 (1.0) 0.6530 (1.04) 0.0000 (1.0) 0;0 1.5315 (0.97) 1 1
test_diff-diff-changed[2.40.0] 0.6545 (1.04) 0.6545 (1.04) 0.6545 (1.04) 0.0000 (1.0) 0.6545 (1.04) 0.0000 (1.0) 0;0 1.5278 (0.96) 1 1
test_diff-diff-changed[2.41.1] 0.6598 (1.05) 0.6598 (1.05) 0.6598 (1.05) 0.0000 (1.0) 0.6598 (1.05) 0.0000 (1.0) 0;0 1.5157 (0.96) 1 1
test_diff-diff-changed[2.45.0] 0.6724 (1.07) 0.6724 (1.07) 0.6724 (1.07) 0.0000 (1.0) 0.6724 (1.07) 0.0000 (1.0) 0;0 1.4872 (0.94) 1 1
test_diff-diff-changed[2.6.3] 3.1096 (4.93) 3.1096 (4.93) 3.1096 (4.93) 0.0000 (1.0) 3.1096 (4.93) 0.0000 (1.0) 0;0 0.3216 (0.20) 1 1
test_diff-diff-changed[main] 0.7554 (1.20) 0.7554 (1.20) 0.7554 (1.20) 0.0000 (1.0) 0.7554 (1.20) 0.0000 (1.0) 0;0 1.3238 (0.83) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 8 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 486.4460 (1.0) 486.4460 (1.0) 486.4460 (1.0) 0.0000 (1.0) 486.4460 (1.0) 0.0000 (1.0) 0;0 2.0557 (1.0) 1 1
test_diff-diff-changed-noop[2.18.1] 632.7889 (1.30) 632.7889 (1.30) 632.7889 (1.30) 0.0000 (1.0) 632.7889 (1.30) 0.0000 (1.0) 0;0 1.5803 (0.77) 1 1
test_diff-diff-changed-noop[2.39.0] 652.6838 (1.34) 652.6838 (1.34) 652.6838 (1.34) 0.0000 (1.0) 652.6838 (1.34) 0.0000 (1.0) 0;0 1.5321 (0.75) 1 1
test_diff-diff-changed-noop[2.40.0] 653.9803 (1.34) 653.9803 (1.34) 653.9803 (1.34) 0.0000 (1.0) 653.9803 (1.34) 0.0000 (1.0) 0;0 1.5291 (0.74) 1 1
test_diff-diff-changed-noop[2.41.1] 653.6538 (1.34) 653.6538 (1.34) 653.6538 (1.34) 0.0000 (1.0) 653.6538 (1.34) 0.0000 (1.0) 0;0 1.5299 (0.74) 1 1
test_diff-diff-changed-noop[2.45.0] 684.6322 (1.41) 684.6322 (1.41) 684.6322 (1.41) 0.0000 (1.0) 684.6322 (1.41) 0.0000 (1.0) 0;0 1.4606 (0.71) 1 1
test_diff-diff-changed-noop[2.6.3] 2,319.1824 (4.77) 2,319.1824 (4.77) 2,319.1824 (4.77) 0.0000 (1.0) 2,319.1824 (4.77) 0.0000 (1.0) 0;0 0.4312 (0.21) 1 1
test_diff-diff-changed-noop[main] 715.4131 (1.47) 715.4131 (1.47) 715.4131 (1.47) 0.0000 (1.0) 715.4131 (1.47) 0.0000 (1.0) 0;0 1.3978 (0.68) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 8 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 451.8198 (1.0) 451.8198 (1.0) 451.8198 (1.0) 0.0000 (1.0) 451.8198 (1.0) 0.0000 (1.0) 0;0 2.2133 (1.0) 1 1
test_diff-diff-noop[2.18.1] 584.5131 (1.29) 584.5131 (1.29) 584.5131 (1.29) 0.0000 (1.0) 584.5131 (1.29) 0.0000 (1.0) 0;0 1.7108 (0.77) 1 1
test_diff-diff-noop[2.39.0] 621.2804 (1.38) 621.2804 (1.38) 621.2804 (1.38) 0.0000 (1.0) 621.2804 (1.38) 0.0000 (1.0) 0;0 1.6096 (0.73) 1 1
test_diff-diff-noop[2.40.0] 619.5144 (1.37) 619.5144 (1.37) 619.5144 (1.37) 0.0000 (1.0) 619.5144 (1.37) 0.0000 (1.0) 0;0 1.6142 (0.73) 1 1
test_diff-diff-noop[2.41.1] 624.3198 (1.38) 624.3198 (1.38) 624.3198 (1.38) 0.0000 (1.0) 624.3198 (1.38) 0.0000 (1.0) 0;0 1.6017 (0.72) 1 1
test_diff-diff-noop[2.45.0] 638.4945 (1.41) 638.4945 (1.41) 638.4945 (1.41) 0.0000 (1.0) 638.4945 (1.41) 0.0000 (1.0) 0;0 1.5662 (0.71) 1 1
test_diff-diff-noop[2.6.3] 1,741.4831 (3.85) 1,741.4831 (3.85) 1,741.4831 (3.85) 0.0000 (1.0) 1,741.4831 (3.85) 0.0000 (1.0) 0;0 0.5742 (0.26) 1 1
test_diff-diff-noop[main] 671.4705 (1.49) 671.4705 (1.49) 671.4705 (1.49) 0.0000 (1.0) 671.4705 (1.49) 0.0000 (1.0) 0;0 1.4893 (0.67) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 3.8266 (1.27) 3.8266 (1.27) 3.8266 (1.27) 0.0000 (1.0) 3.8266 (1.27) 0.0000 (1.0) 0;0 0.2613 (0.79) 1 1
test_checkout_copy-checkout[2.18.1] 3.8030 (1.26) 3.8030 (1.26) 3.8030 (1.26) 0.0000 (1.0) 3.8030 (1.26) 0.0000 (1.0) 0;0 0.2630 (0.80) 1 1
test_checkout_copy-checkout[2.39.0] 3.8739 (1.28) 3.8739 (1.28) 3.8739 (1.28) 0.0000 (1.0) 3.8739 (1.28) 0.0000 (1.0) 0;0 0.2581 (0.78) 1 1
test_checkout_copy-checkout[2.40.0] 3.8535 (1.27) 3.8535 (1.27) 3.8535 (1.27) 0.0000 (1.0) 3.8535 (1.27) 0.0000 (1.0) 0;0 0.2595 (0.78) 1 1
test_checkout_copy-checkout[2.41.1] 3.8762 (1.28) 3.8762 (1.28) 3.8762 (1.28) 0.0000 (1.0) 3.8762 (1.28) 0.0000 (1.0) 0;0 0.2580 (0.78) 1 1
test_checkout_copy-checkout[2.45.0] 4.2060 (1.39) 4.2060 (1.39) 4.2060 (1.39) 0.0000 (1.0) 4.2060 (1.39) 0.0000 (1.0) 0;0 0.2378 (0.72) 1 1
test_checkout_copy-checkout[2.6.3] 3.0235 (1.0) 3.0235 (1.0) 3.0235 (1.0) 0.0000 (1.0) 3.0235 (1.0) 0.0000 (1.0) 0;0 0.3307 (1.0) 1 1
test_checkout_copy-checkout[main] 4.2465 (1.40) 4.2465 (1.40) 4.2465 (1.40) 0.0000 (1.0) 4.2465 (1.40) 0.0000 (1.0) 0;0 0.2355 (0.71) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 533.7009 (1.15) 533.7009 (1.15) 533.7009 (1.15) 0.0000 (1.0) 533.7009 (1.15) 0.0000 (1.0) 0;0 1.8737 (0.87) 1 1
test_checkout_copy-checkout-noop[2.18.1] 693.9667 (1.49) 693.9667 (1.49) 693.9667 (1.49) 0.0000 (1.0) 693.9667 (1.49) 0.0000 (1.0) 0;0 1.4410 (0.67) 1 1
test_checkout_copy-checkout-noop[2.39.0] 677.9288 (1.46) 677.9288 (1.46) 677.9288 (1.46) 0.0000 (1.0) 677.9288 (1.46) 0.0000 (1.0) 0;0 1.4751 (0.69) 1 1
test_checkout_copy-checkout-noop[2.40.0] 720.0668 (1.55) 720.0668 (1.55) 720.0668 (1.55) 0.0000 (1.0) 720.0668 (1.55) 0.0000 (1.0) 0;0 1.3888 (0.65) 1 1
test_checkout_copy-checkout-noop[2.41.1] 708.5297 (1.52) 708.5297 (1.52) 708.5297 (1.52) 0.0000 (1.0) 708.5297 (1.52) 0.0000 (1.0) 0;0 1.4114 (0.66) 1 1
test_checkout_copy-checkout-noop[2.45.0] 716.3520 (1.54) 716.3520 (1.54) 716.3520 (1.54) 0.0000 (1.0) 716.3520 (1.54) 0.0000 (1.0) 0;0 1.3960 (0.65) 1 1
test_checkout_copy-checkout-noop[2.6.3] 465.5472 (1.0) 465.5472 (1.0) 465.5472 (1.0) 0.0000 (1.0) 465.5472 (1.0) 0.0000 (1.0) 0;0 2.1480 (1.0) 1 1
test_checkout_copy-checkout-noop[main] 841.9320 (1.81) 841.9320 (1.81) 841.9320 (1.81) 0.0000 (1.0) 841.9320 (1.81) 0.0000 (1.0) 0;0 1.1877 (0.55) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.4872 (1.96) 1.4872 (1.96) 1.4872 (1.96) 0.0000 (1.0) 1.4872 (1.96) 0.0000 (1.0) 0;0 0.6724 (0.51) 1 1
test_checkout_copy-checkout-update[2.18.1] 0.7586 (1.0) 0.7586 (1.0) 0.7586 (1.0) 0.0000 (1.0) 0.7586 (1.0) 0.0000 (1.0) 0;0 1.3183 (1.0) 1 1
test_checkout_copy-checkout-update[2.39.0] 0.7897 (1.04) 0.7897 (1.04) 0.7897 (1.04) 0.0000 (1.0) 0.7897 (1.04) 0.0000 (1.0) 0;0 1.2663 (0.96) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.7947 (1.05) 0.7947 (1.05) 0.7947 (1.05) 0.0000 (1.0) 0.7947 (1.05) 0.0000 (1.0) 0;0 1.2583 (0.95) 1 1
test_checkout_copy-checkout-update[2.41.1] 0.7595 (1.00) 0.7595 (1.00) 0.7595 (1.00) 0.0000 (1.0) 0.7595 (1.00) 0.0000 (1.0) 0;0 1.3167 (1.00) 1 1
test_checkout_copy-checkout-update[2.45.0] 0.7975 (1.05) 0.7975 (1.05) 0.7975 (1.05) 0.0000 (1.0) 0.7975 (1.05) 0.0000 (1.0) 0;0 1.2540 (0.95) 1 1
test_checkout_copy-checkout-update[2.6.3] 3.6062 (4.75) 3.6062 (4.75) 3.6062 (4.75) 0.0000 (1.0) 3.6062 (4.75) 0.0000 (1.0) 0;0 0.2773 (0.21) 1 1
test_checkout_copy-checkout-update[main] 0.8745 (1.15) 0.8745 (1.15) 0.8745 (1.15) 0.0000 (1.0) 0.8745 (1.15) 0.0000 (1.0) 0;0 1.1435 (0.87) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 8 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 11.0075 (1.51) 11.0075 (1.51) 11.0075 (1.51) 0.0000 (1.0) 11.0075 (1.51) 0.0000 (1.0) 0;0 0.0908 (0.66) 1 1
test_import-import[2.18.1] 10.5397 (1.45) 10.5397 (1.45) 10.5397 (1.45) 0.0000 (1.0) 10.5397 (1.45) 0.0000 (1.0) 0;0 0.0949 (0.69) 1 1
test_import-import[2.39.0] 9.3342 (1.28) 9.3342 (1.28) 9.3342 (1.28) 0.0000 (1.0) 9.3342 (1.28) 0.0000 (1.0) 0;0 0.1071 (0.78) 1 1
test_import-import[2.40.0] 8.8672 (1.22) 8.8672 (1.22) 8.8672 (1.22) 0.0000 (1.0) 8.8672 (1.22) 0.0000 (1.0) 0;0 0.1128 (0.82) 1 1
test_import-import[2.41.1] 8.9541 (1.23) 8.9541 (1.23) 8.9541 (1.23) 0.0000 (1.0) 8.9541 (1.23) 0.0000 (1.0) 0;0 0.1117 (0.81) 1 1
test_import-import[2.45.0] 7.2894 (1.0) 7.2894 (1.0) 7.2894 (1.0) 0.0000 (1.0) 7.2894 (1.0) 0.0000 (1.0) 0;0 0.1372 (1.0) 1 1
test_import-import[2.6.3] 8.8260 (1.21) 8.8260 (1.21) 8.8260 (1.21) 0.0000 (1.0) 8.8260 (1.21) 0.0000 (1.0) 0;0 0.1133 (0.83) 1 1
test_import-import[main] 8.1016 (1.11) 8.1016 (1.11) 8.1016 (1.11) 0.0000 (1.0) 8.1016 (1.11) 0.0000 (1.0) 0;0 0.1234 (0.90) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 3.5308 (5.21) 3.5308 (5.21) 3.5308 (5.21) 0.0000 (1.0) 3.5308 (5.21) 0.0000 (1.0) 0;0 0.2832 (0.19) 1 1
test_partial_remove-add[2.18.1] 2.9248 (4.32) 2.9248 (4.32) 2.9248 (4.32) 0.0000 (1.0) 2.9248 (4.32) 0.0000 (1.0) 0;0 0.3419 (0.23) 1 1
test_partial_remove-add[2.39.0] 2.2574 (3.33) 2.2574 (3.33) 2.2574 (3.33) 0.0000 (1.0) 2.2574 (3.33) 0.0000 (1.0) 0;0 0.4430 (0.30) 1 1
test_partial_remove-add[2.40.0] 3.8397 (5.67) 3.8397 (5.67) 3.8397 (5.67) 0.0000 (1.0) 3.8397 (5.67) 0.0000 (1.0) 0;0 0.2604 (0.18) 1 1
test_partial_remove-add[2.41.1] 2.2961 (3.39) 2.2961 (3.39) 2.2961 (3.39) 0.0000 (1.0) 2.2961 (3.39) 0.0000 (1.0) 0;0 0.4355 (0.30) 1 1
test_partial_remove-add[2.45.0] 3.9411 (5.82) 3.9411 (5.82) 3.9411 (5.82) 0.0000 (1.0) 3.9411 (5.82) 0.0000 (1.0) 0;0 0.2537 (0.17) 1 1
test_partial_remove-add[2.6.3] 0.6776 (1.0) 0.6776 (1.0) 0.6776 (1.0) 0.0000 (1.0) 0.6776 (1.0) 0.0000 (1.0) 0;0 1.4759 (1.0) 1 1
test_partial_remove-add[main] 1.8558 (2.74) 1.8558 (2.74) 1.8558 (2.74) 0.0000 (1.0) 1.8558 (2.74) 0.0000 (1.0) 0;0 0.5388 (0.37) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 539.5487 (1.10) 539.5487 (1.10) 539.5487 (1.10) 0.0000 (1.0) 539.5487 (1.10) 0.0000 (1.0) 0;0 1.8534 (0.91) 1 1
test_partial_remove-gc[2.18.1] 558.0899 (1.13) 558.0899 (1.13) 558.0899 (1.13) 0.0000 (1.0) 558.0899 (1.13) 0.0000 (1.0) 0;0 1.7918 (0.88) 1 1
test_partial_remove-gc[2.39.0] 577.2468 (1.17) 577.2468 (1.17) 577.2468 (1.17) 0.0000 (1.0) 577.2468 (1.17) 0.0000 (1.0) 0;0 1.7324 (0.85) 1 1
test_partial_remove-gc[2.40.0] 583.9752 (1.19) 583.9752 (1.19) 583.9752 (1.19) 0.0000 (1.0) 583.9752 (1.19) 0.0000 (1.0) 0;0 1.7124 (0.84) 1 1
test_partial_remove-gc[2.41.1] 560.9863 (1.14) 560.9863 (1.14) 560.9863 (1.14) 0.0000 (1.0) 560.9863 (1.14) 0.0000 (1.0) 0;0 1.7826 (0.88) 1 1
test_partial_remove-gc[2.45.0] 557.8837 (1.13) 557.8837 (1.13) 557.8837 (1.13) 0.0000 (1.0) 557.8837 (1.13) 0.0000 (1.0) 0;0 1.7925 (0.88) 1 1
test_partial_remove-gc[2.6.3] 492.1823 (1.0) 492.1823 (1.0) 492.1823 (1.0) 0.0000 (1.0) 492.1823 (1.0) 0.0000 (1.0) 0;0 2.0318 (1.0) 1 1
test_partial_remove-gc[main] 645.9485 (1.31) 645.9485 (1.31) 645.9485 (1.31) 0.0000 (1.0) 645.9485 (1.31) 0.0000 (1.0) 0;0 1.5481 (0.76) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 561.3079 (1.08) 561.3079 (1.08) 561.3079 (1.08) 0.0000 (1.0) 561.3079 (1.08) 0.0000 (1.0) 0;0 1.7816 (0.92) 1 1
test_partial_remove-gc-cloud[2.18.1] 597.3225 (1.15) 597.3225 (1.15) 597.3225 (1.15) 0.0000 (1.0) 597.3225 (1.15) 0.0000 (1.0) 0;0 1.6741 (0.87) 1 1
test_partial_remove-gc-cloud[2.39.0] 624.6383 (1.21) 624.6383 (1.21) 624.6383 (1.21) 0.0000 (1.0) 624.6383 (1.21) 0.0000 (1.0) 0;0 1.6009 (0.83) 1 1
test_partial_remove-gc-cloud[2.40.0] 631.0274 (1.22) 631.0274 (1.22) 631.0274 (1.22) 0.0000 (1.0) 631.0274 (1.22) 0.0000 (1.0) 0;0 1.5847 (0.82) 1 1
test_partial_remove-gc-cloud[2.41.1] 627.5756 (1.21) 627.5756 (1.21) 627.5756 (1.21) 0.0000 (1.0) 627.5756 (1.21) 0.0000 (1.0) 0;0 1.5934 (0.83) 1 1
test_partial_remove-gc-cloud[2.45.0] 592.7722 (1.14) 592.7722 (1.14) 592.7722 (1.14) 0.0000 (1.0) 592.7722 (1.14) 0.0000 (1.0) 0;0 1.6870 (0.87) 1 1
test_partial_remove-gc-cloud[2.6.3] 517.8528 (1.0) 517.8528 (1.0) 517.8528 (1.0) 0.0000 (1.0) 517.8528 (1.0) 0.0000 (1.0) 0;0 1.9311 (1.0) 1 1
test_partial_remove-gc-cloud[main] 714.7316 (1.38) 714.7316 (1.38) 714.7316 (1.38) 0.0000 (1.0) 714.7316 (1.38) 0.0000 (1.0) 0;0 1.3991 (0.72) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 540.2425 (1.46) 540.2425 (1.46) 540.2425 (1.46) 0.0000 (1.0) 540.2425 (1.46) 0.0000 (1.0) 0;0 1.8510 (0.69) 1 1
test_partial_remove-push[2.18.1] 521.3460 (1.41) 521.3460 (1.41) 521.3460 (1.41) 0.0000 (1.0) 521.3460 (1.41) 0.0000 (1.0) 0;0 1.9181 (0.71) 1 1
test_partial_remove-push[2.39.0] 559.3112 (1.51) 559.3112 (1.51) 559.3112 (1.51) 0.0000 (1.0) 559.3112 (1.51) 0.0000 (1.0) 0;0 1.7879 (0.66) 1 1
test_partial_remove-push[2.40.0] 613.2263 (1.65) 613.2263 (1.65) 613.2263 (1.65) 0.0000 (1.0) 613.2263 (1.65) 0.0000 (1.0) 0;0 1.6307 (0.60) 1 1
test_partial_remove-push[2.41.1] 564.5452 (1.52) 564.5452 (1.52) 564.5452 (1.52) 0.0000 (1.0) 564.5452 (1.52) 0.0000 (1.0) 0;0 1.7713 (0.66) 1 1
test_partial_remove-push[2.45.0] 578.4522 (1.56) 578.4522 (1.56) 578.4522 (1.56) 0.0000 (1.0) 578.4522 (1.56) 0.0000 (1.0) 0;0 1.7288 (0.64) 1 1
test_partial_remove-push[2.6.3] 370.5937 (1.0) 370.5937 (1.0) 370.5937 (1.0) 0.0000 (1.0) 370.5937 (1.0) 0.0000 (1.0) 0;0 2.6984 (1.0) 1 1
test_partial_remove-push[main] 677.3479 (1.83) 677.3479 (1.83) 677.3479 (1.83) 0.0000 (1.0) 677.3479 (1.83) 0.0000 (1.0) 0;0 1.4763 (0.55) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial-add[2.11.0] 6.9154 (2.11) 6.9154 (2.11) 6.9154 (2.11) 0.0000 (1.0) 6.9154 (2.11) 0.0000 (1.0) 0;0 0.1446 (0.47) 1 1
test_partial_add-add-partial-add[2.18.1] 5.5283 (1.69) 5.5283 (1.69) 5.5283 (1.69) 0.0000 (1.0) 5.5283 (1.69) 0.0000 (1.0) 0;0 0.1809 (0.59) 1 1
test_partial_add-add-partial-add[2.39.0] 4.7473 (1.45) 4.7473 (1.45) 4.7473 (1.45) 0.0000 (1.0) 4.7473 (1.45) 0.0000 (1.0) 0;0 0.2106 (0.69) 1 1
test_partial_add-add-partial-add[2.40.0] 4.7037 (1.44) 4.7037 (1.44) 4.7037 (1.44) 0.0000 (1.0) 4.7037 (1.44) 0.0000 (1.0) 0;0 0.2126 (0.70) 1 1
test_partial_add-add-partial-add[2.41.1] 4.6163 (1.41) 4.6163 (1.41) 4.6163 (1.41) 0.0000 (1.0) 4.6163 (1.41) 0.0000 (1.0) 0;0 0.2166 (0.71) 1 1
test_partial_add-add-partial-add[2.45.0] 3.8473 (1.17) 3.8473 (1.17) 3.8473 (1.17) 0.0000 (1.0) 3.8473 (1.17) 0.0000 (1.0) 0;0 0.2599 (0.85) 1 1
test_partial_add-add-partial-add[2.6.3] 8.1010 (2.47) 8.1010 (2.47) 8.1010 (2.47) 0.0000 (1.0) 8.1010 (2.47) 0.0000 (1.0) 0;0 0.1234 (0.40) 1 1
test_partial_add-add-partial-add[main] 3.2772 (1.0) 3.2772 (1.0) 3.2772 (1.0) 0.0000 (1.0) 3.2772 (1.0) 0.0000 (1.0) 0;0 0.3051 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 471.1538 (1.10) 471.1538 (1.10) 471.1538 (1.10) 0.0000 (1.0) 471.1538 (1.10) 0.0000 (1.0) 0;0 2.1224 (0.91) 1 1
test_partial_add-gc-cloud-noop[2.18.1] 511.2087 (1.20) 511.2087 (1.20) 511.2087 (1.20) 0.0000 (1.0) 511.2087 (1.20) 0.0000 (1.0) 0;0 1.9561 (0.83) 1 1
test_partial_add-gc-cloud-noop[2.39.0] 543.0489 (1.27) 543.0489 (1.27) 543.0489 (1.27) 0.0000 (1.0) 543.0489 (1.27) 0.0000 (1.0) 0;0 1.8415 (0.79) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 542.4735 (1.27) 542.4735 (1.27) 542.4735 (1.27) 0.0000 (1.0) 542.4735 (1.27) 0.0000 (1.0) 0;0 1.8434 (0.79) 1 1
test_partial_add-gc-cloud-noop[2.41.1] 540.6982 (1.27) 540.6982 (1.27) 540.6982 (1.27) 0.0000 (1.0) 540.6982 (1.27) 0.0000 (1.0) 0;0 1.8495 (0.79) 1 1
test_partial_add-gc-cloud-noop[2.45.0] 539.6818 (1.27) 539.6818 (1.27) 539.6818 (1.27) 0.0000 (1.0) 539.6818 (1.27) 0.0000 (1.0) 0;0 1.8529 (0.79) 1 1
test_partial_add-gc-cloud-noop[2.6.3] 426.4639 (1.0) 426.4639 (1.0) 426.4639 (1.0) 0.0000 (1.0) 426.4639 (1.0) 0.0000 (1.0) 0;0 2.3449 (1.0) 1 1
test_partial_add-gc-cloud-noop[main] 622.7386 (1.46) 622.7386 (1.46) 622.7386 (1.46) 0.0000 (1.0) 622.7386 (1.46) 0.0000 (1.0) 0;0 1.6058 (0.68) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 8 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 411.1982 (1.11) 411.1982 (1.11) 411.1982 (1.11) 0.0000 (1.0) 411.1982 (1.11) 0.0000 (1.0) 0;0 2.4319 (0.90) 1 1
test_partial_add-gc-noop[2.18.1] 450.5303 (1.21) 450.5303 (1.21) 450.5303 (1.21) 0.0000 (1.0) 450.5303 (1.21) 0.0000 (1.0) 0;0 2.2196 (0.83) 1 1
test_partial_add-gc-noop[2.39.0] 485.1886 (1.31) 485.1886 (1.31) 485.1886 (1.31) 0.0000 (1.0) 485.1886 (1.31) 0.0000 (1.0) 0;0 2.0611 (0.77) 1 1
test_partial_add-gc-noop[2.40.0] 480.8640 (1.29) 480.8640 (1.29) 480.8640 (1.29) 0.0000 (1.0) 480.8640 (1.29) 0.0000 (1.0) 0;0 2.0796 (0.77) 1 1
test_partial_add-gc-noop[2.41.1] 480.0995 (1.29) 480.0995 (1.29) 480.0995 (1.29) 0.0000 (1.0) 480.0995 (1.29) 0.0000 (1.0) 0;0 2.0829 (0.77) 1 1
test_partial_add-gc-noop[2.45.0] 482.7577 (1.30) 482.7577 (1.30) 482.7577 (1.30) 0.0000 (1.0) 482.7577 (1.30) 0.0000 (1.0) 0;0 2.0714 (0.77) 1 1
test_partial_add-gc-noop[2.6.3] 371.7202 (1.0) 371.7202 (1.0) 371.7202 (1.0) 0.0000 (1.0) 371.7202 (1.0) 0.0000 (1.0) 0;0 2.6902 (1.0) 1 1
test_partial_add-gc-noop[main] 550.8212 (1.48) 550.8212 (1.48) 550.8212 (1.48) 0.0000 (1.0) 550.8212 (1.48) 0.0000 (1.0) 0;0 1.8155 (0.67) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 8 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial-add[2.11.0] 3.8684 (1.87) 3.8684 (1.87) 3.8684 (1.87) 0.0000 (1.0) 3.8684 (1.87) 0.0000 (1.0) 0;0 0.2585 (0.53) 1 1
test_partial_add-push-partial-add[2.18.1] 2.1898 (1.06) 2.1898 (1.06) 2.1898 (1.06) 0.0000 (1.0) 2.1898 (1.06) 0.0000 (1.0) 0;0 0.4567 (0.94) 1 1
test_partial_add-push-partial-add[2.39.0] 2.7324 (1.32) 2.7324 (1.32) 2.7324 (1.32) 0.0000 (1.0) 2.7324 (1.32) 0.0000 (1.0) 0;0 0.3660 (0.76) 1 1
test_partial_add-push-partial-add[2.40.0] 2.7425 (1.33) 2.7425 (1.33) 2.7425 (1.33) 0.0000 (1.0) 2.7425 (1.33) 0.0000 (1.0) 0;0 0.3646 (0.75) 1 1
test_partial_add-push-partial-add[2.41.1] 2.7384 (1.32) 2.7384 (1.32) 2.7384 (1.32) 0.0000 (1.0) 2.7384 (1.32) 0.0000 (1.0) 0;0 0.3652 (0.76) 1 1
test_partial_add-push-partial-add[2.45.0] 3.3586 (1.62) 3.3586 (1.62) 3.3586 (1.62) 0.0000 (1.0) 3.3586 (1.62) 0.0000 (1.0) 0;0 0.2977 (0.62) 1 1
test_partial_add-push-partial-add[2.6.3] 3.2278 (1.56) 3.2278 (1.56) 3.2278 (1.56) 0.0000 (1.0) 3.2278 (1.56) 0.0000 (1.0) 0;0 0.3098 (0.64) 1 1
test_partial_add-push-partial-add[main] 2.0677 (1.0) 2.0677 (1.0) 2.0677 (1.0) 0.0000 (1.0) 2.0677 (1.0) 0.0000 (1.0) 0;0 0.4836 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
set-outputusagecml commentfor PR comment generation