github-actions[bot]
commented
1 year ago
Fri May 5 12:21:42 UTC 2023
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.39.0] 1.1645 (1.19) 1.1856 (1.17) 1.1760 (1.18) 0.0083 (1.27) 1.1783 (1.18) 0.0122 (1.66) 2;0 0.8503 (0.85) 5 3
test_plots-plots-diff[2.40.0] 1.1602 (1.18) 1.1803 (1.16) 1.1702 (1.17) 0.0086 (1.32) 1.1720 (1.18) 0.0149 (2.02) 2;0 0.8546 (0.85) 5 3
test_plots-plots-diff[2.41.1] 1.1636 (1.18) 1.1798 (1.16) 1.1698 (1.17) 0.0068 (1.04) 1.1662 (1.17) 0.0102 (1.38) 1;0 0.8549 (0.85) 5 3
test_plots-plots-diff[2.45.0] 1.0747 (1.09) 1.0921 (1.08) 1.0818 (1.09) 0.0065 (1.0) 1.0803 (1.08) 0.0074 (1.0) 2;0 0.9244 (0.92) 5 3
test_plots-plots-diff[main] 0.9823 (1.0) 1.0146 (1.0) 0.9967 (1.0) 0.0121 (1.86) 0.9957 (1.0) 0.0160 (2.17) 2;0 1.0033 (1.0) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.39.0] 2.1214 (1.63) 2.1454 (1.63) 2.1309 (1.63) 0.0102 (1.38) 2.1264 (1.62) 0.0162 (1.87) 1;0 0.4693 (0.61) 5 3
test_plots-plots-diff-json[2.40.0] 2.1100 (1.63) 2.1253 (1.61) 2.1171 (1.62) 0.0075 (1.01) 2.1129 (1.61) 0.0137 (1.57) 2;0 0.4723 (0.62) 5 3
test_plots-plots-diff-json[2.41.1] 2.1066 (1.62) 2.1421 (1.63) 2.1251 (1.62) 0.0134 (1.81) 2.1261 (1.62) 0.0188 (2.16) 2;0 0.4706 (0.62) 5 3
test_plots-plots-diff-json[2.45.0] 1.9037 (1.47) 1.9234 (1.46) 1.9125 (1.46) 0.0083 (1.13) 1.9133 (1.46) 0.0141 (1.62) 2;0 0.5229 (0.69) 5 3
test_plots-plots-diff-json[main] 1.2982 (1.0) 1.3168 (1.0) 1.3104 (1.0) 0.0074 (1.0) 1.3111 (1.0) 0.0087 (1.0) 1;0 0.7631 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.39.0] 774.9896 (1.05) 792.2329 (1.05) 783.5100 (1.05) 7.7525 (2.88) 782.3052 (1.05) 14.3598 (3.83) 2;0 1.2763 (0.95) 5 3
test_plots-plots-show[2.40.0] 774.3456 (1.04) 790.4199 (1.05) 783.9829 (1.05) 6.5070 (2.41) 785.1180 (1.06) 9.9838 (2.66) 1;0 1.2755 (0.95) 5 3
test_plots-plots-show[2.41.1] 777.3960 (1.05) 784.1002 (1.04) 781.4341 (1.05) 2.6954 (1.0) 781.7288 (1.05) 4.0429 (1.08) 1;0 1.2797 (0.95) 5 3
test_plots-plots-show[2.45.0] 741.1763 (1.0) 752.5412 (1.0) 744.3778 (1.0) 4.6359 (1.72) 742.4267 (1.0) 3.7519 (1.0) 1;1 1.3434 (1.0) 5 3
test_plots-plots-show[main] 816.1523 (1.10) 833.8264 (1.11) 822.7686 (1.11) 6.9655 (2.58) 820.2249 (1.10) 9.1321 (2.43) 1;0 1.2154 (0.90) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.39.0] 1.2892 (1.30) 1.3124 (1.31) 1.3023 (1.30) 0.0091 (3.17) 1.3058 (1.31) 0.0131 (4.35) 2;0 0.7679 (0.77) 5 3
test_plots-plots-show-json[2.40.0] 1.2978 (1.31) 1.3316 (1.33) 1.3098 (1.31) 0.0141 (4.87) 1.3025 (1.30) 0.0198 (6.59) 1;0 0.7635 (0.76) 5 3
test_plots-plots-show-json[2.41.1] 1.2978 (1.31) 1.3062 (1.31) 1.3034 (1.31) 0.0034 (1.18) 1.3041 (1.30) 0.0040 (1.34) 1;0 0.7672 (0.77) 5 3
test_plots-plots-show-json[2.45.0] 1.2123 (1.22) 1.2389 (1.24) 1.2204 (1.22) 0.0113 (3.91) 1.2145 (1.22) 0.0145 (4.83) 1;0 0.8194 (0.82) 5 3
test_plots-plots-show-json[main] 0.9934 (1.0) 1.0004 (1.0) 0.9984 (1.0) 0.0029 (1.0) 0.9993 (1.0) 0.0030 (1.0) 1;0 1.0016 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.18.1] 1.1317 (1.0) 1.1317 (1.0) 1.1317 (1.0) 0.0000 (1.0) 1.1317 (1.0) 0.0000 (1.0) 0;0 0.8836 (1.0) 1 1
test_data_status_all_flags-data-changed[2.39.0] 1.1727 (1.04) 1.1727 (1.04) 1.1727 (1.04) 0.0000 (1.0) 1.1727 (1.04) 0.0000 (1.0) 0;0 0.8528 (0.97) 1 1
test_data_status_all_flags-data-changed[2.40.0] 1.1775 (1.04) 1.1775 (1.04) 1.1775 (1.04) 0.0000 (1.0) 1.1775 (1.04) 0.0000 (1.0) 0;0 0.8493 (0.96) 1 1
test_data_status_all_flags-data-changed[2.41.1] 1.1712 (1.03) 1.1712 (1.03) 1.1712 (1.03) 0.0000 (1.0) 1.1712 (1.03) 0.0000 (1.0) 0;0 0.8538 (0.97) 1 1
test_data_status_all_flags-data-changed[2.45.0] 1.1681 (1.03) 1.1681 (1.03) 1.1681 (1.03) 0.0000 (1.0) 1.1681 (1.03) 0.0000 (1.0) 0;0 0.8561 (0.97) 1 1
test_data_status_all_flags-data-changed[main] 1.1935 (1.05) 1.1935 (1.05) 1.1935 (1.05) 0.0000 (1.0) 1.1935 (1.05) 0.0000 (1.0) 0;0 0.8378 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.18.1] 1.1329 (1.0) 1.1329 (1.0) 1.1329 (1.0) 0.0000 (1.0) 1.1329 (1.0) 0.0000 (1.0) 0;0 0.8827 (1.0) 1 1
test_data_status_all_flags-data-changed-noop[2.39.0] 1.1733 (1.04) 1.1733 (1.04) 1.1733 (1.04) 0.0000 (1.0) 1.1733 (1.04) 0.0000 (1.0) 0;0 0.8523 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[2.40.0] 1.1713 (1.03) 1.1713 (1.03) 1.1713 (1.03) 0.0000 (1.0) 1.1713 (1.03) 0.0000 (1.0) 0;0 0.8538 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[2.41.1] 1.1757 (1.04) 1.1757 (1.04) 1.1757 (1.04) 0.0000 (1.0) 1.1757 (1.04) 0.0000 (1.0) 0;0 0.8506 (0.96) 1 1
test_data_status_all_flags-data-changed-noop[2.45.0] 1.1674 (1.03) 1.1674 (1.03) 1.1674 (1.03) 0.0000 (1.0) 1.1674 (1.03) 0.0000 (1.0) 0;0 0.8566 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.1985 (1.06) 1.1985 (1.06) 1.1985 (1.06) 0.0000 (1.0) 1.1985 (1.06) 0.0000 (1.0) 0;0 0.8344 (0.95) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.18.1] 1.8658 (1.0) 1.8658 (1.0) 1.8658 (1.0) 0.0000 (1.0) 1.8658 (1.0) 0.0000 (1.0) 0;0 0.5360 (1.0) 1 1
test_data_status_all_flags-data-new[2.39.0] 2.4532 (1.31) 2.4532 (1.31) 2.4532 (1.31) 0.0000 (1.0) 2.4532 (1.31) 0.0000 (1.0) 0;0 0.4076 (0.76) 1 1
test_data_status_all_flags-data-new[2.40.0] 1.9062 (1.02) 1.9062 (1.02) 1.9062 (1.02) 0.0000 (1.0) 1.9062 (1.02) 0.0000 (1.0) 0;0 0.5246 (0.98) 1 1
test_data_status_all_flags-data-new[2.41.1] 1.8881 (1.01) 1.8881 (1.01) 1.8881 (1.01) 0.0000 (1.0) 1.8881 (1.01) 0.0000 (1.0) 0;0 0.5296 (0.99) 1 1
test_data_status_all_flags-data-new[2.45.0] 2.5928 (1.39) 2.5928 (1.39) 2.5928 (1.39) 0.0000 (1.0) 2.5928 (1.39) 0.0000 (1.0) 0;0 0.3857 (0.72) 1 1
test_data_status_all_flags-data-new[main] 1.9076 (1.02) 1.9076 (1.02) 1.9076 (1.02) 0.0000 (1.0) 1.9076 (1.02) 0.0000 (1.0) 0;0 0.5242 (0.98) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.18.1] 1.0916 (1.0) 1.0916 (1.0) 1.0916 (1.0) 0.0000 (1.0) 1.0916 (1.0) 0.0000 (1.0) 0;0 0.9161 (1.0) 1 1
test_data_status_all_flags-data-noop[2.39.0] 1.1215 (1.03) 1.1215 (1.03) 1.1215 (1.03) 0.0000 (1.0) 1.1215 (1.03) 0.0000 (1.0) 0;0 0.8917 (0.97) 1 1
test_data_status_all_flags-data-noop[2.40.0] 1.3529 (1.24) 1.3529 (1.24) 1.3529 (1.24) 0.0000 (1.0) 1.3529 (1.24) 0.0000 (1.0) 0;0 0.7391 (0.81) 1 1
test_data_status_all_flags-data-noop[2.41.1] 1.1212 (1.03) 1.1212 (1.03) 1.1212 (1.03) 0.0000 (1.0) 1.1212 (1.03) 0.0000 (1.0) 0;0 0.8919 (0.97) 1 1
test_data_status_all_flags-data-noop[2.45.0] 1.1139 (1.02) 1.1139 (1.02) 1.1139 (1.02) 0.0000 (1.0) 1.1139 (1.02) 0.0000 (1.0) 0;0 0.8978 (0.98) 1 1
test_data_status_all_flags-data-noop[main] 1.1698 (1.07) 1.1698 (1.07) 1.1698 (1.07) 0.0000 (1.0) 1.1698 (1.07) 0.0000 (1.0) 0;0 0.8549 (0.93) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_sharing-add': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 11.1089 (1.95) 11.1089 (1.95) 11.1089 (1.95) 0.0000 (1.0) 11.1089 (1.95) 0.0000 (1.0) 0;0 0.0900 (0.51) 1 1
test_sharing-add[2.18.1] 9.8427 (1.73) 9.8427 (1.73) 9.8427 (1.73) 0.0000 (1.0) 9.8427 (1.73) 0.0000 (1.0) 0;0 0.1016 (0.58) 1 1
test_sharing-add[2.39.0] 8.9855 (1.57) 8.9855 (1.57) 8.9855 (1.57) 0.0000 (1.0) 8.9855 (1.57) 0.0000 (1.0) 0;0 0.1113 (0.63) 1 1
test_sharing-add[2.40.0] 9.5574 (1.68) 9.5574 (1.68) 9.5574 (1.68) 0.0000 (1.0) 9.5574 (1.68) 0.0000 (1.0) 0;0 0.1046 (0.60) 1 1
test_sharing-add[2.41.1] 9.0445 (1.59) 9.0445 (1.59) 9.0445 (1.59) 0.0000 (1.0) 9.0445 (1.59) 0.0000 (1.0) 0;0 0.1106 (0.63) 1 1
test_sharing-add[2.45.0] 5.7051 (1.0) 5.7051 (1.0) 5.7051 (1.0) 0.0000 (1.0) 5.7051 (1.0) 0.0000 (1.0) 0;0 0.1753 (1.0) 1 1
test_sharing-add[main] 6.2762 (1.10) 6.2762 (1.10) 6.2762 (1.10) 0.0000 (1.0) 6.2762 (1.10) 0.0000 (1.0) 0;0 0.1593 (0.91) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 4.9925 (1.40) 4.9925 (1.40) 4.9925 (1.40) 0.0000 (1.0) 4.9925 (1.40) 0.0000 (1.0) 0;0 0.2003 (0.71) 1 1
test_sharing-add-noop[2.18.1] 5.4918 (1.54) 5.4918 (1.54) 5.4918 (1.54) 0.0000 (1.0) 5.4918 (1.54) 0.0000 (1.0) 0;0 0.1821 (0.65) 1 1
test_sharing-add-noop[2.39.0] 3.5643 (1.0) 3.5643 (1.0) 3.5643 (1.0) 0.0000 (1.0) 3.5643 (1.0) 0.0000 (1.0) 0;0 0.2806 (1.0) 1 1
test_sharing-add-noop[2.40.0] 3.8561 (1.08) 3.8561 (1.08) 3.8561 (1.08) 0.0000 (1.0) 3.8561 (1.08) 0.0000 (1.0) 0;0 0.2593 (0.92) 1 1
test_sharing-add-noop[2.41.1] 3.6455 (1.02) 3.6455 (1.02) 3.6455 (1.02) 0.0000 (1.0) 3.6455 (1.02) 0.0000 (1.0) 0;0 0.2743 (0.98) 1 1
test_sharing-add-noop[2.45.0] 3.9002 (1.09) 3.9002 (1.09) 3.9002 (1.09) 0.0000 (1.0) 3.9002 (1.09) 0.0000 (1.0) 0;0 0.2564 (0.91) 1 1
test_sharing-add-noop[main] 4.0108 (1.13) 4.0108 (1.13) 4.0108 (1.13) 0.0000 (1.0) 4.0108 (1.13) 0.0000 (1.0) 0;0 0.2493 (0.89) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 7 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 713.6686 (1.0) 713.6686 (1.0) 713.6686 (1.0) 0.0000 (1.0) 713.6686 (1.0) 0.0000 (1.0) 0;0 1.4012 (1.0) 1 1
test_sharing-checkout-noop[2.18.1] 776.9704 (1.09) 776.9704 (1.09) 776.9704 (1.09) 0.0000 (1.0) 776.9704 (1.09) 0.0000 (1.0) 0;0 1.2871 (0.92) 1 1
test_sharing-checkout-noop[2.39.0] 820.5937 (1.15) 820.5937 (1.15) 820.5937 (1.15) 0.0000 (1.0) 820.5937 (1.15) 0.0000 (1.0) 0;0 1.2186 (0.87) 1 1
test_sharing-checkout-noop[2.40.0] 911.1040 (1.28) 911.1040 (1.28) 911.1040 (1.28) 0.0000 (1.0) 911.1040 (1.28) 0.0000 (1.0) 0;0 1.0976 (0.78) 1 1
test_sharing-checkout-noop[2.41.1] 834.1837 (1.17) 834.1837 (1.17) 834.1837 (1.17) 0.0000 (1.0) 834.1837 (1.17) 0.0000 (1.0) 0;0 1.1988 (0.86) 1 1
test_sharing-checkout-noop[2.45.0] 920.1742 (1.29) 920.1742 (1.29) 920.1742 (1.29) 0.0000 (1.0) 920.1742 (1.29) 0.0000 (1.0) 0;0 1.0868 (0.78) 1 1
test_sharing-checkout-noop[main] 1,013.7772 (1.42) 1,013.7772 (1.42) 1,013.7772 (1.42) 0.0000 (1.0) 1,013.7772 (1.42) 0.0000 (1.0) 0;0 0.9864 (0.70) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing-pull': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 11.6606 (1.13) 11.6606 (1.13) 11.6606 (1.13) 0.0000 (1.0) 11.6606 (1.13) 0.0000 (1.0) 0;0 0.0858 (0.88) 1 1
test_sharing-pull[2.18.1] 11.0928 (1.08) 11.0928 (1.08) 11.0928 (1.08) 0.0000 (1.0) 11.0928 (1.08) 0.0000 (1.0) 0;0 0.0901 (0.93) 1 1
test_sharing-pull[2.39.0] 12.7739 (1.24) 12.7739 (1.24) 12.7739 (1.24) 0.0000 (1.0) 12.7739 (1.24) 0.0000 (1.0) 0;0 0.0783 (0.81) 1 1
test_sharing-pull[2.40.0] 13.3376 (1.30) 13.3376 (1.30) 13.3376 (1.30) 0.0000 (1.0) 13.3376 (1.30) 0.0000 (1.0) 0;0 0.0750 (0.77) 1 1
test_sharing-pull[2.41.1] 12.4760 (1.21) 12.4760 (1.21) 12.4760 (1.21) 0.0000 (1.0) 12.4760 (1.21) 0.0000 (1.0) 0;0 0.0802 (0.83) 1 1
test_sharing-pull[2.45.0] 10.2960 (1.0) 10.2960 (1.0) 10.2960 (1.0) 0.0000 (1.0) 10.2960 (1.0) 0.0000 (1.0) 0;0 0.0971 (1.0) 1 1
test_sharing-pull[main] 10.7999 (1.05) 10.7999 (1.05) 10.7999 (1.05) 0.0000 (1.0) 10.7999 (1.05) 0.0000 (1.0) 0;0 0.0926 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 7 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 755.2388 (1.0) 755.2388 (1.0) 755.2388 (1.0) 0.0000 (1.0) 755.2388 (1.0) 0.0000 (1.0) 0;0 1.3241 (1.0) 1 1
test_sharing-pull-noop[2.18.1] 859.9746 (1.14) 859.9746 (1.14) 859.9746 (1.14) 0.0000 (1.0) 859.9746 (1.14) 0.0000 (1.0) 0;0 1.1628 (0.88) 1 1
test_sharing-pull-noop[2.39.0] 941.2137 (1.25) 941.2137 (1.25) 941.2137 (1.25) 0.0000 (1.0) 941.2137 (1.25) 0.0000 (1.0) 0;0 1.0625 (0.80) 1 1
test_sharing-pull-noop[2.40.0] 953.1763 (1.26) 953.1763 (1.26) 953.1763 (1.26) 0.0000 (1.0) 953.1763 (1.26) 0.0000 (1.0) 0;0 1.0491 (0.79) 1 1
test_sharing-pull-noop[2.41.1] 921.3648 (1.22) 921.3648 (1.22) 921.3648 (1.22) 0.0000 (1.0) 921.3648 (1.22) 0.0000 (1.0) 0;0 1.0853 (0.82) 1 1
test_sharing-pull-noop[2.45.0] 993.0901 (1.31) 993.0901 (1.31) 993.0901 (1.31) 0.0000 (1.0) 993.0901 (1.31) 0.0000 (1.0) 0;0 1.0070 (0.76) 1 1
test_sharing-pull-noop[main] 1,147.3778 (1.52) 1,147.3778 (1.52) 1,147.3778 (1.52) 0.0000 (1.0) 1,147.3778 (1.52) 0.0000 (1.0) 0;0 0.8716 (0.66) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 6.4217 (1.26) 6.4217 (1.26) 6.4217 (1.26) 0.0000 (1.0) 6.4217 (1.26) 0.0000 (1.0) 0;0 0.1557 (0.79) 1 1
test_sharing-push[2.18.1] 6.3499 (1.24) 6.3499 (1.24) 6.3499 (1.24) 0.0000 (1.0) 6.3499 (1.24) 0.0000 (1.0) 0;0 0.1575 (0.80) 1 1
test_sharing-push[2.39.0] 7.4246 (1.46) 7.4246 (1.46) 7.4246 (1.46) 0.0000 (1.0) 7.4246 (1.46) 0.0000 (1.0) 0;0 0.1347 (0.69) 1 1
test_sharing-push[2.40.0] 7.7944 (1.53) 7.7944 (1.53) 7.7944 (1.53) 0.0000 (1.0) 7.7944 (1.53) 0.0000 (1.0) 0;0 0.1283 (0.65) 1 1
test_sharing-push[2.41.1] 7.1511 (1.40) 7.1511 (1.40) 7.1511 (1.40) 0.0000 (1.0) 7.1511 (1.40) 0.0000 (1.0) 0;0 0.1398 (0.71) 1 1
test_sharing-push[2.45.0] 5.1023 (1.0) 5.1023 (1.0) 5.1023 (1.0) 0.0000 (1.0) 5.1023 (1.0) 0.0000 (1.0) 0;0 0.1960 (1.0) 1 1
test_sharing-push[main] 5.4371 (1.07) 5.4371 (1.07) 5.4371 (1.07) 0.0000 (1.0) 5.4371 (1.07) 0.0000 (1.0) 0;0 0.1839 (0.94) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 653.1300 (1.05) 653.1300 (1.05) 653.1300 (1.05) 0.0000 (1.0) 653.1300 (1.05) 0.0000 (1.0) 0;0 1.5311 (0.95) 1 1
test_sharing-push-noop[2.18.1] 622.8440 (1.0) 622.8440 (1.0) 622.8440 (1.0) 0.0000 (1.0) 622.8440 (1.0) 0.0000 (1.0) 0;0 1.6055 (1.0) 1 1
test_sharing-push-noop[2.39.0] 658.7407 (1.06) 658.7407 (1.06) 658.7407 (1.06) 0.0000 (1.0) 658.7407 (1.06) 0.0000 (1.0) 0;0 1.5180 (0.95) 1 1
test_sharing-push-noop[2.40.0] 677.1803 (1.09) 677.1803 (1.09) 677.1803 (1.09) 0.0000 (1.0) 677.1803 (1.09) 0.0000 (1.0) 0;0 1.4767 (0.92) 1 1
test_sharing-push-noop[2.41.1] 632.3978 (1.02) 632.3978 (1.02) 632.3978 (1.02) 0.0000 (1.0) 632.3978 (1.02) 0.0000 (1.0) 0;0 1.5813 (0.98) 1 1
test_sharing-push-noop[2.45.0] 661.1423 (1.06) 661.1423 (1.06) 661.1423 (1.06) 0.0000 (1.0) 661.1423 (1.06) 0.0000 (1.0) 0;0 1.5125 (0.94) 1 1
test_sharing-push-noop[main] 811.8516 (1.30) 811.8516 (1.30) 811.8516 (1.30) 0.0000 (1.0) 811.8516 (1.30) 0.0000 (1.0) 0;0 1.2318 (0.77) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 5.9444 (1.36) 5.9444 (1.36) 5.9444 (1.36) 0.0000 (1.0) 5.9444 (1.36) 0.0000 (1.0) 0;0 0.1682 (0.73) 1 1
test_get-get[2.18.1] 5.6037 (1.29) 5.6037 (1.29) 5.6037 (1.29) 0.0000 (1.0) 5.6037 (1.29) 0.0000 (1.0) 0;0 0.1785 (0.78) 1 1
test_get-get[2.39.0] 4.5435 (1.04) 4.5435 (1.04) 4.5435 (1.04) 0.0000 (1.0) 4.5435 (1.04) 0.0000 (1.0) 0;0 0.2201 (0.96) 1 1
test_get-get[2.40.0] 4.3565 (1.0) 4.3565 (1.0) 4.3565 (1.0) 0.0000 (1.0) 4.3565 (1.0) 0.0000 (1.0) 0;0 0.2295 (1.0) 1 1
test_get-get[2.41.1] 4.4521 (1.02) 4.4521 (1.02) 4.4521 (1.02) 0.0000 (1.0) 4.4521 (1.02) 0.0000 (1.0) 0;0 0.2246 (0.98) 1 1
test_get-get[2.45.0] 4.4611 (1.02) 4.4611 (1.02) 4.4611 (1.02) 0.0000 (1.0) 4.4611 (1.02) 0.0000 (1.0) 0;0 0.2242 (0.98) 1 1
test_get-get[main] 6.0058 (1.38) 6.0058 (1.38) 6.0058 (1.38) 0.0000 (1.0) 6.0058 (1.38) 0.0000 (1.0) 0;0 0.1665 (0.73) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 1.2867 (1.0) 1.2867 (1.0) 1.2867 (1.0) 0.0000 (1.0) 1.2867 (1.0) 0.0000 (1.0) 0;0 0.7772 (1.0) 1 1
test_checkout_symlink-checkout[2.18.1] 1.5064 (1.17) 1.5064 (1.17) 1.5064 (1.17) 0.0000 (1.0) 1.5064 (1.17) 0.0000 (1.0) 0;0 0.6638 (0.85) 1 1
test_checkout_symlink-checkout[2.39.0] 1.3578 (1.06) 1.3578 (1.06) 1.3578 (1.06) 0.0000 (1.0) 1.3578 (1.06) 0.0000 (1.0) 0;0 0.7365 (0.95) 1 1
test_checkout_symlink-checkout[2.40.0] 1.2879 (1.00) 1.2879 (1.00) 1.2879 (1.00) 0.0000 (1.0) 1.2879 (1.00) 0.0000 (1.0) 0;0 0.7765 (1.00) 1 1
test_checkout_symlink-checkout[2.41.1] 1.5017 (1.17) 1.5017 (1.17) 1.5017 (1.17) 0.0000 (1.0) 1.5017 (1.17) 0.0000 (1.0) 0;0 0.6659 (0.86) 1 1
test_checkout_symlink-checkout[2.45.0] 1.5405 (1.20) 1.5405 (1.20) 1.5405 (1.20) 0.0000 (1.0) 1.5405 (1.20) 0.0000 (1.0) 0;0 0.6491 (0.84) 1 1
test_checkout_symlink-checkout[main] 1.5775 (1.23) 1.5775 (1.23) 1.5775 (1.23) 0.0000 (1.0) 1.5775 (1.23) 0.0000 (1.0) 0;0 0.6339 (0.82) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 506.3750 (1.0) 506.3750 (1.0) 506.3750 (1.0) 0.0000 (1.0) 506.3750 (1.0) 0.0000 (1.0) 0;0 1.9748 (1.0) 1 1
test_checkout_symlink-checkout-noop[2.18.1] 557.2003 (1.10) 557.2003 (1.10) 557.2003 (1.10) 0.0000 (1.0) 557.2003 (1.10) 0.0000 (1.0) 0;0 1.7947 (0.91) 1 1
test_checkout_symlink-checkout-noop[2.39.0] 581.6576 (1.15) 581.6576 (1.15) 581.6576 (1.15) 0.0000 (1.0) 581.6576 (1.15) 0.0000 (1.0) 0;0 1.7192 (0.87) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 578.8588 (1.14) 578.8588 (1.14) 578.8588 (1.14) 0.0000 (1.0) 578.8588 (1.14) 0.0000 (1.0) 0;0 1.7275 (0.87) 1 1
test_checkout_symlink-checkout-noop[2.41.1] 585.5359 (1.16) 585.5359 (1.16) 585.5359 (1.16) 0.0000 (1.0) 585.5359 (1.16) 0.0000 (1.0) 0;0 1.7078 (0.86) 1 1
test_checkout_symlink-checkout-noop[2.45.0] 877.6342 (1.73) 877.6342 (1.73) 877.6342 (1.73) 0.0000 (1.0) 877.6342 (1.73) 0.0000 (1.0) 0;0 1.1394 (0.58) 1 1
test_checkout_symlink-checkout-noop[main] 723.6978 (1.43) 723.6978 (1.43) 723.6978 (1.43) 0.0000 (1.0) 723.6978 (1.43) 0.0000 (1.0) 0;0 1.3818 (0.70) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 1.3715 (2.08) 1.3715 (2.08) 1.3715 (2.08) 0.0000 (1.0) 1.3715 (2.08) 0.0000 (1.0) 0;0 0.7292 (0.48) 1 1
test_checkout_symlink-checkout-update[2.18.1] 0.6604 (1.0) 0.6604 (1.0) 0.6604 (1.0) 0.0000 (1.0) 0.6604 (1.0) 0.0000 (1.0) 0;0 1.5141 (1.0) 1 1
test_checkout_symlink-checkout-update[2.39.0] 0.6722 (1.02) 0.6722 (1.02) 0.6722 (1.02) 0.0000 (1.0) 0.6722 (1.02) 0.0000 (1.0) 0;0 1.4877 (0.98) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.7555 (1.14) 0.7555 (1.14) 0.7555 (1.14) 0.0000 (1.0) 0.7555 (1.14) 0.0000 (1.0) 0;0 1.3237 (0.87) 1 1
test_checkout_symlink-checkout-update[2.41.1] 0.6812 (1.03) 0.6812 (1.03) 0.6812 (1.03) 0.0000 (1.0) 0.6812 (1.03) 0.0000 (1.0) 0;0 1.4681 (0.97) 1 1
test_checkout_symlink-checkout-update[2.45.0] 0.7158 (1.08) 0.7158 (1.08) 0.7158 (1.08) 0.0000 (1.0) 0.7158 (1.08) 0.0000 (1.0) 0;0 1.3970 (0.92) 1 1
test_checkout_symlink-checkout-update[main] 0.7906 (1.20) 0.7906 (1.20) 0.7906 (1.20) 0.0000 (1.0) 0.7906 (1.20) 0.0000 (1.0) 0;0 1.2648 (0.84) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 502.3098 (1.0) 502.3098 (1.0) 502.3098 (1.0) 0.0000 (1.0) 502.3098 (1.0) 0.0000 (1.0) 0;0 1.9908 (1.0) 1 1
test_gc-gc[2.18.1] 528.5740 (1.05) 528.5740 (1.05) 528.5740 (1.05) 0.0000 (1.0) 528.5740 (1.05) 0.0000 (1.0) 0;0 1.8919 (0.95) 1 1
test_gc-gc[2.39.0] 564.7272 (1.12) 564.7272 (1.12) 564.7272 (1.12) 0.0000 (1.0) 564.7272 (1.12) 0.0000 (1.0) 0;0 1.7708 (0.89) 1 1
test_gc-gc[2.40.0] 582.3160 (1.16) 582.3160 (1.16) 582.3160 (1.16) 0.0000 (1.0) 582.3160 (1.16) 0.0000 (1.0) 0;0 1.7173 (0.86) 1 1
test_gc-gc[2.41.1] 597.4026 (1.19) 597.4026 (1.19) 597.4026 (1.19) 0.0000 (1.0) 597.4026 (1.19) 0.0000 (1.0) 0;0 1.6739 (0.84) 1 1
test_gc-gc[2.45.0] 569.4085 (1.13) 569.4085 (1.13) 569.4085 (1.13) 0.0000 (1.0) 569.4085 (1.13) 0.0000 (1.0) 0;0 1.7562 (0.88) 1 1
test_gc-gc[main] 634.8599 (1.26) 634.8599 (1.26) 634.8599 (1.26) 0.0000 (1.0) 634.8599 (1.26) 0.0000 (1.0) 0;0 1.5752 (0.79) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 2.7117 (1.0) 2.7117 (1.0) 2.7117 (1.0) 0.0000 (1.0) 2.7117 (1.0) 0.0000 (1.0) 0;0 0.3688 (1.0) 1 1
test_get_url-get-url[2.18.1] 2.7456 (1.01) 2.7456 (1.01) 2.7456 (1.01) 0.0000 (1.0) 2.7456 (1.01) 0.0000 (1.0) 0;0 0.3642 (0.99) 1 1
test_get_url-get-url[2.39.0] 2.7955 (1.03) 2.7955 (1.03) 2.7955 (1.03) 0.0000 (1.0) 2.7955 (1.03) 0.0000 (1.0) 0;0 0.3577 (0.97) 1 1
test_get_url-get-url[2.40.0] 2.8069 (1.04) 2.8069 (1.04) 2.8069 (1.04) 0.0000 (1.0) 2.8069 (1.04) 0.0000 (1.0) 0;0 0.3563 (0.97) 1 1
test_get_url-get-url[2.41.1] 2.7822 (1.03) 2.7822 (1.03) 2.7822 (1.03) 0.0000 (1.0) 2.7822 (1.03) 0.0000 (1.0) 0;0 0.3594 (0.97) 1 1
test_get_url-get-url[2.45.0] 2.8115 (1.04) 2.8115 (1.04) 2.8115 (1.04) 0.0000 (1.0) 2.8115 (1.04) 0.0000 (1.0) 0;0 0.3557 (0.96) 1 1
test_get_url-get-url[main] 2.8729 (1.06) 2.8729 (1.06) 2.8729 (1.06) 0.0000 (1.0) 2.8729 (1.06) 0.0000 (1.0) 0;0 0.3481 (0.94) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0] 9.5103 (1.86) 9.5103 (1.86) 9.5103 (1.86) 0.0000 (1.0) 9.5103 (1.86) 0.0000 (1.0) 0;0 0.1051 (0.54) 1 1
test_sharing_s3-add[2.18.1] 8.1374 (1.59) 8.1374 (1.59) 8.1374 (1.59) 0.0000 (1.0) 8.1374 (1.59) 0.0000 (1.0) 0;0 0.1229 (0.63) 1 1
test_sharing_s3-add[2.39.0] 7.6439 (1.49) 7.6439 (1.49) 7.6439 (1.49) 0.0000 (1.0) 7.6439 (1.49) 0.0000 (1.0) 0;0 0.1308 (0.67) 1 1
test_sharing_s3-add[2.40.0] 7.6691 (1.50) 7.6691 (1.50) 7.6691 (1.50) 0.0000 (1.0) 7.6691 (1.50) 0.0000 (1.0) 0;0 0.1304 (0.67) 1 1
test_sharing_s3-add[2.41.1] 7.8752 (1.54) 7.8752 (1.54) 7.8752 (1.54) 0.0000 (1.0) 7.8752 (1.54) 0.0000 (1.0) 0;0 0.1270 (0.65) 1 1
test_sharing_s3-add[2.45.0] 5.1229 (1.0) 5.1229 (1.0) 5.1229 (1.0) 0.0000 (1.0) 5.1229 (1.0) 0.0000 (1.0) 0;0 0.1952 (1.0) 1 1
test_sharing_s3-add[main] 5.1628 (1.01) 5.1628 (1.01) 5.1628 (1.01) 0.0000 (1.0) 5.1628 (1.01) 0.0000 (1.0) 0;0 0.1937 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0] 4.3975 (1.39) 4.3975 (1.39) 4.3975 (1.39) 0.0000 (1.0) 4.3975 (1.39) 0.0000 (1.0) 0;0 0.2274 (0.72) 1 1
test_sharing_s3-add-noop[2.18.1] 4.7362 (1.50) 4.7362 (1.50) 4.7362 (1.50) 0.0000 (1.0) 4.7362 (1.50) 0.0000 (1.0) 0;0 0.2111 (0.67) 1 1
test_sharing_s3-add-noop[2.39.0] 3.1637 (1.00) 3.1637 (1.00) 3.1637 (1.00) 0.0000 (1.0) 3.1637 (1.00) 0.0000 (1.0) 0;0 0.3161 (1.00) 1 1
test_sharing_s3-add-noop[2.40.0] 3.1558 (1.0) 3.1558 (1.0) 3.1558 (1.0) 0.0000 (1.0) 3.1558 (1.0) 0.0000 (1.0) 0;0 0.3169 (1.0) 1 1
test_sharing_s3-add-noop[2.41.1] 3.2330 (1.02) 3.2330 (1.02) 3.2330 (1.02) 0.0000 (1.0) 3.2330 (1.02) 0.0000 (1.0) 0;0 0.3093 (0.98) 1 1
test_sharing_s3-add-noop[2.45.0] 3.3070 (1.05) 3.3070 (1.05) 3.3070 (1.05) 0.0000 (1.0) 3.3070 (1.05) 0.0000 (1.0) 0;0 0.3024 (0.95) 1 1
test_sharing_s3-add-noop[main] 3.4559 (1.10) 3.4559 (1.10) 3.4559 (1.10) 0.0000 (1.0) 3.4559 (1.10) 0.0000 (1.0) 0;0 0.2894 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0] 559.4176 (1.0) 559.4176 (1.0) 559.4176 (1.0) 0.0000 (1.0) 559.4176 (1.0) 0.0000 (1.0) 0;0 1.7876 (1.0) 1 1
test_sharing_s3-checkout-noop[2.18.1] 731.6317 (1.31) 731.6317 (1.31) 731.6317 (1.31) 0.0000 (1.0) 731.6317 (1.31) 0.0000 (1.0) 0;0 1.3668 (0.76) 1 1
test_sharing_s3-checkout-noop[2.39.0] 696.8345 (1.25) 696.8345 (1.25) 696.8345 (1.25) 0.0000 (1.0) 696.8345 (1.25) 0.0000 (1.0) 0;0 1.4351 (0.80) 1 1
test_sharing_s3-checkout-noop[2.40.0] 713.7381 (1.28) 713.7381 (1.28) 713.7381 (1.28) 0.0000 (1.0) 713.7381 (1.28) 0.0000 (1.0) 0;0 1.4011 (0.78) 1 1
test_sharing_s3-checkout-noop[2.41.1] 721.8776 (1.29) 721.8776 (1.29) 721.8776 (1.29) 0.0000 (1.0) 721.8776 (1.29) 0.0000 (1.0) 0;0 1.3853 (0.77) 1 1
test_sharing_s3-checkout-noop[2.45.0] 782.1612 (1.40) 782.1612 (1.40) 782.1612 (1.40) 0.0000 (1.0) 782.1612 (1.40) 0.0000 (1.0) 0;0 1.2785 (0.72) 1 1
test_sharing_s3-checkout-noop[main] 861.6141 (1.54) 861.6141 (1.54) 861.6141 (1.54) 0.0000 (1.0) 861.6141 (1.54) 0.0000 (1.0) 0;0 1.1606 (0.65) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0] 17.8386 (1.15) 17.8386 (1.15) 17.8386 (1.15) 0.0000 (1.0) 17.8386 (1.15) 0.0000 (1.0) 0;0 0.0561 (0.87) 1 1
test_sharing_s3-pull[2.18.1] 18.0332 (1.16) 18.0332 (1.16) 18.0332 (1.16) 0.0000 (1.0) 18.0332 (1.16) 0.0000 (1.0) 0;0 0.0555 (0.86) 1 1
test_sharing_s3-pull[2.39.0] 18.2936 (1.17) 18.2936 (1.17) 18.2936 (1.17) 0.0000 (1.0) 18.2936 (1.17) 0.0000 (1.0) 0;0 0.0547 (0.85) 1 1
test_sharing_s3-pull[2.40.0] 18.3984 (1.18) 18.3984 (1.18) 18.3984 (1.18) 0.0000 (1.0) 18.3984 (1.18) 0.0000 (1.0) 0;0 0.0544 (0.85) 1 1
test_sharing_s3-pull[2.41.1] 18.3154 (1.18) 18.3154 (1.18) 18.3154 (1.18) 0.0000 (1.0) 18.3154 (1.18) 0.0000 (1.0) 0;0 0.0546 (0.85) 1 1
test_sharing_s3-pull[2.45.0] 15.5787 (1.0) 15.5787 (1.0) 15.5787 (1.0) 0.0000 (1.0) 15.5787 (1.0) 0.0000 (1.0) 0;0 0.0642 (1.0) 1 1
test_sharing_s3-pull[main] 15.7280 (1.01) 15.7280 (1.01) 15.7280 (1.01) 0.0000 (1.0) 15.7280 (1.01) 0.0000 (1.0) 0;0 0.0636 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 7 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0] 834.6116 (1.0) 834.6116 (1.0) 834.6116 (1.0) 0.0000 (1.0) 834.6116 (1.0) 0.0000 (1.0) 0;0 1.1982 (1.0) 1 1
test_sharing_s3-pull-noop[2.18.1] 968.7757 (1.16) 968.7757 (1.16) 968.7757 (1.16) 0.0000 (1.0) 968.7757 (1.16) 0.0000 (1.0) 0;0 1.0322 (0.86) 1 1
test_sharing_s3-pull-noop[2.39.0] 973.3639 (1.17) 973.3639 (1.17) 973.3639 (1.17) 0.0000 (1.0) 973.3639 (1.17) 0.0000 (1.0) 0;0 1.0274 (0.86) 1 1
test_sharing_s3-pull-noop[2.40.0] 961.3679 (1.15) 961.3679 (1.15) 961.3679 (1.15) 0.0000 (1.0) 961.3679 (1.15) 0.0000 (1.0) 0;0 1.0402 (0.87) 1 1
test_sharing_s3-pull-noop[2.41.1] 958.1978 (1.15) 958.1978 (1.15) 958.1978 (1.15) 0.0000 (1.0) 958.1978 (1.15) 0.0000 (1.0) 0;0 1.0436 (0.87) 1 1
test_sharing_s3-pull-noop[2.45.0] 1,012.1405 (1.21) 1,012.1405 (1.21) 1,012.1405 (1.21) 0.0000 (1.0) 1,012.1405 (1.21) 0.0000 (1.0) 0;0 0.9880 (0.82) 1 1
test_sharing_s3-pull-noop[main] 1,125.1926 (1.35) 1,125.1926 (1.35) 1,125.1926 (1.35) 0.0000 (1.0) 1,125.1926 (1.35) 0.0000 (1.0) 0;0 0.8887 (0.74) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0] 26.2582 (2.43) 26.2582 (2.43) 26.2582 (2.43) 0.0000 (1.0) 26.2582 (2.43) 0.0000 (1.0) 0;0 0.0381 (0.41) 1 1
test_sharing_s3-push[2.18.1] 25.6083 (2.37) 25.6083 (2.37) 25.6083 (2.37) 0.0000 (1.0) 25.6083 (2.37) 0.0000 (1.0) 0;0 0.0390 (0.42) 1 1
test_sharing_s3-push[2.39.0] 26.5535 (2.46) 26.5535 (2.46) 26.5535 (2.46) 0.0000 (1.0) 26.5535 (2.46) 0.0000 (1.0) 0;0 0.0377 (0.41) 1 1
test_sharing_s3-push[2.40.0] 26.9015 (2.49) 26.9015 (2.49) 26.9015 (2.49) 0.0000 (1.0) 26.9015 (2.49) 0.0000 (1.0) 0;0 0.0372 (0.40) 1 1
test_sharing_s3-push[2.41.1] 14.4527 (1.34) 14.4527 (1.34) 14.4527 (1.34) 0.0000 (1.0) 14.4527 (1.34) 0.0000 (1.0) 0;0 0.0692 (0.75) 1 1
test_sharing_s3-push[2.45.0] 10.8802 (1.01) 10.8802 (1.01) 10.8802 (1.01) 0.0000 (1.0) 10.8802 (1.01) 0.0000 (1.0) 0;0 0.0919 (0.99) 1 1
test_sharing_s3-push[main] 10.7846 (1.0) 10.7846 (1.0) 10.7846 (1.0) 0.0000 (1.0) 10.7846 (1.0) 0.0000 (1.0) 0;0 0.0927 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0] 1.0811 (1.01) 1.0811 (1.01) 1.0811 (1.01) 0.0000 (1.0) 1.0811 (1.01) 0.0000 (1.0) 0;0 0.9250 (0.99) 1 1
test_sharing_s3-push-noop[2.18.1] 1.0718 (1.0) 1.0718 (1.0) 1.0718 (1.0) 0.0000 (1.0) 1.0718 (1.0) 0.0000 (1.0) 0;0 0.9330 (1.0) 1 1
test_sharing_s3-push-noop[2.39.0] 1.0901 (1.02) 1.0901 (1.02) 1.0901 (1.02) 0.0000 (1.0) 1.0901 (1.02) 0.0000 (1.0) 0;0 0.9174 (0.98) 1 1
test_sharing_s3-push-noop[2.40.0] 1.1212 (1.05) 1.1212 (1.05) 1.1212 (1.05) 0.0000 (1.0) 1.1212 (1.05) 0.0000 (1.0) 0;0 0.8919 (0.96) 1 1
test_sharing_s3-push-noop[2.41.1] 1.1358 (1.06) 1.1358 (1.06) 1.1358 (1.06) 0.0000 (1.0) 1.1358 (1.06) 0.0000 (1.0) 0;0 0.8804 (0.94) 1 1
test_sharing_s3-push-noop[2.45.0] 1.0929 (1.02) 1.0929 (1.02) 1.0929 (1.02) 0.0000 (1.0) 1.0929 (1.02) 0.0000 (1.0) 0;0 0.9150 (0.98) 1 1
test_sharing_s3-push-noop[main] 1.2151 (1.13) 1.2151 (1.13) 1.2151 (1.13) 0.0000 (1.0) 1.2151 (1.13) 0.0000 (1.0) 0;0 0.8230 (0.88) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 17.9902 (1.48) 17.9902 (1.48) 17.9902 (1.48) 0.0000 (1.0) 17.9902 (1.48) 0.0000 (1.0) 0;0 0.0556 (0.67) 1 1
test_import_url-import-url[2.18.1] 15.2874 (1.26) 15.2874 (1.26) 15.2874 (1.26) 0.0000 (1.0) 15.2874 (1.26) 0.0000 (1.0) 0;0 0.0654 (0.79) 1 1
test_import_url-import-url[2.39.0] 15.9840 (1.32) 15.9840 (1.32) 15.9840 (1.32) 0.0000 (1.0) 15.9840 (1.32) 0.0000 (1.0) 0;0 0.0626 (0.76) 1 1
test_import_url-import-url[2.40.0] 15.1582 (1.25) 15.1582 (1.25) 15.1582 (1.25) 0.0000 (1.0) 15.1582 (1.25) 0.0000 (1.0) 0;0 0.0660 (0.80) 1 1
test_import_url-import-url[2.41.1] 15.7242 (1.30) 15.7242 (1.30) 15.7242 (1.30) 0.0000 (1.0) 15.7242 (1.30) 0.0000 (1.0) 0;0 0.0636 (0.77) 1 1
test_import_url-import-url[2.45.0] 12.1421 (1.0) 12.1421 (1.0) 12.1421 (1.0) 0.0000 (1.0) 12.1421 (1.0) 0.0000 (1.0) 0;0 0.0824 (1.0) 1 1
test_import_url-import-url[main] 12.7259 (1.05) 12.7259 (1.05) 12.7259 (1.05) 0.0000 (1.0) 12.7259 (1.05) 0.0000 (1.0) 0;0 0.0786 (0.95) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 2.2455 (1.59) 2.2455 (1.59) 2.2455 (1.59) 0.0000 (1.0) 2.2455 (1.59) 0.0000 (1.0) 0;0 0.4453 (0.63) 1 1
test_status-status[2.18.1] 1.4165 (1.0) 1.4165 (1.0) 1.4165 (1.0) 0.0000 (1.0) 1.4165 (1.0) 0.0000 (1.0) 0;0 0.7059 (1.0) 1 1
test_status-status[2.39.0] 1.4444 (1.02) 1.4444 (1.02) 1.4444 (1.02) 0.0000 (1.0) 1.4444 (1.02) 0.0000 (1.0) 0;0 0.6923 (0.98) 1 1
test_status-status[2.40.0] 1.4450 (1.02) 1.4450 (1.02) 1.4450 (1.02) 0.0000 (1.0) 1.4450 (1.02) 0.0000 (1.0) 0;0 0.6920 (0.98) 1 1
test_status-status[2.41.1] 1.4416 (1.02) 1.4416 (1.02) 1.4416 (1.02) 0.0000 (1.0) 1.4416 (1.02) 0.0000 (1.0) 0;0 0.6937 (0.98) 1 1
test_status-status[2.45.0] 1.4208 (1.00) 1.4208 (1.00) 1.4208 (1.00) 0.0000 (1.0) 1.4208 (1.00) 0.0000 (1.0) 0;0 0.7038 (1.00) 1 1
test_status-status[main] 1.4631 (1.03) 1.4631 (1.03) 1.4631 (1.03) 0.0000 (1.0) 1.4631 (1.03) 0.0000 (1.0) 0;0 0.6835 (0.97) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 1.5936 (2.89) 1.5936 (2.89) 1.5936 (2.89) 0.0000 (1.0) 1.5936 (2.89) 0.0000 (1.0) 0;0 0.6275 (0.35) 1 1
test_status-status-changed[2.18.1] 0.5510 (1.0) 0.5510 (1.0) 0.5510 (1.0) 0.0000 (1.0) 0.5510 (1.0) 0.0000 (1.0) 0;0 1.8148 (1.0) 1 1
test_status-status-changed[2.39.0] 0.8954 (1.62) 0.8954 (1.62) 0.8954 (1.62) 0.0000 (1.0) 0.8954 (1.62) 0.0000 (1.0) 0;0 1.1169 (0.62) 1 1
test_status-status-changed[2.40.0] 0.6424 (1.17) 0.6424 (1.17) 0.6424 (1.17) 0.0000 (1.0) 0.6424 (1.17) 0.0000 (1.0) 0;0 1.5568 (0.86) 1 1
test_status-status-changed[2.41.1] 0.5630 (1.02) 0.5630 (1.02) 0.5630 (1.02) 0.0000 (1.0) 0.5630 (1.02) 0.0000 (1.0) 0;0 1.7763 (0.98) 1 1
test_status-status-changed[2.45.0] 0.5903 (1.07) 0.5903 (1.07) 0.5903 (1.07) 0.0000 (1.0) 0.5903 (1.07) 0.0000 (1.0) 0;0 1.6940 (0.93) 1 1
test_status-status-changed[main] 0.6684 (1.21) 0.6684 (1.21) 0.6684 (1.21) 0.0000 (1.0) 0.6684 (1.21) 0.0000 (1.0) 0;0 1.4960 (0.82) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 691.9730 (1.27) 691.9730 (1.27) 691.9730 (1.27) 0.0000 (1.0) 691.9730 (1.27) 0.0000 (1.0) 0;0 1.4451 (0.79) 1 1
test_status-status-changed-noop[2.18.1] 545.6239 (1.0) 545.6239 (1.0) 545.6239 (1.0) 0.0000 (1.0) 545.6239 (1.0) 0.0000 (1.0) 0;0 1.8328 (1.0) 1 1
test_status-status-changed-noop[2.39.0] 568.1365 (1.04) 568.1365 (1.04) 568.1365 (1.04) 0.0000 (1.0) 568.1365 (1.04) 0.0000 (1.0) 0;0 1.7601 (0.96) 1 1
test_status-status-changed-noop[2.40.0] 571.7096 (1.05) 571.7096 (1.05) 571.7096 (1.05) 0.0000 (1.0) 571.7096 (1.05) 0.0000 (1.0) 0;0 1.7491 (0.95) 1 1
test_status-status-changed-noop[2.41.1] 557.0085 (1.02) 557.0085 (1.02) 557.0085 (1.02) 0.0000 (1.0) 557.0085 (1.02) 0.0000 (1.0) 0;0 1.7953 (0.98) 1 1
test_status-status-changed-noop[2.45.0] 962.6623 (1.76) 962.6623 (1.76) 962.6623 (1.76) 0.0000 (1.0) 962.6623 (1.76) 0.0000 (1.0) 0;0 1.0388 (0.57) 1 1
test_status-status-changed-noop[main] 661.3041 (1.21) 661.3041 (1.21) 661.3041 (1.21) 0.0000 (1.0) 661.3041 (1.21) 0.0000 (1.0) 0;0 1.5122 (0.83) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 463.6734 (1.0) 463.6734 (1.0) 463.6734 (1.0) 0.0000 (1.0) 463.6734 (1.0) 0.0000 (1.0) 0;0 2.1567 (1.0) 1 1
test_status-status-noop[2.18.1] 546.4091 (1.18) 546.4091 (1.18) 546.4091 (1.18) 0.0000 (1.0) 546.4091 (1.18) 0.0000 (1.0) 0;0 1.8301 (0.85) 1 1
test_status-status-noop[2.39.0] 583.5726 (1.26) 583.5726 (1.26) 583.5726 (1.26) 0.0000 (1.0) 583.5726 (1.26) 0.0000 (1.0) 0;0 1.7136 (0.79) 1 1
test_status-status-noop[2.40.0] 633.6126 (1.37) 633.6126 (1.37) 633.6126 (1.37) 0.0000 (1.0) 633.6126 (1.37) 0.0000 (1.0) 0;0 1.5783 (0.73) 1 1
test_status-status-noop[2.41.1] 872.6118 (1.88) 872.6118 (1.88) 872.6118 (1.88) 0.0000 (1.0) 872.6118 (1.88) 0.0000 (1.0) 0;0 1.1460 (0.53) 1 1
test_status-status-noop[2.45.0] 581.1756 (1.25) 581.1756 (1.25) 581.1756 (1.25) 0.0000 (1.0) 581.1756 (1.25) 0.0000 (1.0) 0;0 1.7207 (0.80) 1 1
test_status-status-noop[main] 663.5069 (1.43) 663.5069 (1.43) 663.5069 (1.43) 0.0000 (1.0) 663.5069 (1.43) 0.0000 (1.0) 0;0 1.5071 (0.70) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_pull-pull': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 8.4838 (1.05) 8.4838 (1.05) 8.4838 (1.05) 0.0000 (1.0) 8.4838 (1.05) 0.0000 (1.0) 0;0 0.1179 (0.95) 1 1
test_pull-pull[2.18.1] 8.8568 (1.10) 8.8568 (1.10) 8.8568 (1.10) 0.0000 (1.0) 8.8568 (1.10) 0.0000 (1.0) 0;0 0.1129 (0.91) 1 1
test_pull-pull[2.39.0] 10.0870 (1.25) 10.0870 (1.25) 10.0870 (1.25) 0.0000 (1.0) 10.0870 (1.25) 0.0000 (1.0) 0;0 0.0991 (0.80) 1 1
test_pull-pull[2.40.0] 10.3087 (1.28) 10.3087 (1.28) 10.3087 (1.28) 0.0000 (1.0) 10.3087 (1.28) 0.0000 (1.0) 0;0 0.0970 (0.78) 1 1
test_pull-pull[2.41.1] 10.0161 (1.24) 10.0161 (1.24) 10.0161 (1.24) 0.0000 (1.0) 10.0161 (1.24) 0.0000 (1.0) 0;0 0.0998 (0.80) 1 1
test_pull-pull[2.45.0] 8.0619 (1.0) 8.0619 (1.0) 8.0619 (1.0) 0.0000 (1.0) 8.0619 (1.0) 0.0000 (1.0) 0;0 0.1240 (1.0) 1 1
test_pull-pull[main] 8.1945 (1.02) 8.1945 (1.02) 8.1945 (1.02) 0.0000 (1.0) 8.1945 (1.02) 0.0000 (1.0) 0;0 0.1220 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 7.0428 (1.79) 7.0428 (1.79) 7.0428 (1.79) 0.0000 (1.0) 7.0428 (1.79) 0.0000 (1.0) 0;0 0.1420 (0.56) 1 1
test_add-add[2.18.1] 6.2150 (1.58) 6.2150 (1.58) 6.2150 (1.58) 0.0000 (1.0) 6.2150 (1.58) 0.0000 (1.0) 0;0 0.1609 (0.63) 1 1
test_add-add[2.39.0] 6.0010 (1.53) 6.0010 (1.53) 6.0010 (1.53) 0.0000 (1.0) 6.0010 (1.53) 0.0000 (1.0) 0;0 0.1666 (0.65) 1 1
test_add-add[2.40.0] 5.9735 (1.52) 5.9735 (1.52) 5.9735 (1.52) 0.0000 (1.0) 5.9735 (1.52) 0.0000 (1.0) 0;0 0.1674 (0.66) 1 1
test_add-add[2.41.1] 6.0797 (1.55) 6.0797 (1.55) 6.0797 (1.55) 0.0000 (1.0) 6.0797 (1.55) 0.0000 (1.0) 0;0 0.1645 (0.65) 1 1
test_add-add[2.45.0] 4.3054 (1.10) 4.3054 (1.10) 4.3054 (1.10) 0.0000 (1.0) 4.3054 (1.10) 0.0000 (1.0) 0;0 0.2323 (0.91) 1 1
test_add-add[main] 3.9259 (1.0) 3.9259 (1.0) 3.9259 (1.0) 0.0000 (1.0) 3.9259 (1.0) 0.0000 (1.0) 0;0 0.2547 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_init-init': 7 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 371.3769 (1.0) 425.0802 (1.0) 393.8446 (1.0) 11.8994 (1.0) 390.7297 (1.0) 15.2774 (1.0) 29;1 2.5391 (1.0) 100 1
test_init-init[2.18.1] 384.3330 (1.03) 510.7362 (1.20) 404.2024 (1.03) 16.7614 (1.41) 400.0664 (1.02) 19.8822 (1.30) 11;2 2.4740 (0.97) 100 1
test_init-init[2.39.0] 446.1435 (1.20) 503.2543 (1.18) 467.9079 (1.19) 12.4033 (1.04) 465.3891 (1.19) 15.9580 (1.04) 34;3 2.1372 (0.84) 100 1
test_init-init[2.40.0] 446.4891 (1.20) 507.0111 (1.19) 473.6588 (1.20) 13.6925 (1.15) 470.9897 (1.21) 21.3219 (1.40) 36;0 2.1112 (0.83) 100 1
test_init-init[2.41.1] 454.3051 (1.22) 537.4452 (1.26) 476.6378 (1.21) 16.7370 (1.41) 473.3382 (1.21) 20.4082 (1.34) 30;4 2.0980 (0.83) 100 1
test_init-init[2.45.0] 439.8941 (1.18) 580.4206 (1.37) 470.6692 (1.20) 17.2057 (1.45) 468.2072 (1.20) 15.4121 (1.01) 19;4 2.1246 (0.84) 100 1
test_init-init[main] 554.9403 (1.49) 620.9180 (1.46) 578.9115 (1.47) 14.3721 (1.21) 575.7559 (1.47) 22.4679 (1.47) 38;0 1.7274 (0.68) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 4.1256 (1.16) 4.1256 (1.16) 4.1256 (1.16) 0.0000 (1.0) 4.1256 (1.16) 0.0000 (1.0) 0;0 0.2424 (0.87) 1 1
test_push-push[2.18.1] 3.9509 (1.11) 3.9509 (1.11) 3.9509 (1.11) 0.0000 (1.0) 3.9509 (1.11) 0.0000 (1.0) 0;0 0.2531 (0.90) 1 1
test_push-push[2.39.0] 5.1774 (1.45) 5.1774 (1.45) 5.1774 (1.45) 0.0000 (1.0) 5.1774 (1.45) 0.0000 (1.0) 0;0 0.1931 (0.69) 1 1
test_push-push[2.40.0] 5.0778 (1.42) 5.0778 (1.42) 5.0778 (1.42) 0.0000 (1.0) 5.0778 (1.42) 0.0000 (1.0) 0;0 0.1969 (0.70) 1 1
test_push-push[2.41.1] 5.0910 (1.43) 5.0910 (1.43) 5.0910 (1.43) 0.0000 (1.0) 5.0910 (1.43) 0.0000 (1.0) 0;0 0.1964 (0.70) 1 1
test_push-push[2.45.0] 3.6144 (1.01) 3.6144 (1.01) 3.6144 (1.01) 0.0000 (1.0) 3.6144 (1.01) 0.0000 (1.0) 0;0 0.2767 (0.99) 1 1
test_push-push[main] 3.5702 (1.0) 3.5702 (1.0) 3.5702 (1.0) 0.0000 (1.0) 3.5702 (1.0) 0.0000 (1.0) 0;0 0.2801 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.7806 (1.10) 1.7806 (1.10) 1.7806 (1.10) 0.0000 (1.0) 1.7806 (1.10) 0.0000 (1.0) 0;0 0.5616 (0.91) 1 1
test_checkout_hardlink-checkout[2.18.1] 1.7100 (1.05) 1.7100 (1.05) 1.7100 (1.05) 0.0000 (1.0) 1.7100 (1.05) 0.0000 (1.0) 0;0 0.5848 (0.95) 1 1
test_checkout_hardlink-checkout[2.39.0] 1.8060 (1.11) 1.8060 (1.11) 1.8060 (1.11) 0.0000 (1.0) 1.8060 (1.11) 0.0000 (1.0) 0;0 0.5537 (0.90) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.6227 (1.0) 1.6227 (1.0) 1.6227 (1.0) 0.0000 (1.0) 1.6227 (1.0) 0.0000 (1.0) 0;0 0.6163 (1.0) 1 1
test_checkout_hardlink-checkout[2.41.1] 1.6489 (1.02) 1.6489 (1.02) 1.6489 (1.02) 0.0000 (1.0) 1.6489 (1.02) 0.0000 (1.0) 0;0 0.6065 (0.98) 1 1
test_checkout_hardlink-checkout[2.45.0] 2.0853 (1.29) 2.0853 (1.29) 2.0853 (1.29) 0.0000 (1.0) 2.0853 (1.29) 0.0000 (1.0) 0;0 0.4796 (0.78) 1 1
test_checkout_hardlink-checkout[main] 2.3296 (1.44) 2.3296 (1.44) 2.3296 (1.44) 0.0000 (1.0) 2.3296 (1.44) 0.0000 (1.0) 0;0 0.4293 (0.70) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 652.8114 (1.0) 652.8114 (1.0) 652.8114 (1.0) 0.0000 (1.0) 652.8114 (1.0) 0.0000 (1.0) 0;0 1.5318 (1.0) 1 1
test_checkout_hardlink-checkout-noop[2.18.1] 744.3571 (1.14) 744.3571 (1.14) 744.3571 (1.14) 0.0000 (1.0) 744.3571 (1.14) 0.0000 (1.0) 0;0 1.3434 (0.88) 1 1
test_checkout_hardlink-checkout-noop[2.39.0] 849.8997 (1.30) 849.8997 (1.30) 849.8997 (1.30) 0.0000 (1.0) 849.8997 (1.30) 0.0000 (1.0) 0;0 1.1766 (0.77) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 790.5926 (1.21) 790.5926 (1.21) 790.5926 (1.21) 0.0000 (1.0) 790.5926 (1.21) 0.0000 (1.0) 0;0 1.2649 (0.83) 1 1
test_checkout_hardlink-checkout-noop[2.41.1] 788.7115 (1.21) 788.7115 (1.21) 788.7115 (1.21) 0.0000 (1.0) 788.7115 (1.21) 0.0000 (1.0) 0;0 1.2679 (0.83) 1 1
test_checkout_hardlink-checkout-noop[2.45.0] 830.7925 (1.27) 830.7925 (1.27) 830.7925 (1.27) 0.0000 (1.0) 830.7925 (1.27) 0.0000 (1.0) 0;0 1.2037 (0.79) 1 1
test_checkout_hardlink-checkout-noop[main] 990.2064 (1.52) 990.2064 (1.52) 990.2064 (1.52) 0.0000 (1.0) 990.2064 (1.52) 0.0000 (1.0) 0;0 1.0099 (0.66) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.7056 (1.96) 1.7056 (1.96) 1.7056 (1.96) 0.0000 (1.0) 1.7056 (1.96) 0.0000 (1.0) 0;0 0.5863 (0.51) 1 1
test_checkout_hardlink-checkout-update[2.18.1] 0.8813 (1.01) 0.8813 (1.01) 0.8813 (1.01) 0.0000 (1.0) 0.8813 (1.01) 0.0000 (1.0) 0;0 1.1347 (0.99) 1 1
test_checkout_hardlink-checkout-update[2.39.0] 0.9655 (1.11) 0.9655 (1.11) 0.9655 (1.11) 0.0000 (1.0) 0.9655 (1.11) 0.0000 (1.0) 0;0 1.0358 (0.90) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.8688 (1.0) 0.8688 (1.0) 0.8688 (1.0) 0.0000 (1.0) 0.8688 (1.0) 0.0000 (1.0) 0;0 1.1510 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.41.1] 0.8769 (1.01) 0.8769 (1.01) 0.8769 (1.01) 0.0000 (1.0) 0.8769 (1.01) 0.0000 (1.0) 0;0 1.1404 (0.99) 1 1
test_checkout_hardlink-checkout-update[2.45.0] 0.9002 (1.04) 0.9002 (1.04) 0.9002 (1.04) 0.0000 (1.0) 0.9002 (1.04) 0.0000 (1.0) 0;0 1.1109 (0.97) 1 1
test_checkout_hardlink-checkout-update[main] 1.0575 (1.22) 1.0575 (1.22) 1.0575 (1.22) 0.0000 (1.0) 1.0575 (1.22) 0.0000 (1.0) 0;0 0.9456 (0.82) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_update-update': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 12.2672 (1.31) 12.2672 (1.31) 12.2672 (1.31) 0.0000 (1.0) 12.2672 (1.31) 0.0000 (1.0) 0;0 0.0815 (0.76) 1 1
test_update-update[2.18.1] 11.2620 (1.21) 11.2620 (1.21) 11.2620 (1.21) 0.0000 (1.0) 11.2620 (1.21) 0.0000 (1.0) 0;0 0.0888 (0.83) 1 1
test_update-update[2.39.0] 10.1098 (1.08) 10.1098 (1.08) 10.1098 (1.08) 0.0000 (1.0) 10.1098 (1.08) 0.0000 (1.0) 0;0 0.0989 (0.92) 1 1
test_update-update[2.40.0] 10.2418 (1.10) 10.2418 (1.10) 10.2418 (1.10) 0.0000 (1.0) 10.2418 (1.10) 0.0000 (1.0) 0;0 0.0976 (0.91) 1 1
test_update-update[2.41.1] 10.1012 (1.08) 10.1012 (1.08) 10.1012 (1.08) 0.0000 (1.0) 10.1012 (1.08) 0.0000 (1.0) 0;0 0.0990 (0.92) 1 1
test_update-update[2.45.0] 10.0295 (1.07) 10.0295 (1.07) 10.0295 (1.07) 0.0000 (1.0) 10.0295 (1.07) 0.0000 (1.0) 0;0 0.0997 (0.93) 1 1
test_update-update[main] 9.3317 (1.0) 9.3317 (1.0) 9.3317 (1.0) 0.0000 (1.0) 9.3317 (1.0) 0.0000 (1.0) 0;0 0.1072 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 7 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 594.2371 (1.0) 594.2371 (1.0) 594.2371 (1.0) 0.0000 (1.0) 594.2371 (1.0) 0.0000 (1.0) 0;0 1.6828 (1.0) 1 1
test_update-update-noop[2.18.1] 898.8143 (1.51) 898.8143 (1.51) 898.8143 (1.51) 0.0000 (1.0) 898.8143 (1.51) 0.0000 (1.0) 0;0 1.1126 (0.66) 1 1
test_update-update-noop[2.39.0] 1,385.4756 (2.33) 1,385.4756 (2.33) 1,385.4756 (2.33) 0.0000 (1.0) 1,385.4756 (2.33) 0.0000 (1.0) 0;0 0.7218 (0.43) 1 1
test_update-update-noop[2.40.0] 1,394.0062 (2.35) 1,394.0062 (2.35) 1,394.0062 (2.35) 0.0000 (1.0) 1,394.0062 (2.35) 0.0000 (1.0) 0;0 0.7174 (0.43) 1 1
test_update-update-noop[2.41.1] 1,401.7299 (2.36) 1,401.7299 (2.36) 1,401.7299 (2.36) 0.0000 (1.0) 1,401.7299 (2.36) 0.0000 (1.0) 0;0 0.7134 (0.42) 1 1
test_update-update-noop[2.45.0] 1,539.6320 (2.59) 1,539.6320 (2.59) 1,539.6320 (2.59) 0.0000 (1.0) 1,539.6320 (2.59) 0.0000 (1.0) 0;0 0.6495 (0.39) 1 1
test_update-update-noop[main] 1,620.4116 (2.73) 1,620.4116 (2.73) 1,620.4116 (2.73) 0.0000 (1.0) 1,620.4116 (2.73) 0.0000 (1.0) 0;0 0.6171 (0.37) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.18.1] 636.9925 (1.02) 636.9925 (1.02) 636.9925 (1.02) 0.0000 (1.0) 636.9925 (1.02) 0.0000 (1.0) 0;0 1.5699 (0.98) 1 1
test_data_status-data-changed[2.39.0] 674.0733 (1.08) 674.0733 (1.08) 674.0733 (1.08) 0.0000 (1.0) 674.0733 (1.08) 0.0000 (1.0) 0;0 1.4835 (0.92) 1 1
test_data_status-data-changed[2.40.0] 770.6953 (1.24) 770.6953 (1.24) 770.6953 (1.24) 0.0000 (1.0) 770.6953 (1.24) 0.0000 (1.0) 0;0 1.2975 (0.81) 1 1
test_data_status-data-changed[2.41.1] 704.3811 (1.13) 704.3811 (1.13) 704.3811 (1.13) 0.0000 (1.0) 704.3811 (1.13) 0.0000 (1.0) 0;0 1.4197 (0.88) 1 1
test_data_status-data-changed[2.45.0] 623.1466 (1.0) 623.1466 (1.0) 623.1466 (1.0) 0.0000 (1.0) 623.1466 (1.0) 0.0000 (1.0) 0;0 1.6048 (1.0) 1 1
test_data_status-data-changed[main] 683.3374 (1.10) 683.3374 (1.10) 683.3374 (1.10) 0.0000 (1.0) 683.3374 (1.10) 0.0000 (1.0) 0;0 1.4634 (0.91) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.18.1] 646.2013 (1.03) 646.2013 (1.03) 646.2013 (1.03) 0.0000 (1.0) 646.2013 (1.03) 0.0000 (1.0) 0;0 1.5475 (0.97) 1 1
test_data_status-data-changed-noop[2.39.0] 670.3187 (1.07) 670.3187 (1.07) 670.3187 (1.07) 0.0000 (1.0) 670.3187 (1.07) 0.0000 (1.0) 0;0 1.4918 (0.93) 1 1
test_data_status-data-changed-noop[2.40.0] 672.0959 (1.08) 672.0959 (1.08) 672.0959 (1.08) 0.0000 (1.0) 672.0959 (1.08) 0.0000 (1.0) 0;0 1.4879 (0.93) 1 1
test_data_status-data-changed-noop[2.41.1] 705.1258 (1.13) 705.1258 (1.13) 705.1258 (1.13) 0.0000 (1.0) 705.1258 (1.13) 0.0000 (1.0) 0;0 1.4182 (0.89) 1 1
test_data_status-data-changed-noop[2.45.0] 624.6593 (1.0) 624.6593 (1.0) 624.6593 (1.0) 0.0000 (1.0) 624.6593 (1.0) 0.0000 (1.0) 0;0 1.6009 (1.0) 1 1
test_data_status-data-changed-noop[main] 677.9800 (1.09) 677.9800 (1.09) 677.9800 (1.09) 0.0000 (1.0) 677.9800 (1.09) 0.0000 (1.0) 0;0 1.4750 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.18.1] 1.4039 (1.01) 1.4039 (1.01) 1.4039 (1.01) 0.0000 (1.0) 1.4039 (1.01) 0.0000 (1.0) 0;0 0.7123 (0.99) 1 1
test_data_status-data-new[2.39.0] 1.4264 (1.03) 1.4264 (1.03) 1.4264 (1.03) 0.0000 (1.0) 1.4264 (1.03) 0.0000 (1.0) 0;0 0.7010 (0.97) 1 1
test_data_status-data-new[2.40.0] 1.4292 (1.03) 1.4292 (1.03) 1.4292 (1.03) 0.0000 (1.0) 1.4292 (1.03) 0.0000 (1.0) 0;0 0.6997 (0.97) 1 1
test_data_status-data-new[2.41.1] 1.4633 (1.06) 1.4633 (1.06) 1.4633 (1.06) 0.0000 (1.0) 1.4633 (1.06) 0.0000 (1.0) 0;0 0.6834 (0.95) 1 1
test_data_status-data-new[2.45.0] 1.4123 (1.02) 1.4123 (1.02) 1.4123 (1.02) 0.0000 (1.0) 1.4123 (1.02) 0.0000 (1.0) 0;0 0.7081 (0.98) 1 1
test_data_status-data-new[main] 1.3838 (1.0) 1.3838 (1.0) 1.3838 (1.0) 0.0000 (1.0) 1.3838 (1.0) 0.0000 (1.0) 0;0 0.7227 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.18.1] 630.3246 (1.01) 630.3246 (1.01) 630.3246 (1.01) 0.0000 (1.0) 630.3246 (1.01) 0.0000 (1.0) 0;0 1.5865 (0.99) 1 1
test_data_status-data-noop[2.39.0] 665.1167 (1.07) 665.1167 (1.07) 665.1167 (1.07) 0.0000 (1.0) 665.1167 (1.07) 0.0000 (1.0) 0;0 1.5035 (0.94) 1 1
test_data_status-data-noop[2.40.0] 686.2973 (1.10) 686.2973 (1.10) 686.2973 (1.10) 0.0000 (1.0) 686.2973 (1.10) 0.0000 (1.0) 0;0 1.4571 (0.91) 1 1
test_data_status-data-noop[2.41.1] 688.5284 (1.10) 688.5284 (1.10) 688.5284 (1.10) 0.0000 (1.0) 688.5284 (1.10) 0.0000 (1.0) 0;0 1.4524 (0.91) 1 1
test_data_status-data-noop[2.45.0] 624.1374 (1.0) 624.1374 (1.0) 624.1374 (1.0) 0.0000 (1.0) 624.1374 (1.0) 0.0000 (1.0) 0;0 1.6022 (1.0) 1 1
test_data_status-data-noop[main] 680.0202 (1.09) 680.0202 (1.09) 680.0202 (1.09) 0.0000 (1.0) 680.0202 (1.09) 0.0000 (1.0) 0;0 1.4705 (0.92) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.11.0] 4.6384 (1.11) 4.6384 (1.11) 4.6384 (1.11) 0.0000 (1.0) 4.6384 (1.11) 0.0000 (1.0) 0;0 0.2156 (0.90) 1 1
test_exp_show-exp[2.18.1] 4.9129 (1.17) 4.9129 (1.17) 4.9129 (1.17) 0.0000 (1.0) 4.9129 (1.17) 0.0000 (1.0) 0;0 0.2035 (0.85) 1 1
test_exp_show-exp[2.39.0] 4.3707 (1.04) 4.3707 (1.04) 4.3707 (1.04) 0.0000 (1.0) 4.3707 (1.04) 0.0000 (1.0) 0;0 0.2288 (0.96) 1 1
test_exp_show-exp[2.40.0] 4.2828 (1.02) 4.2828 (1.02) 4.2828 (1.02) 0.0000 (1.0) 4.2828 (1.02) 0.0000 (1.0) 0;0 0.2335 (0.98) 1 1
test_exp_show-exp[2.41.1] 4.1940 (1.0) 4.1940 (1.0) 4.1940 (1.0) 0.0000 (1.0) 4.1940 (1.0) 0.0000 (1.0) 0;0 0.2384 (1.0) 1 1
test_exp_show-exp[2.45.0] 4.2870 (1.02) 4.2870 (1.02) 4.2870 (1.02) 0.0000 (1.0) 4.2870 (1.02) 0.0000 (1.0) 0;0 0.2333 (0.98) 1 1
test_exp_show-exp[main] 5.4957 (1.31) 5.4957 (1.31) 5.4957 (1.31) 0.0000 (1.0) 5.4957 (1.31) 0.0000 (1.0) 0;0 0.1820 (0.76) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 504.5248 (1.03) 504.5248 (1.03) 504.5248 (1.03) 0.0000 (1.0) 504.5248 (1.03) 0.0000 (1.0) 0;0 1.9821 (0.97) 1 1
test_list-list[2.18.1] 493.3141 (1.01) 493.3141 (1.01) 493.3141 (1.01) 0.0000 (1.0) 493.3141 (1.01) 0.0000 (1.0) 0;0 2.0271 (0.99) 1 1
test_list-list[2.39.0] 507.0227 (1.04) 507.0227 (1.04) 507.0227 (1.04) 0.0000 (1.0) 507.0227 (1.04) 0.0000 (1.0) 0;0 1.9723 (0.96) 1 1
test_list-list[2.40.0] 487.7164 (1.0) 487.7164 (1.0) 487.7164 (1.0) 0.0000 (1.0) 487.7164 (1.0) 0.0000 (1.0) 0;0 2.0504 (1.0) 1 1
test_list-list[2.41.1] 504.0518 (1.03) 504.0518 (1.03) 504.0518 (1.03) 0.0000 (1.0) 504.0518 (1.03) 0.0000 (1.0) 0;0 1.9839 (0.97) 1 1
test_list-list[2.45.0] 518.3021 (1.06) 518.3021 (1.06) 518.3021 (1.06) 0.0000 (1.0) 518.3021 (1.06) 0.0000 (1.0) 0;0 1.9294 (0.94) 1 1
test_list-list[main] 628.0403 (1.29) 628.0403 (1.29) 628.0403 (1.29) 0.0000 (1.0) 628.0403 (1.29) 0.0000 (1.0) 0;0 1.5923 (0.78) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 514.3168 (1.09) 514.3168 (1.09) 514.3168 (1.09) 0.0000 (1.0) 514.3168 (1.09) 0.0000 (1.0) 0;0 1.9443 (0.92) 1 1
test_list-list-dvc-only[2.18.1] 490.2903 (1.04) 490.2903 (1.04) 490.2903 (1.04) 0.0000 (1.0) 490.2903 (1.04) 0.0000 (1.0) 0;0 2.0396 (0.97) 1 1
test_list-list-dvc-only[2.39.0] 491.0327 (1.04) 491.0327 (1.04) 491.0327 (1.04) 0.0000 (1.0) 491.0327 (1.04) 0.0000 (1.0) 0;0 2.0365 (0.96) 1 1
test_list-list-dvc-only[2.40.0] 473.1559 (1.0) 473.1559 (1.0) 473.1559 (1.0) 0.0000 (1.0) 473.1559 (1.0) 0.0000 (1.0) 0;0 2.1135 (1.0) 1 1
test_list-list-dvc-only[2.41.1] 494.8292 (1.05) 494.8292 (1.05) 494.8292 (1.05) 0.0000 (1.0) 494.8292 (1.05) 0.0000 (1.0) 0;0 2.0209 (0.96) 1 1
test_list-list-dvc-only[2.45.0] 495.5883 (1.05) 495.5883 (1.05) 495.5883 (1.05) 0.0000 (1.0) 495.5883 (1.05) 0.0000 (1.0) 0;0 2.0178 (0.95) 1 1
test_list-list-dvc-only[main] 591.9932 (1.25) 591.9932 (1.25) 591.9932 (1.25) 0.0000 (1.0) 591.9932 (1.25) 0.0000 (1.0) 0;0 1.6892 (0.80) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 2.0884 (3.60) 2.0884 (3.60) 2.0884 (3.60) 0.0000 (1.0) 2.0884 (3.60) 0.0000 (1.0) 0;0 0.4788 (0.28) 1 1
test_list-list-recursive[2.18.1] 2.8747 (4.95) 2.8747 (4.95) 2.8747 (4.95) 0.0000 (1.0) 2.8747 (4.95) 0.0000 (1.0) 0;0 0.3479 (0.20) 1 1
test_list-list-recursive[2.39.0] 0.9531 (1.64) 0.9531 (1.64) 0.9531 (1.64) 0.0000 (1.0) 0.9531 (1.64) 0.0000 (1.0) 0;0 1.0492 (0.61) 1 1
test_list-list-recursive[2.40.0] 0.5805 (1.0) 0.5805 (1.0) 0.5805 (1.0) 0.0000 (1.0) 0.5805 (1.0) 0.0000 (1.0) 0;0 1.7226 (1.0) 1 1
test_list-list-recursive[2.41.1] 0.5897 (1.02) 0.5897 (1.02) 0.5897 (1.02) 0.0000 (1.0) 0.5897 (1.02) 0.0000 (1.0) 0;0 1.6959 (0.98) 1 1
test_list-list-recursive[2.45.0] 0.6015 (1.04) 0.6015 (1.04) 0.6015 (1.04) 0.0000 (1.0) 0.6015 (1.04) 0.0000 (1.0) 0;0 1.6625 (0.97) 1 1
test_list-list-recursive[main] 0.7117 (1.23) 0.7117 (1.23) 0.7117 (1.23) 0.0000 (1.0) 0.7117 (1.23) 0.0000 (1.0) 0;0 1.4051 (0.82) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 513.6627 (1.07) 513.6627 (1.07) 513.6627 (1.07) 0.0000 (1.0) 513.6627 (1.07) 0.0000 (1.0) 0;0 1.9468 (0.94) 1 1
test_list-list-shallow[2.18.1] 481.2550 (1.0) 481.2550 (1.0) 481.2550 (1.0) 0.0000 (1.0) 481.2550 (1.0) 0.0000 (1.0) 0;0 2.0779 (1.0) 1 1
test_list-list-shallow[2.39.0] 541.3631 (1.12) 541.3631 (1.12) 541.3631 (1.12) 0.0000 (1.0) 541.3631 (1.12) 0.0000 (1.0) 0;0 1.8472 (0.89) 1 1
test_list-list-shallow[2.40.0] 528.1199 (1.10) 528.1199 (1.10) 528.1199 (1.10) 0.0000 (1.0) 528.1199 (1.10) 0.0000 (1.0) 0;0 1.8935 (0.91) 1 1
test_list-list-shallow[2.41.1] 532.5386 (1.11) 532.5386 (1.11) 532.5386 (1.11) 0.0000 (1.0) 532.5386 (1.11) 0.0000 (1.0) 0;0 1.8778 (0.90) 1 1
test_list-list-shallow[2.45.0] 563.6916 (1.17) 563.6916 (1.17) 563.6916 (1.17) 0.0000 (1.0) 563.6916 (1.17) 0.0000 (1.0) 0;0 1.7740 (0.85) 1 1
test_list-list-shallow[main] 595.7347 (1.24) 595.7347 (1.24) 595.7347 (1.24) 0.0000 (1.0) 595.7347 (1.24) 0.0000 (1.0) 0;0 1.6786 (0.81) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_help---help': 7 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 196.5397 (1.04) 226.2358 (1.02) 208.1070 (1.01) 6.4621 (1.0) 207.0877 (1.01) 8.3422 (1.0) 35;2 4.8052 (0.99) 100 1
test_help---help[2.18.1] 203.3397 (1.08) 298.0103 (1.34) 217.5002 (1.06) 10.8495 (1.68) 215.9363 (1.05) 8.6177 (1.03) 16;3 4.5977 (0.94) 100 1
test_help---help[2.39.0] 259.6657 (1.37) 307.9712 (1.38) 272.4109 (1.33) 8.0981 (1.25) 270.6235 (1.32) 9.6706 (1.16) 26;3 3.6709 (0.75) 100 1
test_help---help[2.40.0] 247.7774 (1.31) 287.0562 (1.29) 266.1863 (1.30) 8.2120 (1.27) 264.9163 (1.29) 11.2932 (1.35) 32;0 3.7568 (0.77) 100 1
test_help---help[2.41.1] 231.1842 (1.22) 295.4018 (1.33) 256.7634 (1.25) 13.0138 (2.01) 257.1234 (1.25) 14.8843 (1.78) 38;1 3.8946 (0.80) 100 1
test_help---help[2.45.0] 191.4585 (1.01) 238.7881 (1.07) 207.6936 (1.01) 9.4125 (1.46) 205.3509 (1.0) 13.0438 (1.56) 34;2 4.8148 (0.99) 100 1
test_help---help[main] 189.0096 (1.0) 222.5543 (1.0) 205.1630 (1.0) 6.9194 (1.07) 205.4344 (1.00) 9.2018 (1.10) 30;0 4.8742 (1.0) 100 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 1.7760 (1.21) 1.7760 (1.21) 1.7760 (1.21) 0.0000 (1.0) 1.7760 (1.21) 0.0000 (1.0) 0;0 0.5631 (0.83) 1 1
test_diff-diff[2.18.1] 1.4673 (1.0) 1.4673 (1.0) 1.4673 (1.0) 0.0000 (1.0) 1.4673 (1.0) 0.0000 (1.0) 0;0 0.6815 (1.0) 1 1
test_diff-diff[2.39.0] 1.4871 (1.01) 1.4871 (1.01) 1.4871 (1.01) 0.0000 (1.0) 1.4871 (1.01) 0.0000 (1.0) 0;0 0.6725 (0.99) 1 1
test_diff-diff[2.40.0] 1.5118 (1.03) 1.5118 (1.03) 1.5118 (1.03) 0.0000 (1.0) 1.5118 (1.03) 0.0000 (1.0) 0;0 0.6615 (0.97) 1 1
test_diff-diff[2.41.1] 1.4949 (1.02) 1.4949 (1.02) 1.4949 (1.02) 0.0000 (1.0) 1.4949 (1.02) 0.0000 (1.0) 0;0 0.6690 (0.98) 1 1
test_diff-diff[2.45.0] 1.4686 (1.00) 1.4686 (1.00) 1.4686 (1.00) 0.0000 (1.0) 1.4686 (1.00) 0.0000 (1.0) 0;0 0.6809 (1.00) 1 1
test_diff-diff[main] 1.4722 (1.00) 1.4722 (1.00) 1.4722 (1.00) 0.0000 (1.0) 1.4722 (1.00) 0.0000 (1.0) 0;0 0.6792 (1.00) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.1819 (1.79) 1.1819 (1.79) 1.1819 (1.79) 0.0000 (1.0) 1.1819 (1.79) 0.0000 (1.0) 0;0 0.8461 (0.56) 1 1
test_diff-diff-changed[2.18.1] 0.6597 (1.0) 0.6597 (1.0) 0.6597 (1.0) 0.0000 (1.0) 0.6597 (1.0) 0.0000 (1.0) 0;0 1.5157 (1.0) 1 1
test_diff-diff-changed[2.39.0] 0.6872 (1.04) 0.6872 (1.04) 0.6872 (1.04) 0.0000 (1.0) 0.6872 (1.04) 0.0000 (1.0) 0;0 1.4551 (0.96) 1 1
test_diff-diff-changed[2.40.0] 1.0363 (1.57) 1.0363 (1.57) 1.0363 (1.57) 0.0000 (1.0) 1.0363 (1.57) 0.0000 (1.0) 0;0 0.9650 (0.64) 1 1
test_diff-diff-changed[2.41.1] 0.6825 (1.03) 0.6825 (1.03) 0.6825 (1.03) 0.0000 (1.0) 0.6825 (1.03) 0.0000 (1.0) 0;0 1.4653 (0.97) 1 1
test_diff-diff-changed[2.45.0] 0.7027 (1.07) 0.7027 (1.07) 0.7027 (1.07) 0.0000 (1.0) 0.7027 (1.07) 0.0000 (1.0) 0;0 1.4232 (0.94) 1 1
test_diff-diff-changed[main] 0.8114 (1.23) 0.8114 (1.23) 0.8114 (1.23) 0.0000 (1.0) 0.8114 (1.23) 0.0000 (1.0) 0;0 1.2324 (0.81) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 505.1707 (1.0) 505.1707 (1.0) 505.1707 (1.0) 0.0000 (1.0) 505.1707 (1.0) 0.0000 (1.0) 0;0 1.9795 (1.0) 1 1
test_diff-diff-changed-noop[2.18.1] 667.3291 (1.32) 667.3291 (1.32) 667.3291 (1.32) 0.0000 (1.0) 667.3291 (1.32) 0.0000 (1.0) 0;0 1.4985 (0.76) 1 1
test_diff-diff-changed-noop[2.39.0] 687.9021 (1.36) 687.9021 (1.36) 687.9021 (1.36) 0.0000 (1.0) 687.9021 (1.36) 0.0000 (1.0) 0;0 1.4537 (0.73) 1 1
test_diff-diff-changed-noop[2.40.0] 677.9022 (1.34) 677.9022 (1.34) 677.9022 (1.34) 0.0000 (1.0) 677.9022 (1.34) 0.0000 (1.0) 0;0 1.4751 (0.75) 1 1
test_diff-diff-changed-noop[2.41.1] 680.3550 (1.35) 680.3550 (1.35) 680.3550 (1.35) 0.0000 (1.0) 680.3550 (1.35) 0.0000 (1.0) 0;0 1.4698 (0.74) 1 1
test_diff-diff-changed-noop[2.45.0] 710.1628 (1.41) 710.1628 (1.41) 710.1628 (1.41) 0.0000 (1.0) 710.1628 (1.41) 0.0000 (1.0) 0;0 1.4081 (0.71) 1 1
test_diff-diff-changed-noop[main] 756.6425 (1.50) 756.6425 (1.50) 756.6425 (1.50) 0.0000 (1.0) 756.6425 (1.50) 0.0000 (1.0) 0;0 1.3216 (0.67) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 475.0797 (1.0) 475.0797 (1.0) 475.0797 (1.0) 0.0000 (1.0) 475.0797 (1.0) 0.0000 (1.0) 0;0 2.1049 (1.0) 1 1
test_diff-diff-noop[2.18.1] 615.3726 (1.30) 615.3726 (1.30) 615.3726 (1.30) 0.0000 (1.0) 615.3726 (1.30) 0.0000 (1.0) 0;0 1.6250 (0.77) 1 1
test_diff-diff-noop[2.39.0] 647.8239 (1.36) 647.8239 (1.36) 647.8239 (1.36) 0.0000 (1.0) 647.8239 (1.36) 0.0000 (1.0) 0;0 1.5436 (0.73) 1 1
test_diff-diff-noop[2.40.0] 657.4542 (1.38) 657.4542 (1.38) 657.4542 (1.38) 0.0000 (1.0) 657.4542 (1.38) 0.0000 (1.0) 0;0 1.5210 (0.72) 1 1
test_diff-diff-noop[2.41.1] 641.4474 (1.35) 641.4474 (1.35) 641.4474 (1.35) 0.0000 (1.0) 641.4474 (1.35) 0.0000 (1.0) 0;0 1.5590 (0.74) 1 1
test_diff-diff-noop[2.45.0] 663.9096 (1.40) 663.9096 (1.40) 663.9096 (1.40) 0.0000 (1.0) 663.9096 (1.40) 0.0000 (1.0) 0;0 1.5062 (0.72) 1 1
test_diff-diff-noop[main] 726.6282 (1.53) 726.6282 (1.53) 726.6282 (1.53) 0.0000 (1.0) 726.6282 (1.53) 0.0000 (1.0) 0;0 1.3762 (0.65) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 4.1450 (1.0) 4.1450 (1.0) 4.1450 (1.0) 0.0000 (1.0) 4.1450 (1.0) 0.0000 (1.0) 0;0 0.2413 (1.0) 1 1
test_checkout_copy-checkout[2.18.1] 4.1479 (1.00) 4.1479 (1.00) 4.1479 (1.00) 0.0000 (1.0) 4.1479 (1.00) 0.0000 (1.0) 0;0 0.2411 (1.00) 1 1
test_checkout_copy-checkout[2.39.0] 4.2472 (1.02) 4.2472 (1.02) 4.2472 (1.02) 0.0000 (1.0) 4.2472 (1.02) 0.0000 (1.0) 0;0 0.2354 (0.98) 1 1
test_checkout_copy-checkout[2.40.0] 4.2257 (1.02) 4.2257 (1.02) 4.2257 (1.02) 0.0000 (1.0) 4.2257 (1.02) 0.0000 (1.0) 0;0 0.2366 (0.98) 1 1
test_checkout_copy-checkout[2.41.1] 4.2170 (1.02) 4.2170 (1.02) 4.2170 (1.02) 0.0000 (1.0) 4.2170 (1.02) 0.0000 (1.0) 0;0 0.2371 (0.98) 1 1
test_checkout_copy-checkout[2.45.0] 4.5631 (1.10) 4.5631 (1.10) 4.5631 (1.10) 0.0000 (1.0) 4.5631 (1.10) 0.0000 (1.0) 0;0 0.2192 (0.91) 1 1
test_checkout_copy-checkout[main] 4.6243 (1.12) 4.6243 (1.12) 4.6243 (1.12) 0.0000 (1.0) 4.6243 (1.12) 0.0000 (1.0) 0;0 0.2162 (0.90) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 587.5279 (1.0) 587.5279 (1.0) 587.5279 (1.0) 0.0000 (1.0) 587.5279 (1.0) 0.0000 (1.0) 0;0 1.7020 (1.0) 1 1
test_checkout_copy-checkout-noop[2.18.1] 738.0529 (1.26) 738.0529 (1.26) 738.0529 (1.26) 0.0000 (1.0) 738.0529 (1.26) 0.0000 (1.0) 0;0 1.3549 (0.80) 1 1
test_checkout_copy-checkout-noop[2.39.0] 817.9317 (1.39) 817.9317 (1.39) 817.9317 (1.39) 0.0000 (1.0) 817.9317 (1.39) 0.0000 (1.0) 0;0 1.2226 (0.72) 1 1
test_checkout_copy-checkout-noop[2.40.0] 793.1668 (1.35) 793.1668 (1.35) 793.1668 (1.35) 0.0000 (1.0) 793.1668 (1.35) 0.0000 (1.0) 0;0 1.2608 (0.74) 1 1
test_checkout_copy-checkout-noop[2.41.1] 770.3964 (1.31) 770.3964 (1.31) 770.3964 (1.31) 0.0000 (1.0) 770.3964 (1.31) 0.0000 (1.0) 0;0 1.2980 (0.76) 1 1
test_checkout_copy-checkout-noop[2.45.0] 805.7006 (1.37) 805.7006 (1.37) 805.7006 (1.37) 0.0000 (1.0) 805.7006 (1.37) 0.0000 (1.0) 0;0 1.2412 (0.73) 1 1
test_checkout_copy-checkout-noop[main] 898.5309 (1.53) 898.5309 (1.53) 898.5309 (1.53) 0.0000 (1.0) 898.5309 (1.53) 0.0000 (1.0) 0;0 1.1129 (0.65) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.6391 (1.97) 1.6391 (1.97) 1.6391 (1.97) 0.0000 (1.0) 1.6391 (1.97) 0.0000 (1.0) 0;0 0.6101 (0.51) 1 1
test_checkout_copy-checkout-update[2.18.1] 0.8334 (1.0) 0.8334 (1.0) 0.8334 (1.0) 0.0000 (1.0) 0.8334 (1.0) 0.0000 (1.0) 0;0 1.1999 (1.0) 1 1
test_checkout_copy-checkout-update[2.39.0] 0.8508 (1.02) 0.8508 (1.02) 0.8508 (1.02) 0.0000 (1.0) 0.8508 (1.02) 0.0000 (1.0) 0;0 1.1753 (0.98) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.8436 (1.01) 0.8436 (1.01) 0.8436 (1.01) 0.0000 (1.0) 0.8436 (1.01) 0.0000 (1.0) 0;0 1.1854 (0.99) 1 1
test_checkout_copy-checkout-update[2.41.1] 0.8488 (1.02) 0.8488 (1.02) 0.8488 (1.02) 0.0000 (1.0) 0.8488 (1.02) 0.0000 (1.0) 0;0 1.1781 (0.98) 1 1
test_checkout_copy-checkout-update[2.45.0] 0.9181 (1.10) 0.9181 (1.10) 0.9181 (1.10) 0.0000 (1.0) 0.9181 (1.10) 0.0000 (1.0) 0;0 1.0892 (0.91) 1 1
test_checkout_copy-checkout-update[main] 0.9752 (1.17) 0.9752 (1.17) 0.9752 (1.17) 0.0000 (1.0) 0.9752 (1.17) 0.0000 (1.0) 0;0 1.0254 (0.85) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 11.7643 (1.47) 11.7643 (1.47) 11.7643 (1.47) 0.0000 (1.0) 11.7643 (1.47) 0.0000 (1.0) 0;0 0.0850 (0.68) 1 1
test_import-import[2.18.1] 11.3141 (1.41) 11.3141 (1.41) 11.3141 (1.41) 0.0000 (1.0) 11.3141 (1.41) 0.0000 (1.0) 0;0 0.0884 (0.71) 1 1
test_import-import[2.39.0] 10.0548 (1.25) 10.0548 (1.25) 10.0548 (1.25) 0.0000 (1.0) 10.0548 (1.25) 0.0000 (1.0) 0;0 0.0995 (0.80) 1 1
test_import-import[2.40.0] 9.8701 (1.23) 9.8701 (1.23) 9.8701 (1.23) 0.0000 (1.0) 9.8701 (1.23) 0.0000 (1.0) 0;0 0.1013 (0.81) 1 1
test_import-import[2.41.1] 9.8936 (1.23) 9.8936 (1.23) 9.8936 (1.23) 0.0000 (1.0) 9.8936 (1.23) 0.0000 (1.0) 0;0 0.1011 (0.81) 1 1
test_import-import[2.45.0] 8.0217 (1.0) 8.0217 (1.0) 8.0217 (1.0) 0.0000 (1.0) 8.0217 (1.0) 0.0000 (1.0) 0;0 0.1247 (1.0) 1 1
test_import-import[main] 8.5396 (1.06) 8.5396 (1.06) 8.5396 (1.06) 0.0000 (1.0) 8.5396 (1.06) 0.0000 (1.0) 0;0 0.1171 (0.94) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 4.3298 (5.68) 4.3298 (5.68) 4.3298 (5.68) 0.0000 (1.0) 4.3298 (5.68) 0.0000 (1.0) 0;0 0.2310 (0.18) 1 1
test_partial_remove-add[2.18.1] 6.4341 (8.45) 6.4341 (8.45) 6.4341 (8.45) 0.0000 (1.0) 6.4341 (8.45) 0.0000 (1.0) 0;0 0.1554 (0.12) 1 1
test_partial_remove-add[2.39.0] 2.7060 (3.55) 2.7060 (3.55) 2.7060 (3.55) 0.0000 (1.0) 2.7060 (3.55) 0.0000 (1.0) 0;0 0.3695 (0.28) 1 1
test_partial_remove-add[2.40.0] 2.8260 (3.71) 2.8260 (3.71) 2.8260 (3.71) 0.0000 (1.0) 2.8260 (3.71) 0.0000 (1.0) 0;0 0.3539 (0.27) 1 1
test_partial_remove-add[2.41.1] 4.7517 (6.24) 4.7517 (6.24) 4.7517 (6.24) 0.0000 (1.0) 4.7517 (6.24) 0.0000 (1.0) 0;0 0.2104 (0.16) 1 1
test_partial_remove-add[2.45.0] 0.7617 (1.0) 0.7617 (1.0) 0.7617 (1.0) 0.0000 (1.0) 0.7617 (1.0) 0.0000 (1.0) 0;0 1.3129 (1.0) 1 1
test_partial_remove-add[main] 2.3141 (3.04) 2.3141 (3.04) 2.3141 (3.04) 0.0000 (1.0) 2.3141 (3.04) 0.0000 (1.0) 0;0 0.4321 (0.33) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 613.2902 (1.00) 613.2902 (1.00) 613.2902 (1.00) 0.0000 (1.0) 613.2902 (1.00) 0.0000 (1.0) 0;0 1.6305 (1.00) 1 1
test_partial_remove-gc[2.18.1] 612.6309 (1.0) 612.6309 (1.0) 612.6309 (1.0) 0.0000 (1.0) 612.6309 (1.0) 0.0000 (1.0) 0;0 1.6323 (1.0) 1 1
test_partial_remove-gc[2.39.0] 681.3691 (1.11) 681.3691 (1.11) 681.3691 (1.11) 0.0000 (1.0) 681.3691 (1.11) 0.0000 (1.0) 0;0 1.4676 (0.90) 1 1
test_partial_remove-gc[2.40.0] 669.8291 (1.09) 669.8291 (1.09) 669.8291 (1.09) 0.0000 (1.0) 669.8291 (1.09) 0.0000 (1.0) 0;0 1.4929 (0.91) 1 1
test_partial_remove-gc[2.41.1] 687.7158 (1.12) 687.7158 (1.12) 687.7158 (1.12) 0.0000 (1.0) 687.7158 (1.12) 0.0000 (1.0) 0;0 1.4541 (0.89) 1 1
test_partial_remove-gc[2.45.0] 669.6437 (1.09) 669.6437 (1.09) 669.6437 (1.09) 0.0000 (1.0) 669.6437 (1.09) 0.0000 (1.0) 0;0 1.4933 (0.91) 1 1
test_partial_remove-gc[main] 756.9512 (1.24) 756.9512 (1.24) 756.9512 (1.24) 0.0000 (1.0) 756.9512 (1.24) 0.0000 (1.0) 0;0 1.3211 (0.81) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 656.7620 (1.0) 656.7620 (1.0) 656.7620 (1.0) 0.0000 (1.0) 656.7620 (1.0) 0.0000 (1.0) 0;0 1.5226 (1.0) 1 1
test_partial_remove-gc-cloud[2.18.1] 684.2337 (1.04) 684.2337 (1.04) 684.2337 (1.04) 0.0000 (1.0) 684.2337 (1.04) 0.0000 (1.0) 0;0 1.4615 (0.96) 1 1
test_partial_remove-gc-cloud[2.39.0] 738.1536 (1.12) 738.1536 (1.12) 738.1536 (1.12) 0.0000 (1.0) 738.1536 (1.12) 0.0000 (1.0) 0;0 1.3547 (0.89) 1 1
test_partial_remove-gc-cloud[2.40.0] 721.0127 (1.10) 721.0127 (1.10) 721.0127 (1.10) 0.0000 (1.0) 721.0127 (1.10) 0.0000 (1.0) 0;0 1.3869 (0.91) 1 1
test_partial_remove-gc-cloud[2.41.1] 715.4905 (1.09) 715.4905 (1.09) 715.4905 (1.09) 0.0000 (1.0) 715.4905 (1.09) 0.0000 (1.0) 0;0 1.3976 (0.92) 1 1
test_partial_remove-gc-cloud[2.45.0] 689.8221 (1.05) 689.8221 (1.05) 689.8221 (1.05) 0.0000 (1.0) 689.8221 (1.05) 0.0000 (1.0) 0;0 1.4496 (0.95) 1 1
test_partial_remove-gc-cloud[main] 822.5271 (1.25) 822.5271 (1.25) 822.5271 (1.25) 0.0000 (1.0) 822.5271 (1.25) 0.0000 (1.0) 0;0 1.2158 (0.80) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 623.1500 (1.10) 623.1500 (1.10) 623.1500 (1.10) 0.0000 (1.0) 623.1500 (1.10) 0.0000 (1.0) 0;0 1.6048 (0.91) 1 1
test_partial_remove-push[2.18.1] 650.3575 (1.14) 650.3575 (1.14) 650.3575 (1.14) 0.0000 (1.0) 650.3575 (1.14) 0.0000 (1.0) 0;0 1.5376 (0.87) 1 1
test_partial_remove-push[2.39.0] 714.8884 (1.26) 714.8884 (1.26) 714.8884 (1.26) 0.0000 (1.0) 714.8884 (1.26) 0.0000 (1.0) 0;0 1.3988 (0.80) 1 1
test_partial_remove-push[2.40.0] 672.6226 (1.18) 672.6226 (1.18) 672.6226 (1.18) 0.0000 (1.0) 672.6226 (1.18) 0.0000 (1.0) 0;0 1.4867 (0.85) 1 1
test_partial_remove-push[2.41.1] 701.4674 (1.23) 701.4674 (1.23) 701.4674 (1.23) 0.0000 (1.0) 701.4674 (1.23) 0.0000 (1.0) 0;0 1.4256 (0.81) 1 1
test_partial_remove-push[2.45.0] 568.7603 (1.0) 568.7603 (1.0) 568.7603 (1.0) 0.0000 (1.0) 568.7603 (1.0) 0.0000 (1.0) 0;0 1.7582 (1.0) 1 1
test_partial_remove-push[main] 837.3474 (1.47) 837.3474 (1.47) 837.3474 (1.47) 0.0000 (1.0) 837.3474 (1.47) 0.0000 (1.0) 0;0 1.1942 (0.68) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial-add[2.11.0] 8.1946 (1.92) 8.1946 (1.92) 8.1946 (1.92) 0.0000 (1.0) 8.1946 (1.92) 0.0000 (1.0) 0;0 0.1220 (0.52) 1 1
test_partial_add-add-partial-add[2.18.1] 7.2334 (1.70) 7.2334 (1.70) 7.2334 (1.70) 0.0000 (1.0) 7.2334 (1.70) 0.0000 (1.0) 0;0 0.1382 (0.59) 1 1
test_partial_add-add-partial-add[2.39.0] 6.1561 (1.44) 6.1561 (1.44) 6.1561 (1.44) 0.0000 (1.0) 6.1561 (1.44) 0.0000 (1.0) 0;0 0.1624 (0.69) 1 1
test_partial_add-add-partial-add[2.40.0] 4.2664 (1.0) 4.2664 (1.0) 4.2664 (1.0) 0.0000 (1.0) 4.2664 (1.0) 0.0000 (1.0) 0;0 0.2344 (1.0) 1 1
test_partial_add-add-partial-add[2.41.1] 6.1384 (1.44) 6.1384 (1.44) 6.1384 (1.44) 0.0000 (1.0) 6.1384 (1.44) 0.0000 (1.0) 0;0 0.1629 (0.70) 1 1
test_partial_add-add-partial-add[2.45.0] 4.6952 (1.10) 4.6952 (1.10) 4.6952 (1.10) 0.0000 (1.0) 4.6952 (1.10) 0.0000 (1.0) 0;0 0.2130 (0.91) 1 1
test_partial_add-add-partial-add[main] 5.2659 (1.23) 5.2659 (1.23) 5.2659 (1.23) 0.0000 (1.0) 5.2659 (1.23) 0.0000 (1.0) 0;0 0.1899 (0.81) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 570.3647 (1.0) 570.3647 (1.0) 570.3647 (1.0) 0.0000 (1.0) 570.3647 (1.0) 0.0000 (1.0) 0;0 1.7533 (1.0) 1 1
test_partial_add-gc-cloud-noop[2.18.1] 592.1641 (1.04) 592.1641 (1.04) 592.1641 (1.04) 0.0000 (1.0) 592.1641 (1.04) 0.0000 (1.0) 0;0 1.6887 (0.96) 1 1
test_partial_add-gc-cloud-noop[2.39.0] 636.2778 (1.12) 636.2778 (1.12) 636.2778 (1.12) 0.0000 (1.0) 636.2778 (1.12) 0.0000 (1.0) 0;0 1.5716 (0.90) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 603.4768 (1.06) 603.4768 (1.06) 603.4768 (1.06) 0.0000 (1.0) 603.4768 (1.06) 0.0000 (1.0) 0;0 1.6571 (0.95) 1 1
test_partial_add-gc-cloud-noop[2.41.1] 650.6102 (1.14) 650.6102 (1.14) 650.6102 (1.14) 0.0000 (1.0) 650.6102 (1.14) 0.0000 (1.0) 0;0 1.5370 (0.88) 1 1
test_partial_add-gc-cloud-noop[2.45.0] 630.5773 (1.11) 630.5773 (1.11) 630.5773 (1.11) 0.0000 (1.0) 630.5773 (1.11) 0.0000 (1.0) 0;0 1.5858 (0.90) 1 1
test_partial_add-gc-cloud-noop[main] 754.2676 (1.32) 754.2676 (1.32) 754.2676 (1.32) 0.0000 (1.0) 754.2676 (1.32) 0.0000 (1.0) 0;0 1.3258 (0.76) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 476.8546 (1.0) 476.8546 (1.0) 476.8546 (1.0) 0.0000 (1.0) 476.8546 (1.0) 0.0000 (1.0) 0;0 2.0971 (1.0) 1 1
test_partial_add-gc-noop[2.18.1] 526.1787 (1.10) 526.1787 (1.10) 526.1787 (1.10) 0.0000 (1.0) 526.1787 (1.10) 0.0000 (1.0) 0;0 1.9005 (0.91) 1 1
test_partial_add-gc-noop[2.39.0] 565.6651 (1.19) 565.6651 (1.19) 565.6651 (1.19) 0.0000 (1.0) 565.6651 (1.19) 0.0000 (1.0) 0;0 1.7678 (0.84) 1 1
test_partial_add-gc-noop[2.40.0] 556.1710 (1.17) 556.1710 (1.17) 556.1710 (1.17) 0.0000 (1.0) 556.1710 (1.17) 0.0000 (1.0) 0;0 1.7980 (0.86) 1 1
test_partial_add-gc-noop[2.41.1] 569.4875 (1.19) 569.4875 (1.19) 569.4875 (1.19) 0.0000 (1.0) 569.4875 (1.19) 0.0000 (1.0) 0;0 1.7560 (0.84) 1 1
test_partial_add-gc-noop[2.45.0] 561.6376 (1.18) 561.6376 (1.18) 561.6376 (1.18) 0.0000 (1.0) 561.6376 (1.18) 0.0000 (1.0) 0;0 1.7805 (0.85) 1 1
test_partial_add-gc-noop[main] 659.2519 (1.38) 659.2519 (1.38) 659.2519 (1.38) 0.0000 (1.0) 659.2519 (1.38) 0.0000 (1.0) 0;0 1.5169 (0.72) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial-add[2.11.0] 2.8718 (4.58) 2.8718 (4.58) 2.8718 (4.58) 0.0000 (1.0) 2.8718 (4.58) 0.0000 (1.0) 0;0 0.3482 (0.22) 1 1
test_partial_add-push-partial-add[2.18.1] 2.8227 (4.50) 2.8227 (4.50) 2.8227 (4.50) 0.0000 (1.0) 2.8227 (4.50) 0.0000 (1.0) 0;0 0.3543 (0.22) 1 1
test_partial_add-push-partial-add[2.39.0] 3.7427 (5.97) 3.7427 (5.97) 3.7427 (5.97) 0.0000 (1.0) 3.7427 (5.97) 0.0000 (1.0) 0;0 0.2672 (0.17) 1 1
test_partial_add-push-partial-add[2.40.0] 0.6269 (1.0) 0.6269 (1.0) 0.6269 (1.0) 0.0000 (1.0) 0.6269 (1.0) 0.0000 (1.0) 0;0 1.5953 (1.0) 1 1
test_partial_add-push-partial-add[2.41.1] 3.6287 (5.79) 3.6287 (5.79) 3.6287 (5.79) 0.0000 (1.0) 3.6287 (5.79) 0.0000 (1.0) 0;0 0.2756 (0.17) 1 1
test_partial_add-push-partial-add[2.45.0] 2.4969 (3.98) 2.4969 (3.98) 2.4969 (3.98) 0.0000 (1.0) 2.4969 (3.98) 0.0000 (1.0) 0;0 0.4005 (0.25) 1 1
test_partial_add-push-partial-add[main] 4.5500 (7.26) 4.5500 (7.26) 4.5500 (7.26) 0.0000 (1.0) 4.5500 (7.26) 0.0000 (1.0) 0;0 0.2198 (0.14) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
dependabot[bot]
Bumps pre-commit from 2.21.0 to 3.3.1.
Release notes
Sourced from pre-commit's releases.
... (truncated)
Changelog
Sourced from pre-commit's changelog.
... (truncated)
Commits
51104fav3.3.10fd2501Merge pull request #2866 from pre-commit/autoupdate-hack-windows420a15fadd partial clone hack to fix autoupdate for windows4c06239v3.3.05df9eb9Merge pull request #2863 from pre-commit/parallel-autoupdateddbee32add --jobs option to autoupdatebab5f70Merge pull request #2861 from pre-commit/autoupdate-without-store4f045cbperform autoupdate without Store contention27d77fcMerge pull request #2860 from pre-commit/autoupdate-dash-Ce885f2euse -C for git commands in autoupdateDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)