github-actions[bot]
commented
1 year ago
Thu May 18 10:24:00 UTC 2023
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 3.3573 (1.0) 3.3573 (1.0) 3.3573 (1.0) 0.0000 (1.0) 3.3573 (1.0) 0.0000 (1.0) 0;0 0.2979 (1.0) 1 1
test_get_url-get-url[2.18.1] 3.3714 (1.00) 3.3714 (1.00) 3.3714 (1.00) 0.0000 (1.0) 3.3714 (1.00) 0.0000 (1.0) 0;0 0.2966 (1.00) 1 1
test_get_url-get-url[2.39.0] 3.4763 (1.04) 3.4763 (1.04) 3.4763 (1.04) 0.0000 (1.0) 3.4763 (1.04) 0.0000 (1.0) 0;0 0.2877 (0.97) 1 1
test_get_url-get-url[2.40.0] 3.4461 (1.03) 3.4461 (1.03) 3.4461 (1.03) 0.0000 (1.0) 3.4461 (1.03) 0.0000 (1.0) 0;0 0.2902 (0.97) 1 1
test_get_url-get-url[2.41.1] 3.4354 (1.02) 3.4354 (1.02) 3.4354 (1.02) 0.0000 (1.0) 3.4354 (1.02) 0.0000 (1.0) 0;0 0.2911 (0.98) 1 1
test_get_url-get-url[2.45.0] 3.4643 (1.03) 3.4643 (1.03) 3.4643 (1.03) 0.0000 (1.0) 3.4643 (1.03) 0.0000 (1.0) 0;0 0.2887 (0.97) 1 1
test_get_url-get-url[main] 3.5723 (1.06) 3.5723 (1.06) 3.5723 (1.06) 0.0000 (1.0) 3.5723 (1.06) 0.0000 (1.0) 0;0 0.2799 (0.94) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 3.8194 (1.52) 3.8194 (1.52) 3.8194 (1.52) 0.0000 (1.0) 3.8194 (1.52) 0.0000 (1.0) 0;0 0.2618 (0.66) 1 1
test_checkout_copy-checkout[2.18.1] 3.8278 (1.53) 3.8278 (1.53) 3.8278 (1.53) 0.0000 (1.0) 3.8278 (1.53) 0.0000 (1.0) 0;0 0.2612 (0.65) 1 1
test_checkout_copy-checkout[2.39.0] 3.8400 (1.53) 3.8400 (1.53) 3.8400 (1.53) 0.0000 (1.0) 3.8400 (1.53) 0.0000 (1.0) 0;0 0.2604 (0.65) 1 1
test_checkout_copy-checkout[2.40.0] 3.8348 (1.53) 3.8348 (1.53) 3.8348 (1.53) 0.0000 (1.0) 3.8348 (1.53) 0.0000 (1.0) 0;0 0.2608 (0.65) 1 1
test_checkout_copy-checkout[2.41.1] 3.9302 (1.57) 3.9302 (1.57) 3.9302 (1.57) 0.0000 (1.0) 3.9302 (1.57) 0.0000 (1.0) 0;0 0.2544 (0.64) 1 1
test_checkout_copy-checkout[2.45.0] 4.4556 (1.78) 4.4556 (1.78) 4.4556 (1.78) 0.0000 (1.0) 4.4556 (1.78) 0.0000 (1.0) 0;0 0.2244 (0.56) 1 1
test_checkout_copy-checkout[main] 2.5059 (1.0) 2.5059 (1.0) 2.5059 (1.0) 0.0000 (1.0) 2.5059 (1.0) 0.0000 (1.0) 0;0 0.3991 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 537.9279 (1.0) 537.9279 (1.0) 537.9279 (1.0) 0.0000 (1.0) 537.9279 (1.0) 0.0000 (1.0) 0;0 1.8590 (1.0) 1 1
test_checkout_copy-checkout-noop[2.18.1] 656.3207 (1.22) 656.3207 (1.22) 656.3207 (1.22) 0.0000 (1.0) 656.3207 (1.22) 0.0000 (1.0) 0;0 1.5236 (0.82) 1 1
test_checkout_copy-checkout-noop[2.39.0] 707.2515 (1.31) 707.2515 (1.31) 707.2515 (1.31) 0.0000 (1.0) 707.2515 (1.31) 0.0000 (1.0) 0;0 1.4139 (0.76) 1 1
test_checkout_copy-checkout-noop[2.40.0] 690.4833 (1.28) 690.4833 (1.28) 690.4833 (1.28) 0.0000 (1.0) 690.4833 (1.28) 0.0000 (1.0) 0;0 1.4483 (0.78) 1 1
test_checkout_copy-checkout-noop[2.41.1] 735.6545 (1.37) 735.6545 (1.37) 735.6545 (1.37) 0.0000 (1.0) 735.6545 (1.37) 0.0000 (1.0) 0;0 1.3593 (0.73) 1 1
test_checkout_copy-checkout-noop[2.45.0] 768.3253 (1.43) 768.3253 (1.43) 768.3253 (1.43) 0.0000 (1.0) 768.3253 (1.43) 0.0000 (1.0) 0;0 1.3015 (0.70) 1 1
test_checkout_copy-checkout-noop[main] 850.8867 (1.58) 850.8867 (1.58) 850.8867 (1.58) 0.0000 (1.0) 850.8867 (1.58) 0.0000 (1.0) 0;0 1.1752 (0.63) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.4911 (1.98) 1.4911 (1.98) 1.4911 (1.98) 0.0000 (1.0) 1.4911 (1.98) 0.0000 (1.0) 0;0 0.6707 (0.50) 1 1
test_checkout_copy-checkout-update[2.18.1] 0.7672 (1.02) 0.7672 (1.02) 0.7672 (1.02) 0.0000 (1.0) 0.7672 (1.02) 0.0000 (1.0) 0;0 1.3035 (0.98) 1 1
test_checkout_copy-checkout-update[2.39.0] 0.8045 (1.07) 0.8045 (1.07) 0.8045 (1.07) 0.0000 (1.0) 0.8045 (1.07) 0.0000 (1.0) 0;0 1.2430 (0.93) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.7512 (1.0) 0.7512 (1.0) 0.7512 (1.0) 0.0000 (1.0) 0.7512 (1.0) 0.0000 (1.0) 0;0 1.3312 (1.0) 1 1
test_checkout_copy-checkout-update[2.41.1] 0.8103 (1.08) 0.8103 (1.08) 0.8103 (1.08) 0.0000 (1.0) 0.8103 (1.08) 0.0000 (1.0) 0;0 1.2340 (0.93) 1 1
test_checkout_copy-checkout-update[2.45.0] 0.8361 (1.11) 0.8361 (1.11) 0.8361 (1.11) 0.0000 (1.0) 0.8361 (1.11) 0.0000 (1.0) 0;0 1.1960 (0.90) 1 1
test_checkout_copy-checkout-update[main] 1.0152 (1.35) 1.0152 (1.35) 1.0152 (1.35) 0.0000 (1.0) 1.0152 (1.35) 0.0000 (1.0) 0;0 0.9851 (0.74) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 1.9879 (1.57) 1.9879 (1.57) 1.9879 (1.57) 0.0000 (1.0) 1.9879 (1.57) 0.0000 (1.0) 0;0 0.5030 (0.64) 1 1
test_status-status[2.18.1] 1.2662 (1.0) 1.2662 (1.0) 1.2662 (1.0) 0.0000 (1.0) 1.2662 (1.0) 0.0000 (1.0) 0;0 0.7898 (1.0) 1 1
test_status-status[2.39.0] 1.2908 (1.02) 1.2908 (1.02) 1.2908 (1.02) 0.0000 (1.0) 1.2908 (1.02) 0.0000 (1.0) 0;0 0.7747 (0.98) 1 1
test_status-status[2.40.0] 1.3545 (1.07) 1.3545 (1.07) 1.3545 (1.07) 0.0000 (1.0) 1.3545 (1.07) 0.0000 (1.0) 0;0 0.7383 (0.93) 1 1
test_status-status[2.41.1] 1.3008 (1.03) 1.3008 (1.03) 1.3008 (1.03) 0.0000 (1.0) 1.3008 (1.03) 0.0000 (1.0) 0;0 0.7688 (0.97) 1 1
test_status-status[2.45.0] 1.2917 (1.02) 1.2917 (1.02) 1.2917 (1.02) 0.0000 (1.0) 1.2917 (1.02) 0.0000 (1.0) 0;0 0.7742 (0.98) 1 1
test_status-status[main] 1.3373 (1.06) 1.3373 (1.06) 1.3373 (1.06) 0.0000 (1.0) 1.3373 (1.06) 0.0000 (1.0) 0;0 0.7478 (0.95) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 1.3837 (2.82) 1.3837 (2.82) 1.3837 (2.82) 0.0000 (1.0) 1.3837 (2.82) 0.0000 (1.0) 0;0 0.7227 (0.35) 1 1
test_status-status-changed[2.18.1] 0.4904 (1.0) 0.4904 (1.0) 0.4904 (1.0) 0.0000 (1.0) 0.4904 (1.0) 0.0000 (1.0) 0;0 2.0390 (1.0) 1 1
test_status-status-changed[2.39.0] 0.5250 (1.07) 0.5250 (1.07) 0.5250 (1.07) 0.0000 (1.0) 0.5250 (1.07) 0.0000 (1.0) 0;0 1.9049 (0.93) 1 1
test_status-status-changed[2.40.0] 0.5277 (1.08) 0.5277 (1.08) 0.5277 (1.08) 0.0000 (1.0) 0.5277 (1.08) 0.0000 (1.0) 0;0 1.8949 (0.93) 1 1
test_status-status-changed[2.41.1] 0.5188 (1.06) 0.5188 (1.06) 0.5188 (1.06) 0.0000 (1.0) 0.5188 (1.06) 0.0000 (1.0) 0;0 1.9273 (0.95) 1 1
test_status-status-changed[2.45.0] 0.5549 (1.13) 0.5549 (1.13) 0.5549 (1.13) 0.0000 (1.0) 0.5549 (1.13) 0.0000 (1.0) 0;0 1.8022 (0.88) 1 1
test_status-status-changed[main] 0.6227 (1.27) 0.6227 (1.27) 0.6227 (1.27) 0.0000 (1.0) 0.6227 (1.27) 0.0000 (1.0) 0;0 1.6058 (0.79) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 654.3312 (1.31) 654.3312 (1.31) 654.3312 (1.31) 0.0000 (1.0) 654.3312 (1.31) 0.0000 (1.0) 0;0 1.5283 (0.76) 1 1
test_status-status-changed-noop[2.18.1] 498.5560 (1.0) 498.5560 (1.0) 498.5560 (1.0) 0.0000 (1.0) 498.5560 (1.0) 0.0000 (1.0) 0;0 2.0058 (1.0) 1 1
test_status-status-changed-noop[2.39.0] 524.9357 (1.05) 524.9357 (1.05) 524.9357 (1.05) 0.0000 (1.0) 524.9357 (1.05) 0.0000 (1.0) 0;0 1.9050 (0.95) 1 1
test_status-status-changed-noop[2.40.0] 526.0782 (1.06) 526.0782 (1.06) 526.0782 (1.06) 0.0000 (1.0) 526.0782 (1.06) 0.0000 (1.0) 0;0 1.9009 (0.95) 1 1
test_status-status-changed-noop[2.41.1] 521.6522 (1.05) 521.6522 (1.05) 521.6522 (1.05) 0.0000 (1.0) 521.6522 (1.05) 0.0000 (1.0) 0;0 1.9170 (0.96) 1 1
test_status-status-changed-noop[2.45.0] 557.0809 (1.12) 557.0809 (1.12) 557.0809 (1.12) 0.0000 (1.0) 557.0809 (1.12) 0.0000 (1.0) 0;0 1.7951 (0.89) 1 1
test_status-status-changed-noop[main] 627.4788 (1.26) 627.4788 (1.26) 627.4788 (1.26) 0.0000 (1.0) 627.4788 (1.26) 0.0000 (1.0) 0;0 1.5937 (0.79) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 417.4423 (1.0) 417.4423 (1.0) 417.4423 (1.0) 0.0000 (1.0) 417.4423 (1.0) 0.0000 (1.0) 0;0 2.3955 (1.0) 1 1
test_status-status-noop[2.18.1] 490.9559 (1.18) 490.9559 (1.18) 490.9559 (1.18) 0.0000 (1.0) 490.9559 (1.18) 0.0000 (1.0) 0;0 2.0368 (0.85) 1 1
test_status-status-noop[2.39.0] 524.9130 (1.26) 524.9130 (1.26) 524.9130 (1.26) 0.0000 (1.0) 524.9130 (1.26) 0.0000 (1.0) 0;0 1.9051 (0.80) 1 1
test_status-status-noop[2.40.0] 522.7517 (1.25) 522.7517 (1.25) 522.7517 (1.25) 0.0000 (1.0) 522.7517 (1.25) 0.0000 (1.0) 0;0 1.9130 (0.80) 1 1
test_status-status-noop[2.41.1] 522.3217 (1.25) 522.3217 (1.25) 522.3217 (1.25) 0.0000 (1.0) 522.3217 (1.25) 0.0000 (1.0) 0;0 1.9145 (0.80) 1 1
test_status-status-noop[2.45.0] 557.2196 (1.33) 557.2196 (1.33) 557.2196 (1.33) 0.0000 (1.0) 557.2196 (1.33) 0.0000 (1.0) 0;0 1.7946 (0.75) 1 1
test_status-status-noop[main] 617.5629 (1.48) 617.5629 (1.48) 617.5629 (1.48) 0.0000 (1.0) 617.5629 (1.48) 0.0000 (1.0) 0;0 1.6193 (0.68) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_help---help': 7 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 169.5389 (1.0) 173.8590 (1.0) 171.5768 (1.0) 1.0405 (1.0) 171.5425 (1.0) 1.5686 (1.0) 38;0 5.8283 (1.0) 100 1
test_help---help[2.18.1] 174.8085 (1.03) 180.1912 (1.04) 176.9293 (1.03) 1.0475 (1.01) 177.0022 (1.03) 1.6140 (1.03) 32;1 5.6520 (0.97) 100 1
test_help---help[2.39.0] 223.3939 (1.32) 249.0615 (1.43) 228.2263 (1.33) 4.2737 (4.11) 227.1427 (1.32) 2.8939 (1.84) 14;11 4.3816 (0.75) 100 1
test_help---help[2.40.0] 220.9787 (1.30) 236.5979 (1.36) 227.1353 (1.32) 2.0937 (2.01) 227.0777 (1.32) 2.1885 (1.40) 22;5 4.4027 (0.76) 100 1
test_help---help[2.41.1] 221.5522 (1.31) 275.0437 (1.58) 231.7141 (1.35) 10.1949 (9.80) 226.6435 (1.32) 12.2600 (7.82) 17;3 4.3157 (0.74) 100 1
test_help---help[2.45.0] 174.4185 (1.03) 187.2043 (1.08) 177.8455 (1.04) 1.9419 (1.87) 177.7475 (1.04) 2.4556 (1.57) 26;2 5.6229 (0.96) 100 1
test_help---help[main] 175.7174 (1.04) 200.3818 (1.15) 181.2695 (1.06) 5.0014 (4.81) 179.9414 (1.05) 2.5814 (1.65) 15;12 5.5166 (0.95) 100 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 1.9131 (1.03) 1.9131 (1.03) 1.9131 (1.03) 0.0000 (1.0) 1.9131 (1.03) 0.0000 (1.0) 0;0 0.5227 (0.97) 1 1
test_checkout_symlink-checkout[2.18.1] 1.9153 (1.03) 1.9153 (1.03) 1.9153 (1.03) 0.0000 (1.0) 1.9153 (1.03) 0.0000 (1.0) 0;0 0.5221 (0.97) 1 1
test_checkout_symlink-checkout[2.39.0] 1.8621 (1.0) 1.8621 (1.0) 1.8621 (1.0) 0.0000 (1.0) 1.8621 (1.0) 0.0000 (1.0) 0;0 0.5370 (1.0) 1 1
test_checkout_symlink-checkout[2.40.0] 1.8797 (1.01) 1.8797 (1.01) 1.8797 (1.01) 0.0000 (1.0) 1.8797 (1.01) 0.0000 (1.0) 0;0 0.5320 (0.99) 1 1
test_checkout_symlink-checkout[2.41.1] 1.8627 (1.00) 1.8627 (1.00) 1.8627 (1.00) 0.0000 (1.0) 1.8627 (1.00) 0.0000 (1.0) 0;0 0.5369 (1.00) 1 1
test_checkout_symlink-checkout[2.45.0] 2.2565 (1.21) 2.2565 (1.21) 2.2565 (1.21) 0.0000 (1.0) 2.2565 (1.21) 0.0000 (1.0) 0;0 0.4432 (0.83) 1 1
test_checkout_symlink-checkout[main] 1.9726 (1.06) 1.9726 (1.06) 1.9726 (1.06) 0.0000 (1.0) 1.9726 (1.06) 0.0000 (1.0) 0;0 0.5069 (0.94) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 659.8378 (1.0) 659.8378 (1.0) 659.8378 (1.0) 0.0000 (1.0) 659.8378 (1.0) 0.0000 (1.0) 0;0 1.5155 (1.0) 1 1
test_checkout_symlink-checkout-noop[2.18.1] 773.7692 (1.17) 773.7692 (1.17) 773.7692 (1.17) 0.0000 (1.0) 773.7692 (1.17) 0.0000 (1.0) 0;0 1.2924 (0.85) 1 1
test_checkout_symlink-checkout-noop[2.39.0] 836.4744 (1.27) 836.4744 (1.27) 836.4744 (1.27) 0.0000 (1.0) 836.4744 (1.27) 0.0000 (1.0) 0;0 1.1955 (0.79) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 785.0722 (1.19) 785.0722 (1.19) 785.0722 (1.19) 0.0000 (1.0) 785.0722 (1.19) 0.0000 (1.0) 0;0 1.2738 (0.84) 1 1
test_checkout_symlink-checkout-noop[2.41.1] 793.9497 (1.20) 793.9497 (1.20) 793.9497 (1.20) 0.0000 (1.0) 793.9497 (1.20) 0.0000 (1.0) 0;0 1.2595 (0.83) 1 1
test_checkout_symlink-checkout-noop[2.45.0] 911.2447 (1.38) 911.2447 (1.38) 911.2447 (1.38) 0.0000 (1.0) 911.2447 (1.38) 0.0000 (1.0) 0;0 1.0974 (0.72) 1 1
test_checkout_symlink-checkout-noop[main] 979.7003 (1.48) 979.7003 (1.48) 979.7003 (1.48) 0.0000 (1.0) 979.7003 (1.48) 0.0000 (1.0) 0;0 1.0207 (0.67) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 1.8832 (2.10) 1.8832 (2.10) 1.8832 (2.10) 0.0000 (1.0) 1.8832 (2.10) 0.0000 (1.0) 0;0 0.5310 (0.48) 1 1
test_checkout_symlink-checkout-update[2.18.1] 0.8955 (1.0) 0.8955 (1.0) 0.8955 (1.0) 0.0000 (1.0) 0.8955 (1.0) 0.0000 (1.0) 0;0 1.1167 (1.0) 1 1
test_checkout_symlink-checkout-update[2.39.0] 0.9452 (1.06) 0.9452 (1.06) 0.9452 (1.06) 0.0000 (1.0) 0.9452 (1.06) 0.0000 (1.0) 0;0 1.0580 (0.95) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.9231 (1.03) 0.9231 (1.03) 0.9231 (1.03) 0.0000 (1.0) 0.9231 (1.03) 0.0000 (1.0) 0;0 1.0833 (0.97) 1 1
test_checkout_symlink-checkout-update[2.41.1] 0.9772 (1.09) 0.9772 (1.09) 0.9772 (1.09) 0.0000 (1.0) 0.9772 (1.09) 0.0000 (1.0) 0;0 1.0234 (0.92) 1 1
test_checkout_symlink-checkout-update[2.45.0] 0.9873 (1.10) 0.9873 (1.10) 0.9873 (1.10) 0.0000 (1.0) 0.9873 (1.10) 0.0000 (1.0) 0;0 1.0129 (0.91) 1 1
test_checkout_symlink-checkout-update[main] 1.2349 (1.38) 1.2349 (1.38) 1.2349 (1.38) 0.0000 (1.0) 1.2349 (1.38) 0.0000 (1.0) 0;0 0.8098 (0.73) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 9.9836 (1.46) 9.9836 (1.46) 9.9836 (1.46) 0.0000 (1.0) 9.9836 (1.46) 0.0000 (1.0) 0;0 0.1002 (0.69) 1 1
test_import_url-import-url[2.18.1] 8.8432 (1.29) 8.8432 (1.29) 8.8432 (1.29) 0.0000 (1.0) 8.8432 (1.29) 0.0000 (1.0) 0;0 0.1131 (0.77) 1 1
test_import_url-import-url[2.39.0] 9.0118 (1.32) 9.0118 (1.32) 9.0118 (1.32) 0.0000 (1.0) 9.0118 (1.32) 0.0000 (1.0) 0;0 0.1110 (0.76) 1 1
test_import_url-import-url[2.40.0] 8.9498 (1.31) 8.9498 (1.31) 8.9498 (1.31) 0.0000 (1.0) 8.9498 (1.31) 0.0000 (1.0) 0;0 0.1117 (0.77) 1 1
test_import_url-import-url[2.41.1] 8.8715 (1.30) 8.8715 (1.30) 8.8715 (1.30) 0.0000 (1.0) 8.8715 (1.30) 0.0000 (1.0) 0;0 0.1127 (0.77) 1 1
test_import_url-import-url[2.45.0] 6.8469 (1.0) 6.8469 (1.0) 6.8469 (1.0) 0.0000 (1.0) 6.8469 (1.0) 0.0000 (1.0) 0;0 0.1461 (1.0) 1 1
test_import_url-import-url[main] 7.1601 (1.05) 7.1601 (1.05) 7.1601 (1.05) 0.0000 (1.0) 7.1601 (1.05) 0.0000 (1.0) 0;0 0.1397 (0.96) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 7 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 11.9506 (1.43) 11.9506 (1.43) 11.9506 (1.43) 0.0000 (1.0) 11.9506 (1.43) 0.0000 (1.0) 0;0 0.0837 (0.70) 1 1
test_import-import[2.18.1] 11.2808 (1.35) 11.2808 (1.35) 11.2808 (1.35) 0.0000 (1.0) 11.2808 (1.35) 0.0000 (1.0) 0;0 0.0886 (0.74) 1 1
test_import-import[2.39.0] 10.1758 (1.22) 10.1758 (1.22) 10.1758 (1.22) 0.0000 (1.0) 10.1758 (1.22) 0.0000 (1.0) 0;0 0.0983 (0.82) 1 1
test_import-import[2.40.0] 9.9223 (1.19) 9.9223 (1.19) 9.9223 (1.19) 0.0000 (1.0) 9.9223 (1.19) 0.0000 (1.0) 0;0 0.1008 (0.84) 1 1
test_import-import[2.41.1] 9.8570 (1.18) 9.8570 (1.18) 9.8570 (1.18) 0.0000 (1.0) 9.8570 (1.18) 0.0000 (1.0) 0;0 0.1015 (0.85) 1 1
test_import-import[2.45.0] 8.3345 (1.0) 8.3345 (1.0) 8.3345 (1.0) 0.0000 (1.0) 8.3345 (1.0) 0.0000 (1.0) 0;0 0.1200 (1.0) 1 1
test_import-import[main] 10.2224 (1.23) 10.2224 (1.23) 10.2224 (1.23) 0.0000 (1.0) 10.2224 (1.23) 0.0000 (1.0) 0;0 0.0978 (0.82) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 2.1161 (1.25) 2.1161 (1.25) 2.1161 (1.25) 0.0000 (1.0) 2.1161 (1.25) 0.0000 (1.0) 0;0 0.4726 (0.80) 1 1
test_diff-diff[2.18.1] 1.6961 (1.0) 1.6961 (1.0) 1.6961 (1.0) 0.0000 (1.0) 1.6961 (1.0) 0.0000 (1.0) 0;0 0.5896 (1.0) 1 1
test_diff-diff[2.39.0] 1.6968 (1.00) 1.6968 (1.00) 1.6968 (1.00) 0.0000 (1.0) 1.6968 (1.00) 0.0000 (1.0) 0;0 0.5893 (1.00) 1 1
test_diff-diff[2.40.0] 1.7236 (1.02) 1.7236 (1.02) 1.7236 (1.02) 0.0000 (1.0) 1.7236 (1.02) 0.0000 (1.0) 0;0 0.5802 (0.98) 1 1
test_diff-diff[2.41.1] 1.7709 (1.04) 1.7709 (1.04) 1.7709 (1.04) 0.0000 (1.0) 1.7709 (1.04) 0.0000 (1.0) 0;0 0.5647 (0.96) 1 1
test_diff-diff[2.45.0] 1.7327 (1.02) 1.7327 (1.02) 1.7327 (1.02) 0.0000 (1.0) 1.7327 (1.02) 0.0000 (1.0) 0;0 0.5771 (0.98) 1 1
test_diff-diff[main] 1.6968 (1.00) 1.6968 (1.00) 1.6968 (1.00) 0.0000 (1.0) 1.6968 (1.00) 0.0000 (1.0) 0;0 0.5893 (1.00) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.3475 (1.78) 1.3475 (1.78) 1.3475 (1.78) 0.0000 (1.0) 1.3475 (1.78) 0.0000 (1.0) 0;0 0.7421 (0.56) 1 1
test_diff-diff-changed[2.18.1] 0.7666 (1.01) 0.7666 (1.01) 0.7666 (1.01) 0.0000 (1.0) 0.7666 (1.01) 0.0000 (1.0) 0;0 1.3045 (0.99) 1 1
test_diff-diff-changed[2.39.0] 0.7873 (1.04) 0.7873 (1.04) 0.7873 (1.04) 0.0000 (1.0) 0.7873 (1.04) 0.0000 (1.0) 0;0 1.2702 (0.96) 1 1
test_diff-diff-changed[2.40.0] 0.7579 (1.0) 0.7579 (1.0) 0.7579 (1.0) 0.0000 (1.0) 0.7579 (1.0) 0.0000 (1.0) 0;0 1.3195 (1.0) 1 1
test_diff-diff-changed[2.41.1] 0.8542 (1.13) 0.8542 (1.13) 0.8542 (1.13) 0.0000 (1.0) 0.8542 (1.13) 0.0000 (1.0) 0;0 1.1707 (0.89) 1 1
test_diff-diff-changed[2.45.0] 0.8457 (1.12) 0.8457 (1.12) 0.8457 (1.12) 0.0000 (1.0) 0.8457 (1.12) 0.0000 (1.0) 0;0 1.1824 (0.90) 1 1
test_diff-diff-changed[main] 0.9066 (1.20) 0.9066 (1.20) 0.9066 (1.20) 0.0000 (1.0) 0.9066 (1.20) 0.0000 (1.0) 0;0 1.1030 (0.84) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 554.3885 (1.0) 554.3885 (1.0) 554.3885 (1.0) 0.0000 (1.0) 554.3885 (1.0) 0.0000 (1.0) 0;0 1.8038 (1.0) 1 1
test_diff-diff-changed-noop[2.18.1] 748.6635 (1.35) 748.6635 (1.35) 748.6635 (1.35) 0.0000 (1.0) 748.6635 (1.35) 0.0000 (1.0) 0;0 1.3357 (0.74) 1 1
test_diff-diff-changed-noop[2.39.0] 794.2350 (1.43) 794.2350 (1.43) 794.2350 (1.43) 0.0000 (1.0) 794.2350 (1.43) 0.0000 (1.0) 0;0 1.2591 (0.70) 1 1
test_diff-diff-changed-noop[2.40.0] 750.4260 (1.35) 750.4260 (1.35) 750.4260 (1.35) 0.0000 (1.0) 750.4260 (1.35) 0.0000 (1.0) 0;0 1.3326 (0.74) 1 1
test_diff-diff-changed-noop[2.41.1] 788.8048 (1.42) 788.8048 (1.42) 788.8048 (1.42) 0.0000 (1.0) 788.8048 (1.42) 0.0000 (1.0) 0;0 1.2677 (0.70) 1 1
test_diff-diff-changed-noop[2.45.0] 834.9891 (1.51) 834.9891 (1.51) 834.9891 (1.51) 0.0000 (1.0) 834.9891 (1.51) 0.0000 (1.0) 0;0 1.1976 (0.66) 1 1
test_diff-diff-changed-noop[main] 837.9025 (1.51) 837.9025 (1.51) 837.9025 (1.51) 0.0000 (1.0) 837.9025 (1.51) 0.0000 (1.0) 0;0 1.1935 (0.66) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 521.5491 (1.0) 521.5491 (1.0) 521.5491 (1.0) 0.0000 (1.0) 521.5491 (1.0) 0.0000 (1.0) 0;0 1.9174 (1.0) 1 1
test_diff-diff-noop[2.18.1] 701.8101 (1.35) 701.8101 (1.35) 701.8101 (1.35) 0.0000 (1.0) 701.8101 (1.35) 0.0000 (1.0) 0;0 1.4249 (0.74) 1 1
test_diff-diff-noop[2.39.0] 752.8105 (1.44) 752.8105 (1.44) 752.8105 (1.44) 0.0000 (1.0) 752.8105 (1.44) 0.0000 (1.0) 0;0 1.3284 (0.69) 1 1
test_diff-diff-noop[2.40.0] 738.7983 (1.42) 738.7983 (1.42) 738.7983 (1.42) 0.0000 (1.0) 738.7983 (1.42) 0.0000 (1.0) 0;0 1.3535 (0.71) 1 1
test_diff-diff-noop[2.41.1] 758.0889 (1.45) 758.0889 (1.45) 758.0889 (1.45) 0.0000 (1.0) 758.0889 (1.45) 0.0000 (1.0) 0;0 1.3191 (0.69) 1 1
test_diff-diff-noop[2.45.0] 790.0956 (1.51) 790.0956 (1.51) 790.0956 (1.51) 0.0000 (1.0) 790.0956 (1.51) 0.0000 (1.0) 0;0 1.2657 (0.66) 1 1
test_diff-diff-noop[main] 800.0033 (1.53) 800.0033 (1.53) 800.0033 (1.53) 0.0000 (1.0) 800.0033 (1.53) 0.0000 (1.0) 0;0 1.2500 (0.65) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 592.8908 (1.09) 592.8908 (1.09) 592.8908 (1.09) 0.0000 (1.0) 592.8908 (1.09) 0.0000 (1.0) 0;0 1.6867 (0.91) 1 1
test_list-list[2.18.1] 542.3997 (1.0) 542.3997 (1.0) 542.3997 (1.0) 0.0000 (1.0) 542.3997 (1.0) 0.0000 (1.0) 0;0 1.8437 (1.0) 1 1
test_list-list[2.39.0] 573.2895 (1.06) 573.2895 (1.06) 573.2895 (1.06) 0.0000 (1.0) 573.2895 (1.06) 0.0000 (1.0) 0;0 1.7443 (0.95) 1 1
test_list-list[2.40.0] 572.0089 (1.05) 572.0089 (1.05) 572.0089 (1.05) 0.0000 (1.0) 572.0089 (1.05) 0.0000 (1.0) 0;0 1.7482 (0.95) 1 1
test_list-list[2.41.1] 599.1033 (1.10) 599.1033 (1.10) 599.1033 (1.10) 0.0000 (1.0) 599.1033 (1.10) 0.0000 (1.0) 0;0 1.6692 (0.91) 1 1
test_list-list[2.45.0] 622.5258 (1.15) 622.5258 (1.15) 622.5258 (1.15) 0.0000 (1.0) 622.5258 (1.15) 0.0000 (1.0) 0;0 1.6064 (0.87) 1 1
test_list-list[main] 714.5087 (1.32) 714.5087 (1.32) 714.5087 (1.32) 0.0000 (1.0) 714.5087 (1.32) 0.0000 (1.0) 0;0 1.3996 (0.76) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 574.7508 (1.07) 574.7508 (1.07) 574.7508 (1.07) 0.0000 (1.0) 574.7508 (1.07) 0.0000 (1.0) 0;0 1.7399 (0.93) 1 1
test_list-list-dvc-only[2.18.1] 537.2035 (1.0) 537.2035 (1.0) 537.2035 (1.0) 0.0000 (1.0) 537.2035 (1.0) 0.0000 (1.0) 0;0 1.8615 (1.0) 1 1
test_list-list-dvc-only[2.39.0] 565.1695 (1.05) 565.1695 (1.05) 565.1695 (1.05) 0.0000 (1.0) 565.1695 (1.05) 0.0000 (1.0) 0;0 1.7694 (0.95) 1 1
test_list-list-dvc-only[2.40.0] 574.6322 (1.07) 574.6322 (1.07) 574.6322 (1.07) 0.0000 (1.0) 574.6322 (1.07) 0.0000 (1.0) 0;0 1.7402 (0.93) 1 1
test_list-list-dvc-only[2.41.1] 573.2120 (1.07) 573.2120 (1.07) 573.2120 (1.07) 0.0000 (1.0) 573.2120 (1.07) 0.0000 (1.0) 0;0 1.7446 (0.94) 1 1
test_list-list-dvc-only[2.45.0] 610.8509 (1.14) 610.8509 (1.14) 610.8509 (1.14) 0.0000 (1.0) 610.8509 (1.14) 0.0000 (1.0) 0;0 1.6371 (0.88) 1 1
test_list-list-dvc-only[main] 707.0519 (1.32) 707.0519 (1.32) 707.0519 (1.32) 0.0000 (1.0) 707.0519 (1.32) 0.0000 (1.0) 0;0 1.4143 (0.76) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 2.3843 (3.62) 2.3843 (3.62) 2.3843 (3.62) 0.0000 (1.0) 2.3843 (3.62) 0.0000 (1.0) 0;0 0.4194 (0.28) 1 1
test_list-list-recursive[2.18.1] 3.3783 (5.13) 3.3783 (5.13) 3.3783 (5.13) 0.0000 (1.0) 3.3783 (5.13) 0.0000 (1.0) 0;0 0.2960 (0.19) 1 1
test_list-list-recursive[2.39.0] 1.1245 (1.71) 1.1245 (1.71) 1.1245 (1.71) 0.0000 (1.0) 1.1245 (1.71) 0.0000 (1.0) 0;0 0.8893 (0.59) 1 1
test_list-list-recursive[2.40.0] 0.6585 (1.0) 0.6585 (1.0) 0.6585 (1.0) 0.0000 (1.0) 0.6585 (1.0) 0.0000 (1.0) 0;0 1.5185 (1.0) 1 1
test_list-list-recursive[2.41.1] 0.6732 (1.02) 0.6732 (1.02) 0.6732 (1.02) 0.0000 (1.0) 0.6732 (1.02) 0.0000 (1.0) 0;0 1.4855 (0.98) 1 1
test_list-list-recursive[2.45.0] 0.6874 (1.04) 0.6874 (1.04) 0.6874 (1.04) 0.0000 (1.0) 0.6874 (1.04) 0.0000 (1.0) 0;0 1.4548 (0.96) 1 1
test_list-list-recursive[main] 0.8425 (1.28) 0.8425 (1.28) 0.8425 (1.28) 0.0000 (1.0) 0.8425 (1.28) 0.0000 (1.0) 0;0 1.1869 (0.78) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 569.1245 (1.0) 569.1245 (1.0) 569.1245 (1.0) 0.0000 (1.0) 569.1245 (1.0) 0.0000 (1.0) 0;0 1.7571 (1.0) 1 1
test_list-list-shallow[2.18.1] 577.6588 (1.01) 577.6588 (1.01) 577.6588 (1.01) 0.0000 (1.0) 577.6588 (1.01) 0.0000 (1.0) 0;0 1.7311 (0.99) 1 1
test_list-list-shallow[2.39.0] 593.8757 (1.04) 593.8757 (1.04) 593.8757 (1.04) 0.0000 (1.0) 593.8757 (1.04) 0.0000 (1.0) 0;0 1.6839 (0.96) 1 1
test_list-list-shallow[2.40.0] 619.8594 (1.09) 619.8594 (1.09) 619.8594 (1.09) 0.0000 (1.0) 619.8594 (1.09) 0.0000 (1.0) 0;0 1.6133 (0.92) 1 1
test_list-list-shallow[2.41.1] 610.7074 (1.07) 610.7074 (1.07) 610.7074 (1.07) 0.0000 (1.0) 610.7074 (1.07) 0.0000 (1.0) 0;0 1.6374 (0.93) 1 1
test_list-list-shallow[2.45.0] 648.4691 (1.14) 648.4691 (1.14) 648.4691 (1.14) 0.0000 (1.0) 648.4691 (1.14) 0.0000 (1.0) 0;0 1.5421 (0.88) 1 1
test_list-list-shallow[main] 693.5230 (1.22) 693.5230 (1.22) 693.5230 (1.22) 0.0000 (1.0) 693.5230 (1.22) 0.0000 (1.0) 0;0 1.4419 (0.82) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.2779 (1.03) 1.2779 (1.03) 1.2779 (1.03) 0.0000 (1.0) 1.2779 (1.03) 0.0000 (1.0) 0;0 0.7825 (0.97) 1 1
test_checkout_hardlink-checkout[2.18.1] 1.2706 (1.02) 1.2706 (1.02) 1.2706 (1.02) 0.0000 (1.0) 1.2706 (1.02) 0.0000 (1.0) 0;0 0.7870 (0.98) 1 1
test_checkout_hardlink-checkout[2.39.0] 1.5601 (1.25) 1.5601 (1.25) 1.5601 (1.25) 0.0000 (1.0) 1.5601 (1.25) 0.0000 (1.0) 0;0 0.6410 (0.80) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.2444 (1.0) 1.2444 (1.0) 1.2444 (1.0) 0.0000 (1.0) 1.2444 (1.0) 0.0000 (1.0) 0;0 0.8036 (1.0) 1 1
test_checkout_hardlink-checkout[2.41.1] 1.2481 (1.00) 1.2481 (1.00) 1.2481 (1.00) 0.0000 (1.0) 1.2481 (1.00) 0.0000 (1.0) 0;0 0.8012 (1.00) 1 1
test_checkout_hardlink-checkout[2.45.0] 1.5766 (1.27) 1.5766 (1.27) 1.5766 (1.27) 0.0000 (1.0) 1.5766 (1.27) 0.0000 (1.0) 0;0 0.6343 (0.79) 1 1
test_checkout_hardlink-checkout[main] 1.3872 (1.11) 1.3872 (1.11) 1.3872 (1.11) 0.0000 (1.0) 1.3872 (1.11) 0.0000 (1.0) 0;0 0.7209 (0.90) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 492.4573 (1.0) 492.4573 (1.0) 492.4573 (1.0) 0.0000 (1.0) 492.4573 (1.0) 0.0000 (1.0) 0;0 2.0306 (1.0) 1 1
test_checkout_hardlink-checkout-noop[2.18.1] 566.4912 (1.15) 566.4912 (1.15) 566.4912 (1.15) 0.0000 (1.0) 566.4912 (1.15) 0.0000 (1.0) 0;0 1.7653 (0.87) 1 1
test_checkout_hardlink-checkout-noop[2.39.0] 586.8324 (1.19) 586.8324 (1.19) 586.8324 (1.19) 0.0000 (1.0) 586.8324 (1.19) 0.0000 (1.0) 0;0 1.7041 (0.84) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 585.1646 (1.19) 585.1646 (1.19) 585.1646 (1.19) 0.0000 (1.0) 585.1646 (1.19) 0.0000 (1.0) 0;0 1.7089 (0.84) 1 1
test_checkout_hardlink-checkout-noop[2.41.1] 590.0084 (1.20) 590.0084 (1.20) 590.0084 (1.20) 0.0000 (1.0) 590.0084 (1.20) 0.0000 (1.0) 0;0 1.6949 (0.83) 1 1
test_checkout_hardlink-checkout-noop[2.45.0] 612.3606 (1.24) 612.3606 (1.24) 612.3606 (1.24) 0.0000 (1.0) 612.3606 (1.24) 0.0000 (1.0) 0;0 1.6330 (0.80) 1 1
test_checkout_hardlink-checkout-noop[main] 679.3970 (1.38) 679.3970 (1.38) 679.3970 (1.38) 0.0000 (1.0) 679.3970 (1.38) 0.0000 (1.0) 0;0 1.4719 (0.72) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.2743 (1.97) 1.2743 (1.97) 1.2743 (1.97) 0.0000 (1.0) 1.2743 (1.97) 0.0000 (1.0) 0;0 0.7847 (0.51) 1 1
test_checkout_hardlink-checkout-update[2.18.1] 0.6467 (1.0) 0.6467 (1.0) 0.6467 (1.0) 0.0000 (1.0) 0.6467 (1.0) 0.0000 (1.0) 0;0 1.5464 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.39.0] 0.6652 (1.03) 0.6652 (1.03) 0.6652 (1.03) 0.0000 (1.0) 0.6652 (1.03) 0.0000 (1.0) 0;0 1.5033 (0.97) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.6519 (1.01) 0.6519 (1.01) 0.6519 (1.01) 0.0000 (1.0) 0.6519 (1.01) 0.0000 (1.0) 0;0 1.5340 (0.99) 1 1
test_checkout_hardlink-checkout-update[2.41.1] 0.6672 (1.03) 0.6672 (1.03) 0.6672 (1.03) 0.0000 (1.0) 0.6672 (1.03) 0.0000 (1.0) 0;0 1.4988 (0.97) 1 1
test_checkout_hardlink-checkout-update[2.45.0] 0.6766 (1.05) 0.6766 (1.05) 0.6766 (1.05) 0.0000 (1.0) 0.6766 (1.05) 0.0000 (1.0) 0;0 1.4781 (0.96) 1 1
test_checkout_hardlink-checkout-update[main] 0.8642 (1.34) 0.8642 (1.34) 0.8642 (1.34) 0.0000 (1.0) 0.8642 (1.34) 0.0000 (1.0) 0;0 1.1572 (0.75) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 5.1372 (1.10) 5.1372 (1.10) 5.1372 (1.10) 0.0000 (1.0) 5.1372 (1.10) 0.0000 (1.0) 0;0 0.1947 (0.91) 1 1
test_push-push[2.18.1] 5.1752 (1.10) 5.1752 (1.10) 5.1752 (1.10) 0.0000 (1.0) 5.1752 (1.10) 0.0000 (1.0) 0;0 0.1932 (0.91) 1 1
test_push-push[2.39.0] 6.7868 (1.45) 6.7868 (1.45) 6.7868 (1.45) 0.0000 (1.0) 6.7868 (1.45) 0.0000 (1.0) 0;0 0.1473 (0.69) 1 1
test_push-push[2.40.0] 6.6899 (1.43) 6.6899 (1.43) 6.6899 (1.43) 0.0000 (1.0) 6.6899 (1.43) 0.0000 (1.0) 0;0 0.1495 (0.70) 1 1
test_push-push[2.41.1] 6.7856 (1.45) 6.7856 (1.45) 6.7856 (1.45) 0.0000 (1.0) 6.7856 (1.45) 0.0000 (1.0) 0;0 0.1474 (0.69) 1 1
test_push-push[2.45.0] 4.6858 (1.0) 4.6858 (1.0) 4.6858 (1.0) 0.0000 (1.0) 4.6858 (1.0) 0.0000 (1.0) 0;0 0.2134 (1.0) 1 1
test_push-push[main] 4.7189 (1.01) 4.7189 (1.01) 4.7189 (1.01) 0.0000 (1.0) 4.7189 (1.01) 0.0000 (1.0) 0;0 0.2119 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial-add[2.11.0] 8.5998 (1.88) 8.5998 (1.88) 8.5998 (1.88) 0.0000 (1.0) 8.5998 (1.88) 0.0000 (1.0) 0;0 0.1163 (0.53) 1 1
test_partial_add-add-partial-add[2.18.1] 7.4492 (1.63) 7.4492 (1.63) 7.4492 (1.63) 0.0000 (1.0) 7.4492 (1.63) 0.0000 (1.0) 0;0 0.1342 (0.61) 1 1
test_partial_add-add-partial-add[2.39.0] 6.4263 (1.41) 6.4263 (1.41) 6.4263 (1.41) 0.0000 (1.0) 6.4263 (1.41) 0.0000 (1.0) 0;0 0.1556 (0.71) 1 1
test_partial_add-add-partial-add[2.40.0] 6.3507 (1.39) 6.3507 (1.39) 6.3507 (1.39) 0.0000 (1.0) 6.3507 (1.39) 0.0000 (1.0) 0;0 0.1575 (0.72) 1 1
test_partial_add-add-partial-add[2.41.1] 6.5777 (1.44) 6.5777 (1.44) 6.5777 (1.44) 0.0000 (1.0) 6.5777 (1.44) 0.0000 (1.0) 0;0 0.1520 (0.69) 1 1
test_partial_add-add-partial-add[2.45.0] 5.0152 (1.10) 5.0152 (1.10) 5.0152 (1.10) 0.0000 (1.0) 5.0152 (1.10) 0.0000 (1.0) 0;0 0.1994 (0.91) 1 1
test_partial_add-add-partial-add[main] 4.5648 (1.0) 4.5648 (1.0) 4.5648 (1.0) 0.0000 (1.0) 4.5648 (1.0) 0.0000 (1.0) 0;0 0.2191 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 600.4891 (1.0) 600.4891 (1.0) 600.4891 (1.0) 0.0000 (1.0) 600.4891 (1.0) 0.0000 (1.0) 0;0 1.6653 (1.0) 1 1
test_partial_add-gc-cloud-noop[2.18.1] 649.8080 (1.08) 649.8080 (1.08) 649.8080 (1.08) 0.0000 (1.0) 649.8080 (1.08) 0.0000 (1.0) 0;0 1.5389 (0.92) 1 1
test_partial_add-gc-cloud-noop[2.39.0] 672.6673 (1.12) 672.6673 (1.12) 672.6673 (1.12) 0.0000 (1.0) 672.6673 (1.12) 0.0000 (1.0) 0;0 1.4866 (0.89) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 702.4800 (1.17) 702.4800 (1.17) 702.4800 (1.17) 0.0000 (1.0) 702.4800 (1.17) 0.0000 (1.0) 0;0 1.4235 (0.85) 1 1
test_partial_add-gc-cloud-noop[2.41.1] 757.4132 (1.26) 757.4132 (1.26) 757.4132 (1.26) 0.0000 (1.0) 757.4132 (1.26) 0.0000 (1.0) 0;0 1.3203 (0.79) 1 1
test_partial_add-gc-cloud-noop[2.45.0] 673.3449 (1.12) 673.3449 (1.12) 673.3449 (1.12) 0.0000 (1.0) 673.3449 (1.12) 0.0000 (1.0) 0;0 1.4851 (0.89) 1 1
test_partial_add-gc-cloud-noop[main] 786.9105 (1.31) 786.9105 (1.31) 786.9105 (1.31) 0.0000 (1.0) 786.9105 (1.31) 0.0000 (1.0) 0;0 1.2708 (0.76) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 507.0999 (1.0) 507.0999 (1.0) 507.0999 (1.0) 0.0000 (1.0) 507.0999 (1.0) 0.0000 (1.0) 0;0 1.9720 (1.0) 1 1
test_partial_add-gc-noop[2.18.1] 585.7809 (1.16) 585.7809 (1.16) 585.7809 (1.16) 0.0000 (1.0) 585.7809 (1.16) 0.0000 (1.0) 0;0 1.7071 (0.87) 1 1
test_partial_add-gc-noop[2.39.0] 592.5541 (1.17) 592.5541 (1.17) 592.5541 (1.17) 0.0000 (1.0) 592.5541 (1.17) 0.0000 (1.0) 0;0 1.6876 (0.86) 1 1
test_partial_add-gc-noop[2.40.0] 648.9943 (1.28) 648.9943 (1.28) 648.9943 (1.28) 0.0000 (1.0) 648.9943 (1.28) 0.0000 (1.0) 0;0 1.5408 (0.78) 1 1
test_partial_add-gc-noop[2.41.1] 652.8026 (1.29) 652.8026 (1.29) 652.8026 (1.29) 0.0000 (1.0) 652.8026 (1.29) 0.0000 (1.0) 0;0 1.5319 (0.78) 1 1
test_partial_add-gc-noop[2.45.0] 651.2701 (1.28) 651.2701 (1.28) 651.2701 (1.28) 0.0000 (1.0) 651.2701 (1.28) 0.0000 (1.0) 0;0 1.5355 (0.78) 1 1
test_partial_add-gc-noop[main] 706.0086 (1.39) 706.0086 (1.39) 706.0086 (1.39) 0.0000 (1.0) 706.0086 (1.39) 0.0000 (1.0) 0;0 1.4164 (0.72) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial-add[2.11.0] 3.0871 (1.16) 3.0871 (1.16) 3.0871 (1.16) 0.0000 (1.0) 3.0871 (1.16) 0.0000 (1.0) 0;0 0.3239 (0.86) 1 1
test_partial_add-push-partial-add[2.18.1] 3.0974 (1.16) 3.0974 (1.16) 3.0974 (1.16) 0.0000 (1.0) 3.0974 (1.16) 0.0000 (1.0) 0;0 0.3228 (0.86) 1 1
test_partial_add-push-partial-add[2.39.0] 3.7443 (1.40) 3.7443 (1.40) 3.7443 (1.40) 0.0000 (1.0) 3.7443 (1.40) 0.0000 (1.0) 0;0 0.2671 (0.71) 1 1
test_partial_add-push-partial-add[2.40.0] 3.6586 (1.37) 3.6586 (1.37) 3.6586 (1.37) 0.0000 (1.0) 3.6586 (1.37) 0.0000 (1.0) 0;0 0.2733 (0.73) 1 1
test_partial_add-push-partial-add[2.41.1] 3.9332 (1.48) 3.9332 (1.48) 3.9332 (1.48) 0.0000 (1.0) 3.9332 (1.48) 0.0000 (1.0) 0;0 0.2542 (0.68) 1 1
test_partial_add-push-partial-add[2.45.0] 2.6663 (1.0) 2.6663 (1.0) 2.6663 (1.0) 0.0000 (1.0) 2.6663 (1.0) 0.0000 (1.0) 0;0 0.3750 (1.0) 1 1
test_partial_add-push-partial-add[main] 2.8041 (1.05) 2.8041 (1.05) 2.8041 (1.05) 0.0000 (1.0) 2.8041 (1.05) 0.0000 (1.0) 0;0 0.3566 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 424.3270 (1.0) 424.3270 (1.0) 424.3270 (1.0) 0.0000 (1.0) 424.3270 (1.0) 0.0000 (1.0) 0;0 2.3567 (1.0) 1 1
test_gc-gc[2.18.1] 441.0749 (1.04) 441.0749 (1.04) 441.0749 (1.04) 0.0000 (1.0) 441.0749 (1.04) 0.0000 (1.0) 0;0 2.2672 (0.96) 1 1
test_gc-gc[2.39.0] 487.2130 (1.15) 487.2130 (1.15) 487.2130 (1.15) 0.0000 (1.0) 487.2130 (1.15) 0.0000 (1.0) 0;0 2.0525 (0.87) 1 1
test_gc-gc[2.40.0] 483.5113 (1.14) 483.5113 (1.14) 483.5113 (1.14) 0.0000 (1.0) 483.5113 (1.14) 0.0000 (1.0) 0;0 2.0682 (0.88) 1 1
test_gc-gc[2.41.1] 482.3159 (1.14) 482.3159 (1.14) 482.3159 (1.14) 0.0000 (1.0) 482.3159 (1.14) 0.0000 (1.0) 0;0 2.0733 (0.88) 1 1
test_gc-gc[2.45.0] 475.1339 (1.12) 475.1339 (1.12) 475.1339 (1.12) 0.0000 (1.0) 475.1339 (1.12) 0.0000 (1.0) 0;0 2.1047 (0.89) 1 1
test_gc-gc[main] 537.8567 (1.27) 537.8567 (1.27) 537.8567 (1.27) 0.0000 (1.0) 537.8567 (1.27) 0.0000 (1.0) 0;0 1.8592 (0.79) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_pull-pull': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 6.5159 (1.28) 6.5159 (1.28) 6.5159 (1.28) 0.0000 (1.0) 6.5159 (1.28) 0.0000 (1.0) 0;0 0.1535 (0.78) 1 1
test_pull-pull[2.18.1] 6.5703 (1.29) 6.5703 (1.29) 6.5703 (1.29) 0.0000 (1.0) 6.5703 (1.29) 0.0000 (1.0) 0;0 0.1522 (0.78) 1 1
test_pull-pull[2.39.0] 7.8540 (1.54) 7.8540 (1.54) 7.8540 (1.54) 0.0000 (1.0) 7.8540 (1.54) 0.0000 (1.0) 0;0 0.1273 (0.65) 1 1
test_pull-pull[2.40.0] 7.9463 (1.56) 7.9463 (1.56) 7.9463 (1.56) 0.0000 (1.0) 7.9463 (1.56) 0.0000 (1.0) 0;0 0.1258 (0.64) 1 1
test_pull-pull[2.41.1] 7.6775 (1.50) 7.6775 (1.50) 7.6775 (1.50) 0.0000 (1.0) 7.6775 (1.50) 0.0000 (1.0) 0;0 0.1303 (0.66) 1 1
test_pull-pull[2.45.0] 6.3253 (1.24) 6.3253 (1.24) 6.3253 (1.24) 0.0000 (1.0) 6.3253 (1.24) 0.0000 (1.0) 0;0 0.1581 (0.81) 1 1
test_pull-pull[main] 5.1024 (1.0) 5.1024 (1.0) 5.1024 (1.0) 0.0000 (1.0) 5.1024 (1.0) 0.0000 (1.0) 0;0 0.1960 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-update': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 9.2685 (1.29) 9.2685 (1.29) 9.2685 (1.29) 0.0000 (1.0) 9.2685 (1.29) 0.0000 (1.0) 0;0 0.1079 (0.78) 1 1
test_update-update[2.18.1] 8.2877 (1.15) 8.2877 (1.15) 8.2877 (1.15) 0.0000 (1.0) 8.2877 (1.15) 0.0000 (1.0) 0;0 0.1207 (0.87) 1 1
test_update-update[2.39.0] 7.4408 (1.04) 7.4408 (1.04) 7.4408 (1.04) 0.0000 (1.0) 7.4408 (1.04) 0.0000 (1.0) 0;0 0.1344 (0.97) 1 1
test_update-update[2.40.0] 7.4972 (1.04) 7.4972 (1.04) 7.4972 (1.04) 0.0000 (1.0) 7.4972 (1.04) 0.0000 (1.0) 0;0 0.1334 (0.96) 1 1
test_update-update[2.41.1] 7.4502 (1.04) 7.4502 (1.04) 7.4502 (1.04) 0.0000 (1.0) 7.4502 (1.04) 0.0000 (1.0) 0;0 0.1342 (0.96) 1 1
test_update-update[2.45.0] 7.5724 (1.05) 7.5724 (1.05) 7.5724 (1.05) 0.0000 (1.0) 7.5724 (1.05) 0.0000 (1.0) 0;0 0.1321 (0.95) 1 1
test_update-update[main] 7.1873 (1.0) 7.1873 (1.0) 7.1873 (1.0) 0.0000 (1.0) 7.1873 (1.0) 0.0000 (1.0) 0;0 0.1391 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 7 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 502.1570 (1.0) 502.1570 (1.0) 502.1570 (1.0) 0.0000 (1.0) 502.1570 (1.0) 0.0000 (1.0) 0;0 1.9914 (1.0) 1 1
test_update-update-noop[2.18.1] 657.0770 (1.31) 657.0770 (1.31) 657.0770 (1.31) 0.0000 (1.0) 657.0770 (1.31) 0.0000 (1.0) 0;0 1.5219 (0.76) 1 1
test_update-update-noop[2.39.0] 960.4487 (1.91) 960.4487 (1.91) 960.4487 (1.91) 0.0000 (1.0) 960.4487 (1.91) 0.0000 (1.0) 0;0 1.0412 (0.52) 1 1
test_update-update-noop[2.40.0] 964.6782 (1.92) 964.6782 (1.92) 964.6782 (1.92) 0.0000 (1.0) 964.6782 (1.92) 0.0000 (1.0) 0;0 1.0366 (0.52) 1 1
test_update-update-noop[2.41.1] 960.2755 (1.91) 960.2755 (1.91) 960.2755 (1.91) 0.0000 (1.0) 960.2755 (1.91) 0.0000 (1.0) 0;0 1.0414 (0.52) 1 1
test_update-update-noop[2.45.0] 1,051.8832 (2.09) 1,051.8832 (2.09) 1,051.8832 (2.09) 0.0000 (1.0) 1,051.8832 (2.09) 0.0000 (1.0) 0;0 0.9507 (0.48) 1 1
test_update-update-noop[main] 1,151.5424 (2.29) 1,151.5424 (2.29) 1,151.5424 (2.29) 0.0000 (1.0) 1,151.5424 (2.29) 0.0000 (1.0) 0;0 0.8684 (0.44) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 6 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.18.1] 697.6491 (1.01) 697.6491 (1.01) 697.6491 (1.01) 0.0000 (1.0) 697.6491 (1.01) 0.0000 (1.0) 0;0 1.4334 (0.99) 1 1
test_data_status-data-changed[2.39.0] 1,059.0521 (1.53) 1,059.0521 (1.53) 1,059.0521 (1.53) 0.0000 (1.0) 1,059.0521 (1.53) 0.0000 (1.0) 0;0 0.9442 (0.65) 1 1
test_data_status-data-changed[2.40.0] 734.0682 (1.06) 734.0682 (1.06) 734.0682 (1.06) 0.0000 (1.0) 734.0682 (1.06) 0.0000 (1.0) 0;0 1.3623 (0.94) 1 1
test_data_status-data-changed[2.41.1] 724.6718 (1.05) 724.6718 (1.05) 724.6718 (1.05) 0.0000 (1.0) 724.6718 (1.05) 0.0000 (1.0) 0;0 1.3799 (0.95) 1 1
test_data_status-data-changed[2.45.0] 690.7816 (1.0) 690.7816 (1.0) 690.7816 (1.0) 0.0000 (1.0) 690.7816 (1.0) 0.0000 (1.0) 0;0 1.4476 (1.0) 1 1
test_data_status-data-changed[main] 754.5851 (1.09) 754.5851 (1.09) 754.5851 (1.09) 0.0000 (1.0) 754.5851 (1.09) 0.0000 (1.0) 0;0 1.3252 (0.92) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.18.1] 709.7318 (1.04) 709.7318 (1.04) 709.7318 (1.04) 0.0000 (1.0) 709.7318 (1.04) 0.0000 (1.0) 0;0 1.4090 (0.96) 1 1
test_data_status-data-changed-noop[2.39.0] 728.0175 (1.07) 728.0175 (1.07) 728.0175 (1.07) 0.0000 (1.0) 728.0175 (1.07) 0.0000 (1.0) 0;0 1.3736 (0.93) 1 1
test_data_status-data-changed-noop[2.40.0] 721.5142 (1.06) 721.5142 (1.06) 721.5142 (1.06) 0.0000 (1.0) 721.5142 (1.06) 0.0000 (1.0) 0;0 1.3860 (0.94) 1 1
test_data_status-data-changed-noop[2.41.1] 733.1839 (1.08) 733.1839 (1.08) 733.1839 (1.08) 0.0000 (1.0) 733.1839 (1.08) 0.0000 (1.0) 0;0 1.3639 (0.93) 1 1
test_data_status-data-changed-noop[2.45.0] 680.5580 (1.0) 680.5580 (1.0) 680.5580 (1.0) 0.0000 (1.0) 680.5580 (1.0) 0.0000 (1.0) 0;0 1.4694 (1.0) 1 1
test_data_status-data-changed-noop[main] 746.8501 (1.10) 746.8501 (1.10) 746.8501 (1.10) 0.0000 (1.0) 746.8501 (1.10) 0.0000 (1.0) 0;0 1.3390 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.18.1] 1.5572 (1.04) 1.5572 (1.04) 1.5572 (1.04) 0.0000 (1.0) 1.5572 (1.04) 0.0000 (1.0) 0;0 0.6422 (0.97) 1 1
test_data_status-data-new[2.39.0] 1.5954 (1.06) 1.5954 (1.06) 1.5954 (1.06) 0.0000 (1.0) 1.5954 (1.06) 0.0000 (1.0) 0;0 0.6268 (0.94) 1 1
test_data_status-data-new[2.40.0] 1.5849 (1.05) 1.5849 (1.05) 1.5849 (1.05) 0.0000 (1.0) 1.5849 (1.05) 0.0000 (1.0) 0;0 0.6309 (0.95) 1 1
test_data_status-data-new[2.41.1] 1.5794 (1.05) 1.5794 (1.05) 1.5794 (1.05) 0.0000 (1.0) 1.5794 (1.05) 0.0000 (1.0) 0;0 0.6331 (0.95) 1 1
test_data_status-data-new[2.45.0] 1.5027 (1.0) 1.5027 (1.0) 1.5027 (1.0) 0.0000 (1.0) 1.5027 (1.0) 0.0000 (1.0) 0;0 0.6655 (1.0) 1 1
test_data_status-data-new[main] 1.5500 (1.03) 1.5500 (1.03) 1.5500 (1.03) 0.0000 (1.0) 1.5500 (1.03) 0.0000 (1.0) 0;0 0.6452 (0.97) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 6 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.18.1] 690.4830 (1.0) 690.4830 (1.0) 690.4830 (1.0) 0.0000 (1.0) 690.4830 (1.0) 0.0000 (1.0) 0;0 1.4483 (1.0) 1 1
test_data_status-data-noop[2.39.0] 723.6690 (1.05) 723.6690 (1.05) 723.6690 (1.05) 0.0000 (1.0) 723.6690 (1.05) 0.0000 (1.0) 0;0 1.3818 (0.95) 1 1
test_data_status-data-noop[2.40.0] 716.0273 (1.04) 716.0273 (1.04) 716.0273 (1.04) 0.0000 (1.0) 716.0273 (1.04) 0.0000 (1.0) 0;0 1.3966 (0.96) 1 1
test_data_status-data-noop[2.41.1] 712.4074 (1.03) 712.4074 (1.03) 712.4074 (1.03) 0.0000 (1.0) 712.4074 (1.03) 0.0000 (1.0) 0;0 1.4037 (0.97) 1 1
test_data_status-data-noop[2.45.0] 704.0995 (1.02) 704.0995 (1.02) 704.0995 (1.02) 0.0000 (1.0) 704.0995 (1.02) 0.0000 (1.0) 0;0 1.4203 (0.98) 1 1
test_data_status-data-noop[main] 742.4177 (1.08) 742.4177 (1.08) 742.4177 (1.08) 0.0000 (1.0) 742.4177 (1.08) 0.0000 (1.0) 0;0 1.3470 (0.93) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 7 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 395.8899 (1.0) 454.6178 (1.01) 403.1898 (1.0) 8.4036 (1.27) 400.9758 (1.0) 5.3411 (1.0) 9;9 2.4802 (1.0) 100 1
test_init-init[2.18.1] 404.9862 (1.02) 448.4787 (1.0) 417.2278 (1.03) 9.7371 (1.47) 414.0650 (1.03) 9.3228 (1.75) 23;8 2.3968 (0.97) 100 1
test_init-init[2.39.0] 472.4129 (1.19) 507.9611 (1.13) 484.0856 (1.20) 6.8105 (1.03) 483.3212 (1.21) 8.1765 (1.53) 29;3 2.0658 (0.83) 100 1
test_init-init[2.40.0] 471.8044 (1.19) 562.7164 (1.25) 486.5706 (1.21) 13.1348 (1.98) 483.2894 (1.21) 8.5103 (1.59) 9;6 2.0552 (0.83) 100 1
test_init-init[2.41.1] 473.1704 (1.20) 507.9102 (1.13) 481.7497 (1.19) 6.6374 (1.0) 480.2905 (1.20) 5.8913 (1.10) 21;6 2.0758 (0.84) 100 1
test_init-init[2.45.0] 469.5115 (1.19) 517.1466 (1.15) 484.7355 (1.20) 8.7577 (1.32) 482.9236 (1.20) 9.2568 (1.73) 23;5 2.0630 (0.83) 100 1
test_init-init[main] 582.9142 (1.47) 691.8107 (1.54) 599.9476 (1.49) 16.6615 (2.51) 596.6981 (1.49) 8.5698 (1.60) 5;5 1.6668 (0.67) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 14 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0] 7.1127 (1.84) 7.1127 (1.84) 7.1127 (1.84) 0.0000 (1.0) 7.1127 (1.84) 0.0000 (1.0) 0;0 0.1406 (0.54) 1 1
test_sharing_s3-add[2.11.0] 6.8223 (1.76) 6.8223 (1.76) 6.8223 (1.76) 0.0000 (1.0) 6.8223 (1.76) 0.0000 (1.0) 0;0 0.1466 (0.57) 1 1
test_sharing_s3-add[2.18.1] 6.3778 (1.65) 6.3778 (1.65) 6.3778 (1.65) 0.0000 (1.0) 6.3778 (1.65) 0.0000 (1.0) 0;0 0.1568 (0.61) 1 1
test_sharing_s3-add[2.18.1] 6.0586 (1.57) 6.0586 (1.57) 6.0586 (1.57) 0.0000 (1.0) 6.0586 (1.57) 0.0000 (1.0) 0;0 0.1651 (0.64) 1 1
test_sharing_s3-add[2.39.0] 5.8724 (1.52) 5.8724 (1.52) 5.8724 (1.52) 0.0000 (1.0) 5.8724 (1.52) 0.0000 (1.0) 0;0 0.1703 (0.66) 1 1
test_sharing_s3-add[2.39.0] 5.7845 (1.50) 5.7845 (1.50) 5.7845 (1.50) 0.0000 (1.0) 5.7845 (1.50) 0.0000 (1.0) 0;0 0.1729 (0.67) 1 1
test_sharing_s3-add[2.40.0] 5.8056 (1.50) 5.8056 (1.50) 5.8056 (1.50) 0.0000 (1.0) 5.8056 (1.50) 0.0000 (1.0) 0;0 0.1722 (0.67) 1 1
test_sharing_s3-add[2.40.0] 5.8007 (1.50) 5.8007 (1.50) 5.8007 (1.50) 0.0000 (1.0) 5.8007 (1.50) 0.0000 (1.0) 0;0 0.1724 (0.67) 1 1
test_sharing_s3-add[2.41.1] 5.7155 (1.48) 5.7155 (1.48) 5.7155 (1.48) 0.0000 (1.0) 5.7155 (1.48) 0.0000 (1.0) 0;0 0.1750 (0.68) 1 1
test_sharing_s3-add[2.41.1] 5.7842 (1.50) 5.7842 (1.50) 5.7842 (1.50) 0.0000 (1.0) 5.7842 (1.50) 0.0000 (1.0) 0;0 0.1729 (0.67) 1 1
test_sharing_s3-add[2.45.0] 3.8791 (1.00) 3.8791 (1.00) 3.8791 (1.00) 0.0000 (1.0) 3.8791 (1.00) 0.0000 (1.0) 0;0 0.2578 (1.00) 1 1
test_sharing_s3-add[2.45.0] 3.8690 (1.0) 3.8690 (1.0) 3.8690 (1.0) 0.0000 (1.0) 3.8690 (1.0) 0.0000 (1.0) 0;0 0.2585 (1.0) 1 1
test_sharing_s3-add[main] 3.9447 (1.02) 3.9447 (1.02) 3.9447 (1.02) 0.0000 (1.0) 3.9447 (1.02) 0.0000 (1.0) 0;0 0.2535 (0.98) 1 1
test_sharing_s3-add[main] 3.9680 (1.03) 3.9680 (1.03) 3.9680 (1.03) 0.0000 (1.0) 3.9680 (1.03) 0.0000 (1.0) 0;0 0.2520 (0.98) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 14 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0] 3.4345 (1.43) 3.4345 (1.43) 3.4345 (1.43) 0.0000 (1.0) 3.4345 (1.43) 0.0000 (1.0) 0;0 0.2912 (0.70) 1 1
test_sharing_s3-add-noop[2.11.0] 3.3746 (1.41) 3.3746 (1.41) 3.3746 (1.41) 0.0000 (1.0) 3.3746 (1.41) 0.0000 (1.0) 0;0 0.2963 (0.71) 1 1
test_sharing_s3-add-noop[2.18.1] 3.6189 (1.51) 3.6189 (1.51) 3.6189 (1.51) 0.0000 (1.0) 3.6189 (1.51) 0.0000 (1.0) 0;0 0.2763 (0.66) 1 1
test_sharing_s3-add-noop[2.18.1] 3.6018 (1.50) 3.6018 (1.50) 3.6018 (1.50) 0.0000 (1.0) 3.6018 (1.50) 0.0000 (1.0) 0;0 0.2776 (0.67) 1 1
test_sharing_s3-add-noop[2.39.0] 2.3968 (1.00) 2.3968 (1.00) 2.3968 (1.00) 0.0000 (1.0) 2.3968 (1.00) 0.0000 (1.0) 0;0 0.4172 (1.00) 1 1
test_sharing_s3-add-noop[2.39.0] 2.3964 (1.0) 2.3964 (1.0) 2.3964 (1.0) 0.0000 (1.0) 2.3964 (1.0) 0.0000 (1.0) 0;0 0.4173 (1.0) 1 1
test_sharing_s3-add-noop[2.40.0] 2.4034 (1.00) 2.4034 (1.00) 2.4034 (1.00) 0.0000 (1.0) 2.4034 (1.00) 0.0000 (1.0) 0;0 0.4161 (1.00) 1 1
test_sharing_s3-add-noop[2.40.0] 2.4546 (1.02) 2.4546 (1.02) 2.4546 (1.02) 0.0000 (1.0) 2.4546 (1.02) 0.0000 (1.0) 0;0 0.4074 (0.98) 1 1
test_sharing_s3-add-noop[2.41.1] 2.4265 (1.01) 2.4265 (1.01) 2.4265 (1.01) 0.0000 (1.0) 2.4265 (1.01) 0.0000 (1.0) 0;0 0.4121 (0.99) 1 1
test_sharing_s3-add-noop[2.41.1] 2.4116 (1.01) 2.4116 (1.01) 2.4116 (1.01) 0.0000 (1.0) 2.4116 (1.01) 0.0000 (1.0) 0;0 0.4147 (0.99) 1 1
test_sharing_s3-add-noop[2.45.0] 2.5328 (1.06) 2.5328 (1.06) 2.5328 (1.06) 0.0000 (1.0) 2.5328 (1.06) 0.0000 (1.0) 0;0 0.3948 (0.95) 1 1
test_sharing_s3-add-noop[2.45.0] 2.5237 (1.05) 2.5237 (1.05) 2.5237 (1.05) 0.0000 (1.0) 2.5237 (1.05) 0.0000 (1.0) 0;0 0.3962 (0.95) 1 1
test_sharing_s3-add-noop[main] 2.6252 (1.10) 2.6252 (1.10) 2.6252 (1.10) 0.0000 (1.0) 2.6252 (1.10) 0.0000 (1.0) 0;0 0.3809 (0.91) 1 1
test_sharing_s3-add-noop[main] 2.6224 (1.09) 2.6224 (1.09) 2.6224 (1.09) 0.0000 (1.0) 2.6224 (1.09) 0.0000 (1.0) 0;0 0.3813 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 14 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0] 473.1876 (1.0) 473.1876 (1.0) 473.1876 (1.0) 0.0000 (1.0) 473.1876 (1.0) 0.0000 (1.0) 0;0 2.1133 (1.0) 1 1
test_sharing_s3-checkout-noop[2.11.0] 474.2501 (1.00) 474.2501 (1.00) 474.2501 (1.00) 0.0000 (1.0) 474.2501 (1.00) 0.0000 (1.0) 0;0 2.1086 (1.00) 1 1
test_sharing_s3-checkout-noop[2.18.1] 549.1992 (1.16) 549.1992 (1.16) 549.1992 (1.16) 0.0000 (1.0) 549.1992 (1.16) 0.0000 (1.0) 0;0 1.8208 (0.86) 1 1
test_sharing_s3-checkout-noop[2.18.1] 557.9950 (1.18) 557.9950 (1.18) 557.9950 (1.18) 0.0000 (1.0) 557.9950 (1.18) 0.0000 (1.0) 0;0 1.7921 (0.85) 1 1
test_sharing_s3-checkout-noop[2.39.0] 572.1106 (1.21) 572.1106 (1.21) 572.1106 (1.21) 0.0000 (1.0) 572.1106 (1.21) 0.0000 (1.0) 0;0 1.7479 (0.83) 1 1
test_sharing_s3-checkout-noop[2.39.0] 563.8495 (1.19) 563.8495 (1.19) 563.8495 (1.19) 0.0000 (1.0) 563.8495 (1.19) 0.0000 (1.0) 0;0 1.7735 (0.84) 1 1
test_sharing_s3-checkout-noop[2.40.0] 569.5917 (1.20) 569.5917 (1.20) 569.5917 (1.20) 0.0000 (1.0) 569.5917 (1.20) 0.0000 (1.0) 0;0 1.7556 (0.83) 1 1
test_sharing_s3-checkout-noop[2.40.0] 572.7328 (1.21) 572.7328 (1.21) 572.7328 (1.21) 0.0000 (1.0) 572.7328 (1.21) 0.0000 (1.0) 0;0 1.7460 (0.83) 1 1
test_sharing_s3-checkout-noop[2.41.1] 571.8536 (1.21) 571.8536 (1.21) 571.8536 (1.21) 0.0000 (1.0) 571.8536 (1.21) 0.0000 (1.0) 0;0 1.7487 (0.83) 1 1
test_sharing_s3-checkout-noop[2.41.1] 569.2796 (1.20) 569.2796 (1.20) 569.2796 (1.20) 0.0000 (1.0) 569.2796 (1.20) 0.0000 (1.0) 0;0 1.7566 (0.83) 1 1
test_sharing_s3-checkout-noop[2.45.0] 595.8767 (1.26) 595.8767 (1.26) 595.8767 (1.26) 0.0000 (1.0) 595.8767 (1.26) 0.0000 (1.0) 0;0 1.6782 (0.79) 1 1
test_sharing_s3-checkout-noop[2.45.0] 604.9707 (1.28) 604.9707 (1.28) 604.9707 (1.28) 0.0000 (1.0) 604.9707 (1.28) 0.0000 (1.0) 0;0 1.6530 (0.78) 1 1
test_sharing_s3-checkout-noop[main] 665.0025 (1.41) 665.0025 (1.41) 665.0025 (1.41) 0.0000 (1.0) 665.0025 (1.41) 0.0000 (1.0) 0;0 1.5038 (0.71) 1 1
test_sharing_s3-checkout-noop[main] 673.1124 (1.42) 673.1124 (1.42) 673.1124 (1.42) 0.0000 (1.0) 673.1124 (1.42) 0.0000 (1.0) 0;0 1.4856 (0.70) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 14 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0] 14.4259 (1.29) 14.4259 (1.29) 14.4259 (1.29) 0.0000 (1.0) 14.4259 (1.29) 0.0000 (1.0) 0;0 0.0693 (0.77) 1 1
test_sharing_s3-pull[2.11.0] 14.3780 (1.29) 14.3780 (1.29) 14.3780 (1.29) 0.0000 (1.0) 14.3780 (1.29) 0.0000 (1.0) 0;0 0.0696 (0.78) 1 1
test_sharing_s3-pull[2.18.1] 14.5190 (1.30) 14.5190 (1.30) 14.5190 (1.30) 0.0000 (1.0) 14.5190 (1.30) 0.0000 (1.0) 0;0 0.0689 (0.77) 1 1
test_sharing_s3-pull[2.18.1] 14.5596 (1.30) 14.5596 (1.30) 14.5596 (1.30) 0.0000 (1.0) 14.5596 (1.30) 0.0000 (1.0) 0;0 0.0687 (0.77) 1 1
test_sharing_s3-pull[2.39.0] 14.6645 (1.31) 14.6645 (1.31) 14.6645 (1.31) 0.0000 (1.0) 14.6645 (1.31) 0.0000 (1.0) 0;0 0.0682 (0.76) 1 1
test_sharing_s3-pull[2.39.0] 14.6047 (1.31) 14.6047 (1.31) 14.6047 (1.31) 0.0000 (1.0) 14.6047 (1.31) 0.0000 (1.0) 0;0 0.0685 (0.76) 1 1
test_sharing_s3-pull[2.40.0] 14.5934 (1.31) 14.5934 (1.31) 14.5934 (1.31) 0.0000 (1.0) 14.5934 (1.31) 0.0000 (1.0) 0;0 0.0685 (0.76) 1 1
test_sharing_s3-pull[2.40.0] 14.7378 (1.32) 14.7378 (1.32) 14.7378 (1.32) 0.0000 (1.0) 14.7378 (1.32) 0.0000 (1.0) 0;0 0.0679 (0.76) 1 1
test_sharing_s3-pull[2.41.1] 14.6503 (1.31) 14.6503 (1.31) 14.6503 (1.31) 0.0000 (1.0) 14.6503 (1.31) 0.0000 (1.0) 0;0 0.0683 (0.76) 1 1
test_sharing_s3-pull[2.41.1] 14.8423 (1.33) 14.8423 (1.33) 14.8423 (1.33) 0.0000 (1.0) 14.8423 (1.33) 0.0000 (1.0) 0;0 0.0674 (0.75) 1 1
test_sharing_s3-pull[2.45.0] 12.8706 (1.15) 12.8706 (1.15) 12.8706 (1.15) 0.0000 (1.0) 12.8706 (1.15) 0.0000 (1.0) 0;0 0.0777 (0.87) 1 1
test_sharing_s3-pull[2.45.0] 12.5908 (1.13) 12.5908 (1.13) 12.5908 (1.13) 0.0000 (1.0) 12.5908 (1.13) 0.0000 (1.0) 0;0 0.0794 (0.89) 1 1
test_sharing_s3-pull[main] 11.1612 (1.0) 11.1612 (1.0) 11.1612 (1.0) 0.0000 (1.0) 11.1612 (1.0) 0.0000 (1.0) 0;0 0.0896 (1.0) 1 1
test_sharing_s3-pull[main] 11.2400 (1.01) 11.2400 (1.01) 11.2400 (1.01) 0.0000 (1.0) 11.2400 (1.01) 0.0000 (1.0) 0;0 0.0890 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 14 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0] 692.9397 (1.0) 692.9397 (1.0) 692.9397 (1.0) 0.0000 (1.0) 692.9397 (1.0) 0.0000 (1.0) 0;0 1.4431 (1.0) 1 1
test_sharing_s3-pull-noop[2.11.0] 704.4871 (1.02) 704.4871 (1.02) 704.4871 (1.02) 0.0000 (1.0) 704.4871 (1.02) 0.0000 (1.0) 0;0 1.4195 (0.98) 1 1
test_sharing_s3-pull-noop[2.18.1] 781.7887 (1.13) 781.7887 (1.13) 781.7887 (1.13) 0.0000 (1.0) 781.7887 (1.13) 0.0000 (1.0) 0;0 1.2791 (0.89) 1 1
test_sharing_s3-pull-noop[2.18.1] 785.6200 (1.13) 785.6200 (1.13) 785.6200 (1.13) 0.0000 (1.0) 785.6200 (1.13) 0.0000 (1.0) 0;0 1.2729 (0.88) 1 1
test_sharing_s3-pull-noop[2.39.0] 784.8026 (1.13) 784.8026 (1.13) 784.8026 (1.13) 0.0000 (1.0) 784.8026 (1.13) 0.0000 (1.0) 0;0 1.2742 (0.88) 1 1
test_sharing_s3-pull-noop[2.39.0] 779.3799 (1.12) 779.3799 (1.12) 779.3799 (1.12) 0.0000 (1.0) 779.3799 (1.12) 0.0000 (1.0) 0;0 1.2831 (0.89) 1 1
test_sharing_s3-pull-noop[2.40.0] 778.6733 (1.12) 778.6733 (1.12) 778.6733 (1.12) 0.0000 (1.0) 778.6733 (1.12) 0.0000 (1.0) 0;0 1.2842 (0.89) 1 1
test_sharing_s3-pull-noop[2.40.0] 786.1308 (1.13) 786.1308 (1.13) 786.1308 (1.13) 0.0000 (1.0) 786.1308 (1.13) 0.0000 (1.0) 0;0 1.2721 (0.88) 1 1
test_sharing_s3-pull-noop[2.41.1] 792.4211 (1.14) 792.4211 (1.14) 792.4211 (1.14) 0.0000 (1.0) 792.4211 (1.14) 0.0000 (1.0) 0;0 1.2620 (0.87) 1 1
test_sharing_s3-pull-noop[2.41.1] 779.4239 (1.12) 779.4239 (1.12) 779.4239 (1.12) 0.0000 (1.0) 779.4239 (1.12) 0.0000 (1.0) 0;0 1.2830 (0.89) 1 1
test_sharing_s3-pull-noop[2.45.0] 819.5934 (1.18) 819.5934 (1.18) 819.5934 (1.18) 0.0000 (1.0) 819.5934 (1.18) 0.0000 (1.0) 0;0 1.2201 (0.85) 1 1
test_sharing_s3-pull-noop[2.45.0] 819.0021 (1.18) 819.0021 (1.18) 819.0021 (1.18) 0.0000 (1.0) 819.0021 (1.18) 0.0000 (1.0) 0;0 1.2210 (0.85) 1 1
test_sharing_s3-pull-noop[main] 900.7263 (1.30) 900.7263 (1.30) 900.7263 (1.30) 0.0000 (1.0) 900.7263 (1.30) 0.0000 (1.0) 0;0 1.1102 (0.77) 1 1
test_sharing_s3-pull-noop[main] 896.8765 (1.29) 896.8765 (1.29) 896.8765 (1.29) 0.0000 (1.0) 896.8765 (1.29) 0.0000 (1.0) 0;0 1.1150 (0.77) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 14 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0] 20.5159 (2.34) 20.5159 (2.34) 20.5159 (2.34) 0.0000 (1.0) 20.5159 (2.34) 0.0000 (1.0) 0;0 0.0487 (0.43) 1 1
test_sharing_s3-push[2.11.0] 19.9690 (2.28) 19.9690 (2.28) 19.9690 (2.28) 0.0000 (1.0) 19.9690 (2.28) 0.0000 (1.0) 0;0 0.0501 (0.44) 1 1
test_sharing_s3-push[2.18.1] 20.2987 (2.31) 20.2987 (2.31) 20.2987 (2.31) 0.0000 (1.0) 20.2987 (2.31) 0.0000 (1.0) 0;0 0.0493 (0.43) 1 1
test_sharing_s3-push[2.18.1] 19.8414 (2.26) 19.8414 (2.26) 19.8414 (2.26) 0.0000 (1.0) 19.8414 (2.26) 0.0000 (1.0) 0;0 0.0504 (0.44) 1 1
test_sharing_s3-push[2.39.0] 21.3792 (2.44) 21.3792 (2.44) 21.3792 (2.44) 0.0000 (1.0) 21.3792 (2.44) 0.0000 (1.0) 0;0 0.0468 (0.41) 1 1
test_sharing_s3-push[2.39.0] 21.6812 (2.47) 21.6812 (2.47) 21.6812 (2.47) 0.0000 (1.0) 21.6812 (2.47) 0.0000 (1.0) 0;0 0.0461 (0.40) 1 1
test_sharing_s3-push[2.40.0] 21.4216 (2.44) 21.4216 (2.44) 21.4216 (2.44) 0.0000 (1.0) 21.4216 (2.44) 0.0000 (1.0) 0;0 0.0467 (0.41) 1 1
test_sharing_s3-push[2.40.0] 21.7682 (2.48) 21.7682 (2.48) 21.7682 (2.48) 0.0000 (1.0) 21.7682 (2.48) 0.0000 (1.0) 0;0 0.0459 (0.40) 1 1
test_sharing_s3-push[2.41.1] 11.7319 (1.34) 11.7319 (1.34) 11.7319 (1.34) 0.0000 (1.0) 11.7319 (1.34) 0.0000 (1.0) 0;0 0.0852 (0.75) 1 1
test_sharing_s3-push[2.41.1] 11.7198 (1.34) 11.7198 (1.34) 11.7198 (1.34) 0.0000 (1.0) 11.7198 (1.34) 0.0000 (1.0) 0;0 0.0853 (0.75) 1 1
test_sharing_s3-push[2.45.0] 8.7754 (1.0) 8.7754 (1.0) 8.7754 (1.0) 0.0000 (1.0) 8.7754 (1.0) 0.0000 (1.0) 0;0 0.1140 (1.0) 1 1
test_sharing_s3-push[2.45.0] 8.9470 (1.02) 8.9470 (1.02) 8.9470 (1.02) 0.0000 (1.0) 8.9470 (1.02) 0.0000 (1.0) 0;0 0.1118 (0.98) 1 1
test_sharing_s3-push[main] 8.9071 (1.02) 8.9071 (1.02) 8.9071 (1.02) 0.0000 (1.0) 8.9071 (1.02) 0.0000 (1.0) 0;0 0.1123 (0.99) 1 1
test_sharing_s3-push[main] 8.8242 (1.01) 8.8242 (1.01) 8.8242 (1.01) 0.0000 (1.0) 8.8242 (1.01) 0.0000 (1.0) 0;0 0.1133 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 14 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0] 933.6481 (1.03) 933.6481 (1.03) 933.6481 (1.03) 0.0000 (1.0) 933.6481 (1.03) 0.0000 (1.0) 0;0 1.0711 (0.98) 1 1
test_sharing_s3-push-noop[2.11.0] 1,202.4725 (1.32) 1,202.4725 (1.32) 1,202.4725 (1.32) 0.0000 (1.0) 1,202.4725 (1.32) 0.0000 (1.0) 0;0 0.8316 (0.76) 1 1
test_sharing_s3-push-noop[2.18.1] 910.7311 (1.0) 910.7311 (1.0) 910.7311 (1.0) 0.0000 (1.0) 910.7311 (1.0) 0.0000 (1.0) 0;0 1.0980 (1.0) 1 1
test_sharing_s3-push-noop[2.18.1] 916.4269 (1.01) 916.4269 (1.01) 916.4269 (1.01) 0.0000 (1.0) 916.4269 (1.01) 0.0000 (1.0) 0;0 1.0912 (0.99) 1 1
test_sharing_s3-push-noop[2.39.0] 956.5678 (1.05) 956.5678 (1.05) 956.5678 (1.05) 0.0000 (1.0) 956.5678 (1.05) 0.0000 (1.0) 0;0 1.0454 (0.95) 1 1
test_sharing_s3-push-noop[2.39.0] 955.6553 (1.05) 955.6553 (1.05) 955.6553 (1.05) 0.0000 (1.0) 955.6553 (1.05) 0.0000 (1.0) 0;0 1.0464 (0.95) 1 1
test_sharing_s3-push-noop[2.40.0] 1,260.1273 (1.38) 1,260.1273 (1.38) 1,260.1273 (1.38) 0.0000 (1.0) 1,260.1273 (1.38) 0.0000 (1.0) 0;0 0.7936 (0.72) 1 1
test_sharing_s3-push-noop[2.40.0] 964.6645 (1.06) 964.6645 (1.06) 964.6645 (1.06) 0.0000 (1.0) 964.6645 (1.06) 0.0000 (1.0) 0;0 1.0366 (0.94) 1 1
test_sharing_s3-push-noop[2.41.1] 961.4673 (1.06) 961.4673 (1.06) 961.4673 (1.06) 0.0000 (1.0) 961.4673 (1.06) 0.0000 (1.0) 0;0 1.0401 (0.95) 1 1
test_sharing_s3-push-noop[2.41.1] 955.6270 (1.05) 955.6270 (1.05) 955.6270 (1.05) 0.0000 (1.0) 955.6270 (1.05) 0.0000 (1.0) 0;0 1.0464 (0.95) 1 1
test_sharing_s3-push-noop[2.45.0] 956.9531 (1.05) 956.9531 (1.05) 956.9531 (1.05) 0.0000 (1.0) 956.9531 (1.05) 0.0000 (1.0) 0;0 1.0450 (0.95) 1 1
test_sharing_s3-push-noop[2.45.0] 963.7654 (1.06) 963.7654 (1.06) 963.7654 (1.06) 0.0000 (1.0) 963.7654 (1.06) 0.0000 (1.0) 0;0 1.0376 (0.94) 1 1
test_sharing_s3-push-noop[main] 1,053.9841 (1.16) 1,053.9841 (1.16) 1,053.9841 (1.16) 0.0000 (1.0) 1,053.9841 (1.16) 0.0000 (1.0) 0;0 0.9488 (0.86) 1 1
test_sharing_s3-push-noop[main] 1,059.6702 (1.16) 1,059.6702 (1.16) 1,059.6702 (1.16) 0.0000 (1.0) 1,059.6702 (1.16) 0.0000 (1.0) 0;0 0.9437 (0.86) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 7.3726 (1.82) 7.3726 (1.82) 7.3726 (1.82) 0.0000 (1.0) 7.3726 (1.82) 0.0000 (1.0) 0;0 0.1356 (0.55) 1 1
test_sharing-add[2.18.1] 6.1119 (1.51) 6.1119 (1.51) 6.1119 (1.51) 0.0000 (1.0) 6.1119 (1.51) 0.0000 (1.0) 0;0 0.1636 (0.66) 1 1
test_sharing-add[2.39.0] 6.1162 (1.51) 6.1162 (1.51) 6.1162 (1.51) 0.0000 (1.0) 6.1162 (1.51) 0.0000 (1.0) 0;0 0.1635 (0.66) 1 1
test_sharing-add[2.40.0] 6.0311 (1.49) 6.0311 (1.49) 6.0311 (1.49) 0.0000 (1.0) 6.0311 (1.49) 0.0000 (1.0) 0;0 0.1658 (0.67) 1 1
test_sharing-add[2.41.1] 5.9094 (1.46) 5.9094 (1.46) 5.9094 (1.46) 0.0000 (1.0) 5.9094 (1.46) 0.0000 (1.0) 0;0 0.1692 (0.69) 1 1
test_sharing-add[2.45.0] 4.1216 (1.02) 4.1216 (1.02) 4.1216 (1.02) 0.0000 (1.0) 4.1216 (1.02) 0.0000 (1.0) 0;0 0.2426 (0.98) 1 1
test_sharing-add[main] 4.0518 (1.0) 4.0518 (1.0) 4.0518 (1.0) 0.0000 (1.0) 4.0518 (1.0) 0.0000 (1.0) 0;0 0.2468 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 3.4826 (1.41) 3.4826 (1.41) 3.4826 (1.41) 0.0000 (1.0) 3.4826 (1.41) 0.0000 (1.0) 0;0 0.2871 (0.71) 1 1
test_sharing-add-noop[2.18.1] 3.6932 (1.50) 3.6932 (1.50) 3.6932 (1.50) 0.0000 (1.0) 3.6932 (1.50) 0.0000 (1.0) 0;0 0.2708 (0.67) 1 1
test_sharing-add-noop[2.39.0] 2.5922 (1.05) 2.5922 (1.05) 2.5922 (1.05) 0.0000 (1.0) 2.5922 (1.05) 0.0000 (1.0) 0;0 0.3858 (0.95) 1 1
test_sharing-add-noop[2.40.0] 2.5247 (1.02) 2.5247 (1.02) 2.5247 (1.02) 0.0000 (1.0) 2.5247 (1.02) 0.0000 (1.0) 0;0 0.3961 (0.98) 1 1
test_sharing-add-noop[2.41.1] 2.4678 (1.0) 2.4678 (1.0) 2.4678 (1.0) 0.0000 (1.0) 2.4678 (1.0) 0.0000 (1.0) 0;0 0.4052 (1.0) 1 1
test_sharing-add-noop[2.45.0] 2.5308 (1.03) 2.5308 (1.03) 2.5308 (1.03) 0.0000 (1.0) 2.5308 (1.03) 0.0000 (1.0) 0;0 0.3951 (0.98) 1 1
test_sharing-add-noop[main] 2.7417 (1.11) 2.7417 (1.11) 2.7417 (1.11) 0.0000 (1.0) 2.7417 (1.11) 0.0000 (1.0) 0;0 0.3647 (0.90) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 505.3560 (1.0) 505.3560 (1.0) 505.3560 (1.0) 0.0000 (1.0) 505.3560 (1.0) 0.0000 (1.0) 0;0 1.9788 (1.0) 1 1
test_sharing-checkout-noop[2.18.1] 576.3752 (1.14) 576.3752 (1.14) 576.3752 (1.14) 0.0000 (1.0) 576.3752 (1.14) 0.0000 (1.0) 0;0 1.7350 (0.88) 1 1
test_sharing-checkout-noop[2.39.0] 603.9087 (1.20) 603.9087 (1.20) 603.9087 (1.20) 0.0000 (1.0) 603.9087 (1.20) 0.0000 (1.0) 0;0 1.6559 (0.84) 1 1
test_sharing-checkout-noop[2.40.0] 602.7684 (1.19) 602.7684 (1.19) 602.7684 (1.19) 0.0000 (1.0) 602.7684 (1.19) 0.0000 (1.0) 0;0 1.6590 (0.84) 1 1
test_sharing-checkout-noop[2.41.1] 602.5791 (1.19) 602.5791 (1.19) 602.5791 (1.19) 0.0000 (1.0) 602.5791 (1.19) 0.0000 (1.0) 0;0 1.6595 (0.84) 1 1
test_sharing-checkout-noop[2.45.0] 613.1156 (1.21) 613.1156 (1.21) 613.1156 (1.21) 0.0000 (1.0) 613.1156 (1.21) 0.0000 (1.0) 0;0 1.6310 (0.82) 1 1
test_sharing-checkout-noop[main] 695.4622 (1.38) 695.4622 (1.38) 695.4622 (1.38) 0.0000 (1.0) 695.4622 (1.38) 0.0000 (1.0) 0;0 1.4379 (0.73) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-pull': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 7.2881 (1.31) 7.2881 (1.31) 7.2881 (1.31) 0.0000 (1.0) 7.2881 (1.31) 0.0000 (1.0) 0;0 0.1372 (0.76) 1 1
test_sharing-pull[2.18.1] 7.3618 (1.32) 7.3618 (1.32) 7.3618 (1.32) 0.0000 (1.0) 7.3618 (1.32) 0.0000 (1.0) 0;0 0.1358 (0.76) 1 1
test_sharing-pull[2.39.0] 8.6910 (1.56) 8.6910 (1.56) 8.6910 (1.56) 0.0000 (1.0) 8.6910 (1.56) 0.0000 (1.0) 0;0 0.1151 (0.64) 1 1
test_sharing-pull[2.40.0] 8.7819 (1.58) 8.7819 (1.58) 8.7819 (1.58) 0.0000 (1.0) 8.7819 (1.58) 0.0000 (1.0) 0;0 0.1139 (0.63) 1 1
test_sharing-pull[2.41.1] 8.5687 (1.54) 8.5687 (1.54) 8.5687 (1.54) 0.0000 (1.0) 8.5687 (1.54) 0.0000 (1.0) 0;0 0.1167 (0.65) 1 1
test_sharing-pull[2.45.0] 6.8209 (1.23) 6.8209 (1.23) 6.8209 (1.23) 0.0000 (1.0) 6.8209 (1.23) 0.0000 (1.0) 0;0 0.1466 (0.81) 1 1
test_sharing-pull[main] 5.5588 (1.0) 5.5588 (1.0) 5.5588 (1.0) 0.0000 (1.0) 5.5588 (1.0) 0.0000 (1.0) 0;0 0.1799 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 536.8681 (1.0) 536.8681 (1.0) 536.8681 (1.0) 0.0000 (1.0) 536.8681 (1.0) 0.0000 (1.0) 0;0 1.8627 (1.0) 1 1
test_sharing-pull-noop[2.18.1] 614.0566 (1.14) 614.0566 (1.14) 614.0566 (1.14) 0.0000 (1.0) 614.0566 (1.14) 0.0000 (1.0) 0;0 1.6285 (0.87) 1 1
test_sharing-pull-noop[2.39.0] 648.3830 (1.21) 648.3830 (1.21) 648.3830 (1.21) 0.0000 (1.0) 648.3830 (1.21) 0.0000 (1.0) 0;0 1.5423 (0.83) 1 1
test_sharing-pull-noop[2.40.0] 644.7843 (1.20) 644.7843 (1.20) 644.7843 (1.20) 0.0000 (1.0) 644.7843 (1.20) 0.0000 (1.0) 0;0 1.5509 (0.83) 1 1
test_sharing-pull-noop[2.41.1] 635.3803 (1.18) 635.3803 (1.18) 635.3803 (1.18) 0.0000 (1.0) 635.3803 (1.18) 0.0000 (1.0) 0;0 1.5739 (0.84) 1 1
test_sharing-pull-noop[2.45.0] 671.8251 (1.25) 671.8251 (1.25) 671.8251 (1.25) 0.0000 (1.0) 671.8251 (1.25) 0.0000 (1.0) 0;0 1.4885 (0.80) 1 1
test_sharing-pull-noop[main] 747.9264 (1.39) 747.9264 (1.39) 747.9264 (1.39) 0.0000 (1.0) 747.9264 (1.39) 0.0000 (1.0) 0;0 1.3370 (0.72) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 4.0326 (1.18) 4.0326 (1.18) 4.0326 (1.18) 0.0000 (1.0) 4.0326 (1.18) 0.0000 (1.0) 0;0 0.2480 (0.85) 1 1
test_sharing-push[2.18.1] 3.9868 (1.17) 3.9868 (1.17) 3.9868 (1.17) 0.0000 (1.0) 3.9868 (1.17) 0.0000 (1.0) 0;0 0.2508 (0.86) 1 1
test_sharing-push[2.39.0] 5.1965 (1.52) 5.1965 (1.52) 5.1965 (1.52) 0.0000 (1.0) 5.1965 (1.52) 0.0000 (1.0) 0;0 0.1924 (0.66) 1 1
test_sharing-push[2.40.0] 5.2398 (1.54) 5.2398 (1.54) 5.2398 (1.54) 0.0000 (1.0) 5.2398 (1.54) 0.0000 (1.0) 0;0 0.1908 (0.65) 1 1
test_sharing-push[2.41.1] 5.1100 (1.50) 5.1100 (1.50) 5.1100 (1.50) 0.0000 (1.0) 5.1100 (1.50) 0.0000 (1.0) 0;0 0.1957 (0.67) 1 1
test_sharing-push[2.45.0] 3.4116 (1.0) 3.4116 (1.0) 3.4116 (1.0) 0.0000 (1.0) 3.4116 (1.0) 0.0000 (1.0) 0;0 0.2931 (1.0) 1 1
test_sharing-push[main] 3.5491 (1.04) 3.5491 (1.04) 3.5491 (1.04) 0.0000 (1.0) 3.5491 (1.04) 0.0000 (1.0) 0;0 0.2818 (0.96) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 450.7291 (1.00) 450.7291 (1.00) 450.7291 (1.00) 0.0000 (1.0) 450.7291 (1.00) 0.0000 (1.0) 0;0 2.2186 (1.00) 1 1
test_sharing-push-noop[2.18.1] 448.7605 (1.0) 448.7605 (1.0) 448.7605 (1.0) 0.0000 (1.0) 448.7605 (1.0) 0.0000 (1.0) 0;0 2.2284 (1.0) 1 1
test_sharing-push-noop[2.39.0] 489.2706 (1.09) 489.2706 (1.09) 489.2706 (1.09) 0.0000 (1.0) 489.2706 (1.09) 0.0000 (1.0) 0;0 2.0439 (0.92) 1 1
test_sharing-push-noop[2.40.0] 501.3920 (1.12) 501.3920 (1.12) 501.3920 (1.12) 0.0000 (1.0) 501.3920 (1.12) 0.0000 (1.0) 0;0 1.9944 (0.90) 1 1
test_sharing-push-noop[2.41.1] 490.1384 (1.09) 490.1384 (1.09) 490.1384 (1.09) 0.0000 (1.0) 490.1384 (1.09) 0.0000 (1.0) 0;0 2.0402 (0.92) 1 1
test_sharing-push-noop[2.45.0] 491.7998 (1.10) 491.7998 (1.10) 491.7998 (1.10) 0.0000 (1.0) 491.7998 (1.10) 0.0000 (1.0) 0;0 2.0333 (0.91) 1 1
test_sharing-push-noop[main] 587.4368 (1.31) 587.4368 (1.31) 587.4368 (1.31) 0.0000 (1.0) 587.4368 (1.31) 0.0000 (1.0) 0;0 1.7023 (0.76) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 5.2752 (1.37) 5.2752 (1.37) 5.2752 (1.37) 0.0000 (1.0) 5.2752 (1.37) 0.0000 (1.0) 0;0 0.1896 (0.73) 1 1
test_get-get[2.18.1] 4.8726 (1.27) 4.8726 (1.27) 4.8726 (1.27) 0.0000 (1.0) 4.8726 (1.27) 0.0000 (1.0) 0;0 0.2052 (0.79) 1 1
test_get-get[2.39.0] 4.0776 (1.06) 4.0776 (1.06) 4.0776 (1.06) 0.0000 (1.0) 4.0776 (1.06) 0.0000 (1.0) 0;0 0.2452 (0.94) 1 1
test_get-get[2.40.0] 3.9001 (1.02) 3.9001 (1.02) 3.9001 (1.02) 0.0000 (1.0) 3.9001 (1.02) 0.0000 (1.0) 0;0 0.2564 (0.98) 1 1
test_get-get[2.41.1] 3.8411 (1.0) 3.8411 (1.0) 3.8411 (1.0) 0.0000 (1.0) 3.8411 (1.0) 0.0000 (1.0) 0;0 0.2603 (1.0) 1 1
test_get-get[2.45.0] 3.9397 (1.03) 3.9397 (1.03) 3.9397 (1.03) 0.0000 (1.0) 3.9397 (1.03) 0.0000 (1.0) 0;0 0.2538 (0.97) 1 1
test_get-get[main] 6.4314 (1.67) 6.4314 (1.67) 6.4314 (1.67) 0.0000 (1.0) 6.4314 (1.67) 0.0000 (1.0) 0;0 0.1555 (0.60) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 3.0320 (1.80) 3.0320 (1.80) 3.0320 (1.80) 0.0000 (1.0) 3.0320 (1.80) 0.0000 (1.0) 0;0 0.3298 (0.56) 1 1
test_partial_remove-add[2.18.1] 2.5230 (1.49) 2.5230 (1.49) 2.5230 (1.49) 0.0000 (1.0) 2.5230 (1.49) 0.0000 (1.0) 0;0 0.3964 (0.67) 1 1
test_partial_remove-add[2.39.0] 1.9386 (1.15) 1.9386 (1.15) 1.9386 (1.15) 0.0000 (1.0) 1.9386 (1.15) 0.0000 (1.0) 0;0 0.5158 (0.87) 1 1
test_partial_remove-add[2.40.0] 1.9613 (1.16) 1.9613 (1.16) 1.9613 (1.16) 0.0000 (1.0) 1.9613 (1.16) 0.0000 (1.0) 0;0 0.5099 (0.86) 1 1
test_partial_remove-add[2.41.1] 1.9293 (1.14) 1.9293 (1.14) 1.9293 (1.14) 0.0000 (1.0) 1.9293 (1.14) 0.0000 (1.0) 0;0 0.5183 (0.87) 1 1
test_partial_remove-add[2.45.0] 1.9587 (1.16) 1.9587 (1.16) 1.9587 (1.16) 0.0000 (1.0) 1.9587 (1.16) 0.0000 (1.0) 0;0 0.5106 (0.86) 1 1
test_partial_remove-add[main] 1.6881 (1.0) 1.6881 (1.0) 1.6881 (1.0) 0.0000 (1.0) 1.6881 (1.0) 0.0000 (1.0) 0;0 0.5924 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 456.3836 (1.0) 456.3836 (1.0) 456.3836 (1.0) 0.0000 (1.0) 456.3836 (1.0) 0.0000 (1.0) 0;0 2.1911 (1.0) 1 1
test_partial_remove-gc[2.18.1] 477.5926 (1.05) 477.5926 (1.05) 477.5926 (1.05) 0.0000 (1.0) 477.5926 (1.05) 0.0000 (1.0) 0;0 2.0938 (0.96) 1 1
test_partial_remove-gc[2.39.0] 512.2743 (1.12) 512.2743 (1.12) 512.2743 (1.12) 0.0000 (1.0) 512.2743 (1.12) 0.0000 (1.0) 0;0 1.9521 (0.89) 1 1
test_partial_remove-gc[2.40.0] 508.7101 (1.11) 508.7101 (1.11) 508.7101 (1.11) 0.0000 (1.0) 508.7101 (1.11) 0.0000 (1.0) 0;0 1.9658 (0.90) 1 1
test_partial_remove-gc[2.41.1] 522.9285 (1.15) 522.9285 (1.15) 522.9285 (1.15) 0.0000 (1.0) 522.9285 (1.15) 0.0000 (1.0) 0;0 1.9123 (0.87) 1 1
test_partial_remove-gc[2.45.0] 513.4644 (1.13) 513.4644 (1.13) 513.4644 (1.13) 0.0000 (1.0) 513.4644 (1.13) 0.0000 (1.0) 0;0 1.9476 (0.89) 1 1
test_partial_remove-gc[main] 597.4850 (1.31) 597.4850 (1.31) 597.4850 (1.31) 0.0000 (1.0) 597.4850 (1.31) 0.0000 (1.0) 0;0 1.6737 (0.76) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 489.1874 (1.0) 489.1874 (1.0) 489.1874 (1.0) 0.0000 (1.0) 489.1874 (1.0) 0.0000 (1.0) 0;0 2.0442 (1.0) 1 1
test_partial_remove-gc-cloud[2.18.1] 526.9426 (1.08) 526.9426 (1.08) 526.9426 (1.08) 0.0000 (1.0) 526.9426 (1.08) 0.0000 (1.0) 0;0 1.8977 (0.93) 1 1
test_partial_remove-gc-cloud[2.39.0] 551.3700 (1.13) 551.3700 (1.13) 551.3700 (1.13) 0.0000 (1.0) 551.3700 (1.13) 0.0000 (1.0) 0;0 1.8137 (0.89) 1 1
test_partial_remove-gc-cloud[2.40.0] 563.7968 (1.15) 563.7968 (1.15) 563.7968 (1.15) 0.0000 (1.0) 563.7968 (1.15) 0.0000 (1.0) 0;0 1.7737 (0.87) 1 1
test_partial_remove-gc-cloud[2.41.1] 579.5705 (1.18) 579.5705 (1.18) 579.5705 (1.18) 0.0000 (1.0) 579.5705 (1.18) 0.0000 (1.0) 0;0 1.7254 (0.84) 1 1
test_partial_remove-gc-cloud[2.45.0] 550.5092 (1.13) 550.5092 (1.13) 550.5092 (1.13) 0.0000 (1.0) 550.5092 (1.13) 0.0000 (1.0) 0;0 1.8165 (0.89) 1 1
test_partial_remove-gc-cloud[main] 641.0090 (1.31) 641.0090 (1.31) 641.0090 (1.31) 0.0000 (1.0) 641.0090 (1.31) 0.0000 (1.0) 0;0 1.5600 (0.76) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push': 7 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 463.6585 (1.01) 463.6585 (1.01) 463.6585 (1.01) 0.0000 (1.0) 463.6585 (1.01) 0.0000 (1.0) 0;0 2.1568 (0.99) 1 1
test_partial_remove-push[2.18.1] 459.1105 (1.0) 459.1105 (1.0) 459.1105 (1.0) 0.0000 (1.0) 459.1105 (1.0) 0.0000 (1.0) 0;0 2.1781 (1.0) 1 1
test_partial_remove-push[2.39.0] 500.6972 (1.09) 500.6972 (1.09) 500.6972 (1.09) 0.0000 (1.0) 500.6972 (1.09) 0.0000 (1.0) 0;0 1.9972 (0.92) 1 1
test_partial_remove-push[2.40.0] 503.8564 (1.10) 503.8564 (1.10) 503.8564 (1.10) 0.0000 (1.0) 503.8564 (1.10) 0.0000 (1.0) 0;0 1.9847 (0.91) 1 1
test_partial_remove-push[2.41.1] 508.2248 (1.11) 508.2248 (1.11) 508.2248 (1.11) 0.0000 (1.0) 508.2248 (1.11) 0.0000 (1.0) 0;0 1.9676 (0.90) 1 1
test_partial_remove-push[2.45.0] 503.0541 (1.10) 503.0541 (1.10) 503.0541 (1.10) 0.0000 (1.0) 503.0541 (1.10) 0.0000 (1.0) 0;0 1.9879 (0.91) 1 1
test_partial_remove-push[main] 637.8731 (1.39) 637.8731 (1.39) 637.8731 (1.39) 0.0000 (1.0) 637.8731 (1.39) 0.0000 (1.0) 0;0 1.5677 (0.72) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.39.0] 1.0879 (1.18) 1.0906 (1.18) 1.0894 (1.18) 0.0012 (1.0) 1.0897 (1.18) 0.0023 (1.41) 1;0 0.9179 (0.85) 5 3
test_plots-plots-diff[2.40.0] 1.0854 (1.18) 1.0935 (1.18) 1.0914 (1.18) 0.0034 (2.77) 1.0932 (1.18) 0.0033 (2.03) 1;0 0.9162 (0.85) 5 3
test_plots-plots-diff[2.41.1] 1.0861 (1.18) 1.0903 (1.17) 1.0879 (1.18) 0.0015 (1.23) 1.0878 (1.18) 0.0016 (1.0) 2;0 0.9192 (0.85) 5 3
test_plots-plots-diff[2.45.0] 0.9866 (1.07) 0.9966 (1.07) 0.9908 (1.07) 0.0039 (3.09) 0.9892 (1.07) 0.0050 (3.04) 2;0 1.0093 (0.93) 5 3
test_plots-plots-diff[main] 0.9199 (1.0) 0.9280 (1.0) 0.9252 (1.0) 0.0031 (2.51) 0.9256 (1.0) 0.0032 (1.96) 1;0 1.0809 (1.0) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.39.0] 1.9804 (1.63) 1.9927 (1.63) 1.9858 (1.63) 0.0051 (1.35) 1.9833 (1.63) 0.0079 (1.79) 2;0 0.5036 (0.61) 5 3
test_plots-plots-diff-json[2.40.0] 1.9919 (1.64) 2.0030 (1.64) 1.9958 (1.64) 0.0047 (1.24) 1.9935 (1.64) 0.0068 (1.53) 1;0 0.5011 (0.61) 5 3
test_plots-plots-diff-json[2.41.1] 1.9766 (1.63) 1.9924 (1.63) 1.9865 (1.63) 0.0063 (1.68) 1.9873 (1.63) 0.0086 (1.93) 1;0 0.5034 (0.61) 5 3
test_plots-plots-diff-json[2.45.0] 1.7688 (1.46) 1.7785 (1.45) 1.7737 (1.46) 0.0044 (1.18) 1.7720 (1.45) 0.0080 (1.80) 3;0 0.5638 (0.69) 5 3
test_plots-plots-diff-json[main] 1.2153 (1.0) 1.2250 (1.0) 1.2188 (1.0) 0.0038 (1.0) 1.2183 (1.0) 0.0044 (1.0) 1;0 0.8205 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.39.0] 735.5788 (1.05) 741.4156 (1.05) 737.9500 (1.05) 2.4165 (1.92) 738.2560 (1.05) 3.7467 (2.39) 1;0 1.3551 (0.95) 5 3
test_plots-plots-show[2.40.0] 740.3732 (1.06) 744.3737 (1.06) 741.4854 (1.06) 1.6559 (1.31) 740.7074 (1.06) 1.5667 (1.0) 1;0 1.3486 (0.95) 5 3
test_plots-plots-show[2.41.1] 734.0785 (1.05) 740.8656 (1.05) 737.9881 (1.05) 2.8927 (2.29) 738.3242 (1.05) 4.9748 (3.18) 1;0 1.3550 (0.95) 5 3
test_plots-plots-show[2.45.0] 700.5531 (1.0) 703.6790 (1.0) 701.7637 (1.0) 1.2610 (1.0) 701.5737 (1.0) 1.8724 (1.20) 1;0 1.4250 (1.0) 5 3
test_plots-plots-show[main] 753.3500 (1.08) 760.3400 (1.08) 756.5735 (1.08) 2.7364 (2.17) 757.1591 (1.08) 3.9709 (2.53) 2;0 1.3217 (0.93) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.39.0] 1.2152 (1.31) 1.2190 (1.29) 1.2164 (1.30) 0.0015 (1.0) 1.2163 (1.30) 0.0017 (1.0) 1;0 0.8221 (0.77) 5 3
test_plots-plots-show-json[2.40.0] 1.2128 (1.31) 1.2318 (1.31) 1.2225 (1.31) 0.0074 (4.91) 1.2226 (1.31) 0.0116 (6.75) 2;0 0.8180 (0.76) 5 3
test_plots-plots-show-json[2.41.1] 1.2184 (1.31) 1.2280 (1.30) 1.2220 (1.31) 0.0043 (2.81) 1.2202 (1.31) 0.0073 (4.22) 1;0 0.8183 (0.76) 5 3
test_plots-plots-show-json[2.45.0] 1.1254 (1.21) 1.1338 (1.20) 1.1302 (1.21) 0.0034 (2.26) 1.1311 (1.21) 0.0055 (3.21) 2;0 0.8848 (0.83) 5 3
test_plots-plots-show-json[main] 0.9289 (1.0) 0.9417 (1.0) 0.9341 (1.0) 0.0050 (3.26) 0.9325 (1.0) 0.0066 (3.80) 2;0 1.0706 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.18.1] 1.4350 (1.00) 1.4350 (1.00) 1.4350 (1.00) 0.0000 (1.0) 1.4350 (1.00) 0.0000 (1.0) 0;0 0.6969 (1.00) 1 1
test_data_status_all_flags-data-changed[2.39.0] 1.4865 (1.04) 1.4865 (1.04) 1.4865 (1.04) 0.0000 (1.0) 1.4865 (1.04) 0.0000 (1.0) 0;0 0.6727 (0.96) 1 1
test_data_status_all_flags-data-changed[2.40.0] 1.5136 (1.06) 1.5136 (1.06) 1.5136 (1.06) 0.0000 (1.0) 1.5136 (1.06) 0.0000 (1.0) 0;0 0.6607 (0.95) 1 1
test_data_status_all_flags-data-changed[2.41.1] 1.4324 (1.0) 1.4324 (1.0) 1.4324 (1.0) 0.0000 (1.0) 1.4324 (1.0) 0.0000 (1.0) 0;0 0.6981 (1.0) 1 1
test_data_status_all_flags-data-changed[2.45.0] 1.4504 (1.01) 1.4504 (1.01) 1.4504 (1.01) 0.0000 (1.0) 1.4504 (1.01) 0.0000 (1.0) 0;0 0.6895 (0.99) 1 1
test_data_status_all_flags-data-changed[main] 1.5393 (1.07) 1.5393 (1.07) 1.5393 (1.07) 0.0000 (1.0) 1.5393 (1.07) 0.0000 (1.0) 0;0 0.6497 (0.93) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.18.1] 1.3989 (1.0) 1.3989 (1.0) 1.3989 (1.0) 0.0000 (1.0) 1.3989 (1.0) 0.0000 (1.0) 0;0 0.7149 (1.0) 1 1
test_data_status_all_flags-data-changed-noop[2.39.0] 1.5020 (1.07) 1.5020 (1.07) 1.5020 (1.07) 0.0000 (1.0) 1.5020 (1.07) 0.0000 (1.0) 0;0 0.6658 (0.93) 1 1
test_data_status_all_flags-data-changed-noop[2.40.0] 1.4867 (1.06) 1.4867 (1.06) 1.4867 (1.06) 0.0000 (1.0) 1.4867 (1.06) 0.0000 (1.0) 0;0 0.6726 (0.94) 1 1
test_data_status_all_flags-data-changed-noop[2.41.1] 1.4305 (1.02) 1.4305 (1.02) 1.4305 (1.02) 0.0000 (1.0) 1.4305 (1.02) 0.0000 (1.0) 0;0 0.6990 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[2.45.0] 1.4488 (1.04) 1.4488 (1.04) 1.4488 (1.04) 0.0000 (1.0) 1.4488 (1.04) 0.0000 (1.0) 0;0 0.6902 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.5313 (1.09) 1.5313 (1.09) 1.5313 (1.09) 0.0000 (1.0) 1.5313 (1.09) 0.0000 (1.0) 0;0 0.6530 (0.91) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.18.1] 2.4305 (1.0) 2.4305 (1.0) 2.4305 (1.0) 0.0000 (1.0) 2.4305 (1.0) 0.0000 (1.0) 0;0 0.4114 (1.0) 1 1
test_data_status_all_flags-data-new[2.39.0] 2.4464 (1.01) 2.4464 (1.01) 2.4464 (1.01) 0.0000 (1.0) 2.4464 (1.01) 0.0000 (1.0) 0;0 0.4088 (0.99) 1 1
test_data_status_all_flags-data-new[2.40.0] 2.4808 (1.02) 2.4808 (1.02) 2.4808 (1.02) 0.0000 (1.0) 2.4808 (1.02) 0.0000 (1.0) 0;0 0.4031 (0.98) 1 1
test_data_status_all_flags-data-new[2.41.1] 2.4626 (1.01) 2.4626 (1.01) 2.4626 (1.01) 0.0000 (1.0) 2.4626 (1.01) 0.0000 (1.0) 0;0 0.4061 (0.99) 1 1
test_data_status_all_flags-data-new[2.45.0] 2.4610 (1.01) 2.4610 (1.01) 2.4610 (1.01) 0.0000 (1.0) 2.4610 (1.01) 0.0000 (1.0) 0;0 0.4063 (0.99) 1 1
test_data_status_all_flags-data-new[main] 2.5428 (1.05) 2.5428 (1.05) 2.5428 (1.05) 0.0000 (1.0) 2.5428 (1.05) 0.0000 (1.0) 0;0 0.3933 (0.96) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 6 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.18.1] 1.4001 (1.03) 1.4001 (1.03) 1.4001 (1.03) 0.0000 (1.0) 1.4001 (1.03) 0.0000 (1.0) 0;0 0.7142 (0.97) 1 1
test_data_status_all_flags-data-noop[2.39.0] 1.3812 (1.02) 1.3812 (1.02) 1.3812 (1.02) 0.0000 (1.0) 1.3812 (1.02) 0.0000 (1.0) 0;0 0.7240 (0.99) 1 1
test_data_status_all_flags-data-noop[2.40.0] 1.4212 (1.04) 1.4212 (1.04) 1.4212 (1.04) 0.0000 (1.0) 1.4212 (1.04) 0.0000 (1.0) 0;0 0.7036 (0.96) 1 1
test_data_status_all_flags-data-noop[2.41.1] 1.3608 (1.0) 1.3608 (1.0) 1.3608 (1.0) 0.0000 (1.0) 1.3608 (1.0) 0.0000 (1.0) 0;0 0.7349 (1.0) 1 1
test_data_status_all_flags-data-noop[2.45.0] 1.4176 (1.04) 1.4176 (1.04) 1.4176 (1.04) 0.0000 (1.0) 1.4176 (1.04) 0.0000 (1.0) 0;0 0.7054 (0.96) 1 1
test_data_status_all_flags-data-noop[main] 1.4687 (1.08) 1.4687 (1.08) 1.4687 (1.08) 0.0000 (1.0) 1.4687 (1.08) 0.0000 (1.0) 0;0 0.6809 (0.93) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.11.0] 3.5659 (1.13) 3.5659 (1.13) 3.5659 (1.13) 0.0000 (1.0) 3.5659 (1.13) 0.0000 (1.0) 0;0 0.2804 (0.89) 1 1
test_exp_show-exp[2.18.1] 3.5796 (1.13) 3.5796 (1.13) 3.5796 (1.13) 0.0000 (1.0) 3.5796 (1.13) 0.0000 (1.0) 0;0 0.2794 (0.88) 1 1
test_exp_show-exp[2.39.0] 3.1564 (1.0) 3.1564 (1.0) 3.1564 (1.0) 0.0000 (1.0) 3.1564 (1.0) 0.0000 (1.0) 0;0 0.3168 (1.0) 1 1
test_exp_show-exp[2.40.0] 3.1651 (1.00) 3.1651 (1.00) 3.1651 (1.00) 0.0000 (1.0) 3.1651 (1.00) 0.0000 (1.0) 0;0 0.3159 (1.00) 1 1
test_exp_show-exp[2.41.1] 3.1717 (1.00) 3.1717 (1.00) 3.1717 (1.00) 0.0000 (1.0) 3.1717 (1.00) 0.0000 (1.0) 0;0 0.3153 (1.00) 1 1
test_exp_show-exp[2.45.0] 3.2976 (1.04) 3.2976 (1.04) 3.2976 (1.04) 0.0000 (1.0) 3.2976 (1.04) 0.0000 (1.0) 0;0 0.3032 (0.96) 1 1
test_exp_show-exp[main] 4.1819 (1.32) 4.1819 (1.32) 4.1819 (1.32) 0.0000 (1.0) 4.1819 (1.32) 0.0000 (1.0) 0;0 0.2391 (0.75) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add-add': 7 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 6.3298 (1.75) 6.3298 (1.75) 6.3298 (1.75) 0.0000 (1.0) 6.3298 (1.75) 0.0000 (1.0) 0;0 0.1580 (0.57) 1 1
test_add-add[2.18.1] 5.8322 (1.61) 5.8322 (1.61) 5.8322 (1.61) 0.0000 (1.0) 5.8322 (1.61) 0.0000 (1.0) 0;0 0.1715 (0.62) 1 1
test_add-add[2.39.0] 5.3862 (1.49) 5.3862 (1.49) 5.3862 (1.49) 0.0000 (1.0) 5.3862 (1.49) 0.0000 (1.0) 0;0 0.1857 (0.67) 1 1
test_add-add[2.40.0] 5.4626 (1.51) 5.4626 (1.51) 5.4626 (1.51) 0.0000 (1.0) 5.4626 (1.51) 0.0000 (1.0) 0;0 0.1831 (0.66) 1 1
test_add-add[2.41.1] 5.4177 (1.50) 5.4177 (1.50) 5.4177 (1.50) 0.0000 (1.0) 5.4177 (1.50) 0.0000 (1.0) 0;0 0.1846 (0.67) 1 1
test_add-add[2.45.0] 4.0731 (1.13) 4.0731 (1.13) 4.0731 (1.13) 0.0000 (1.0) 4.0731 (1.13) 0.0000 (1.0) 0;0 0.2455 (0.89) 1 1
test_add-add[main] 3.6150 (1.0) 3.6150 (1.0) 3.6150 (1.0) 0.0000 (1.0) 3.6150 (1.0) 0.0000 (1.0) 0;0 0.2766 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
dependabot[bot]
Bumps pre-commit from 2.21.0 to 3.3.2.
Release notes
Sourced from pre-commit's releases.
... (truncated)
Changelog
Sourced from pre-commit's changelog.
... (truncated)
Commits
a0a7347v3.3.2bcd8274Merge pull request #2885 from lorenzwalthert/avoid-quote-write-to-tempfilecd09c35avoid quoting and escaping while installing R hooks by writing code to tempfi...c389ac0Merge pull request #2886 from pre-commit/pre-commit-ci-update-config64985bd[pre-commit.ci] pre-commit autoupdatef5a98ebMerge pull request #2883 from pre-commit/install-swift-not-needed08b670fswift is included in github actions72b7b53Merge pull request #2884 from pre-commit/typo9c2a011fix typo in testing/languagesee49d42Merge pull request #2882 from pre-commit/languages-always-runDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)