github-actions[bot]
commented
1 month ago
Tue Aug 13 15:06:10 UTC 2024
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2] 3.6206 (2.43) 3.6206 (2.43) 3.6206 (2.43) 0.0000 (1.0) 3.6206 (2.43) 0.0000 (1.0) 0;0 0.2762 (0.41) 1 1
test_add_copy-add[3.10.0] 3.4030 (2.29) 3.4030 (2.29) 3.4030 (2.29) 0.0000 (1.0) 3.4030 (2.29) 0.0000 (1.0) 0;0 0.2939 (0.44) 1 1
test_add_copy-add[3.53.2] 3.1646 (2.13) 3.1646 (2.13) 3.1646 (2.13) 0.0000 (1.0) 3.1646 (2.13) 0.0000 (1.0) 0;0 0.3160 (0.47) 1 1
test_add_copy-add[main] 1.4876 (1.0) 1.4876 (1.0) 1.4876 (1.0) 0.0000 (1.0) 1.4876 (1.0) 0.0000 (1.0) 0;0 0.6722 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2] 1.4743 (2.15) 1.4743 (2.15) 1.4743 (2.15) 0.0000 (1.0) 1.4743 (2.15) 0.0000 (1.0) 0;0 0.6783 (0.46) 1 1
test_add_copy-add-noop[3.10.0] 1.4877 (2.17) 1.4877 (2.17) 1.4877 (2.17) 0.0000 (1.0) 1.4877 (2.17) 0.0000 (1.0) 0;0 0.6722 (0.46) 1 1
test_add_copy-add-noop[3.53.2] 1.3310 (1.94) 1.3310 (1.94) 1.3310 (1.94) 0.0000 (1.0) 1.3310 (1.94) 0.0000 (1.0) 0;0 0.7513 (0.51) 1 1
test_add_copy-add-noop[main] 0.6846 (1.0) 0.6846 (1.0) 0.6846 (1.0) 0.0000 (1.0) 0.6846 (1.0) 0.0000 (1.0) 0;0 1.4608 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2] 2.8896 (1.69) 2.8896 (1.69) 2.8896 (1.69) 0.0000 (1.0) 2.8896 (1.69) 0.0000 (1.0) 0;0 0.3461 (0.59) 1 1
test_add_hardlink-add[3.10.0] 2.7662 (1.61) 2.7662 (1.61) 2.7662 (1.61) 0.0000 (1.0) 2.7662 (1.61) 0.0000 (1.0) 0;0 0.3615 (0.62) 1 1
test_add_hardlink-add[3.53.2] 2.5420 (1.48) 2.5420 (1.48) 2.5420 (1.48) 0.0000 (1.0) 2.5420 (1.48) 0.0000 (1.0) 0;0 0.3934 (0.67) 1 1
test_add_hardlink-add[main] 1.7148 (1.0) 1.7148 (1.0) 1.7148 (1.0) 0.0000 (1.0) 1.7148 (1.0) 0.0000 (1.0) 0;0 0.5832 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2] 1.7566 (2.69) 1.7566 (2.69) 1.7566 (2.69) 0.0000 (1.0) 1.7566 (2.69) 0.0000 (1.0) 0;0 0.5693 (0.37) 1 1
test_add_hardlink-add-noop[3.10.0] 1.5908 (2.44) 1.5908 (2.44) 1.5908 (2.44) 0.0000 (1.0) 1.5908 (2.44) 0.0000 (1.0) 0;0 0.6286 (0.41) 1 1
test_add_hardlink-add-noop[3.53.2] 1.5557 (2.39) 1.5557 (2.39) 1.5557 (2.39) 0.0000 (1.0) 1.5557 (2.39) 0.0000 (1.0) 0;0 0.6428 (0.42) 1 1
test_add_hardlink-add-noop[main] 0.6520 (1.0) 0.6520 (1.0) 0.6520 (1.0) 0.0000 (1.0) 0.6520 (1.0) 0.0000 (1.0) 0;0 1.5337 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2] 3.0505 (1.67) 3.0505 (1.67) 3.0505 (1.67) 0.0000 (1.0) 3.0505 (1.67) 0.0000 (1.0) 0;0 0.3278 (0.60) 1 1
test_add_symlink-add[3.10.0] 2.9238 (1.60) 2.9238 (1.60) 2.9238 (1.60) 0.0000 (1.0) 2.9238 (1.60) 0.0000 (1.0) 0;0 0.3420 (0.62) 1 1
test_add_symlink-add[3.53.2] 2.6829 (1.47) 2.6829 (1.47) 2.6829 (1.47) 0.0000 (1.0) 2.6829 (1.47) 0.0000 (1.0) 0;0 0.3727 (0.68) 1 1
test_add_symlink-add[main] 1.8238 (1.0) 1.8238 (1.0) 1.8238 (1.0) 0.0000 (1.0) 1.8238 (1.0) 0.0000 (1.0) 0;0 0.5483 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2] 1.9898 (2.79) 1.9898 (2.79) 1.9898 (2.79) 0.0000 (1.0) 1.9898 (2.79) 0.0000 (1.0) 0;0 0.5026 (0.36) 1 1
test_add_symlink-add-noop[3.10.0] 1.8495 (2.60) 1.8495 (2.60) 1.8495 (2.60) 0.0000 (1.0) 1.8495 (2.60) 0.0000 (1.0) 0;0 0.5407 (0.39) 1 1
test_add_symlink-add-noop[3.53.2] 1.7876 (2.51) 1.7876 (2.51) 1.7876 (2.51) 0.0000 (1.0) 1.7876 (2.51) 0.0000 (1.0) 0;0 0.5594 (0.40) 1 1
test_add_symlink-add-noop[main] 0.7126 (1.0) 0.7126 (1.0) 0.7126 (1.0) 0.0000 (1.0) 0.7126 (1.0) 0.0000 (1.0) 0;0 1.4033 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 2.0598 (1.53) 2.0598 (1.53) 2.0598 (1.53) 0.0000 (1.0) 2.0598 (1.53) 0.0000 (1.0) 0;0 0.4855 (0.65) 1 1
test_checkout_copy-checkout[3.10.0] 4.0295 (2.99) 4.0295 (2.99) 4.0295 (2.99) 0.0000 (1.0) 4.0295 (2.99) 0.0000 (1.0) 0;0 0.2482 (0.33) 1 1
test_checkout_copy-checkout[3.53.2] 1.5874 (1.18) 1.5874 (1.18) 1.5874 (1.18) 0.0000 (1.0) 1.5874 (1.18) 0.0000 (1.0) 0;0 0.6300 (0.85) 1 1
test_checkout_copy-checkout[main] 1.3483 (1.0) 1.3483 (1.0) 1.3483 (1.0) 0.0000 (1.0) 1.3483 (1.0) 0.0000 (1.0) 0;0 0.7417 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 592.2525 (1.06) 592.2525 (1.06) 592.2525 (1.06) 0.0000 (1.0) 592.2525 (1.06) 0.0000 (1.0) 0;0 1.6885 (0.94) 1 1
test_checkout_copy-checkout-noop[3.10.0] 652.1217 (1.17) 652.1217 (1.17) 652.1217 (1.17) 0.0000 (1.0) 652.1217 (1.17) 0.0000 (1.0) 0;0 1.5335 (0.86) 1 1
test_checkout_copy-checkout-noop[3.53.2] 587.6625 (1.05) 587.6625 (1.05) 587.6625 (1.05) 0.0000 (1.0) 587.6625 (1.05) 0.0000 (1.0) 0;0 1.7017 (0.95) 1 1
test_checkout_copy-checkout-noop[main] 558.4118 (1.0) 558.4118 (1.0) 558.4118 (1.0) 0.0000 (1.0) 558.4118 (1.0) 0.0000 (1.0) 0;0 1.7908 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 773.7690 (1.25) 773.7690 (1.25) 773.7690 (1.25) 0.0000 (1.0) 773.7690 (1.25) 0.0000 (1.0) 0;0 1.2924 (0.80) 1 1
test_checkout_copy-checkout-update[3.10.0] 768.9962 (1.24) 768.9962 (1.24) 768.9962 (1.24) 0.0000 (1.0) 768.9962 (1.24) 0.0000 (1.0) 0;0 1.3004 (0.80) 1 1
test_checkout_copy-checkout-update[3.53.2] 658.0184 (1.06) 658.0184 (1.06) 658.0184 (1.06) 0.0000 (1.0) 658.0184 (1.06) 0.0000 (1.0) 0;0 1.5197 (0.94) 1 1
test_checkout_copy-checkout-update[main] 618.8784 (1.0) 618.8784 (1.0) 618.8784 (1.0) 0.0000 (1.0) 618.8784 (1.0) 0.0000 (1.0) 0;0 1.6158 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.3910 (1.72) 1.3910 (1.72) 1.3910 (1.72) 0.0000 (1.0) 1.3910 (1.72) 0.0000 (1.0) 0;0 0.7189 (0.58) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.1865 (1.47) 1.1865 (1.47) 1.1865 (1.47) 0.0000 (1.0) 1.1865 (1.47) 0.0000 (1.0) 0;0 0.8428 (0.68) 1 1
test_checkout_hardlink-checkout[3.53.2] 1.0816 (1.34) 1.0816 (1.34) 1.0816 (1.34) 0.0000 (1.0) 1.0816 (1.34) 0.0000 (1.0) 0;0 0.9246 (0.75) 1 1
test_checkout_hardlink-checkout[main] 0.8082 (1.0) 0.8082 (1.0) 0.8082 (1.0) 0.0000 (1.0) 0.8082 (1.0) 0.0000 (1.0) 0;0 1.2373 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 657.3077 (1.22) 657.3077 (1.22) 657.3077 (1.22) 0.0000 (1.0) 657.3077 (1.22) 0.0000 (1.0) 0;0 1.5214 (0.82) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 628.7008 (1.17) 628.7008 (1.17) 628.7008 (1.17) 0.0000 (1.0) 628.7008 (1.17) 0.0000 (1.0) 0;0 1.5906 (0.85) 1 1
test_checkout_hardlink-checkout-noop[3.53.2] 599.3517 (1.12) 599.3517 (1.12) 599.3517 (1.12) 0.0000 (1.0) 599.3517 (1.12) 0.0000 (1.0) 0;0 1.6685 (0.90) 1 1
test_checkout_hardlink-checkout-noop[main] 537.3399 (1.0) 537.3399 (1.0) 537.3399 (1.0) 0.0000 (1.0) 537.3399 (1.0) 0.0000 (1.0) 0;0 1.8610 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 774.6364 (1.37) 774.6364 (1.37) 774.6364 (1.37) 0.0000 (1.0) 774.6364 (1.37) 0.0000 (1.0) 0;0 1.2909 (0.73) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 701.7898 (1.24) 701.7898 (1.24) 701.7898 (1.24) 0.0000 (1.0) 701.7898 (1.24) 0.0000 (1.0) 0;0 1.4249 (0.80) 1 1
test_checkout_hardlink-checkout-update[3.53.2] 674.9640 (1.20) 674.9640 (1.20) 674.9640 (1.20) 0.0000 (1.0) 674.9640 (1.20) 0.0000 (1.0) 0;0 1.4816 (0.84) 1 1
test_checkout_hardlink-checkout-update[main] 564.7314 (1.0) 564.7314 (1.0) 564.7314 (1.0) 0.0000 (1.0) 564.7314 (1.0) 0.0000 (1.0) 0;0 1.7708 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.4255 (1.63) 1.4255 (1.63) 1.4255 (1.63) 0.0000 (1.0) 1.4255 (1.63) 0.0000 (1.0) 0;0 0.7015 (0.61) 1 1
test_checkout_symlink-checkout[3.10.0] 1.2048 (1.38) 1.2048 (1.38) 1.2048 (1.38) 0.0000 (1.0) 1.2048 (1.38) 0.0000 (1.0) 0;0 0.8300 (0.73) 1 1
test_checkout_symlink-checkout[3.53.2] 1.1362 (1.30) 1.1362 (1.30) 1.1362 (1.30) 0.0000 (1.0) 1.1362 (1.30) 0.0000 (1.0) 0;0 0.8801 (0.77) 1 1
test_checkout_symlink-checkout[main] 0.8736 (1.0) 0.8736 (1.0) 0.8736 (1.0) 0.0000 (1.0) 0.8736 (1.0) 0.0000 (1.0) 0;0 1.1446 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 678.3808 (1.31) 678.3808 (1.31) 678.3808 (1.31) 0.0000 (1.0) 678.3808 (1.31) 0.0000 (1.0) 0;0 1.4741 (0.77) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 627.9373 (1.21) 627.9373 (1.21) 627.9373 (1.21) 0.0000 (1.0) 627.9373 (1.21) 0.0000 (1.0) 0;0 1.5925 (0.83) 1 1
test_checkout_symlink-checkout-noop[3.53.2] 598.5081 (1.15) 598.5081 (1.15) 598.5081 (1.15) 0.0000 (1.0) 598.5081 (1.15) 0.0000 (1.0) 0;0 1.6708 (0.87) 1 1
test_checkout_symlink-checkout-noop[main] 519.0987 (1.0) 519.0987 (1.0) 519.0987 (1.0) 0.0000 (1.0) 519.0987 (1.0) 0.0000 (1.0) 0;0 1.9264 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 793.3957 (1.33) 793.3957 (1.33) 793.3957 (1.33) 0.0000 (1.0) 793.3957 (1.33) 0.0000 (1.0) 0;0 1.2604 (0.75) 1 1
test_checkout_symlink-checkout-update[3.10.0] 738.7008 (1.24) 738.7008 (1.24) 738.7008 (1.24) 0.0000 (1.0) 738.7008 (1.24) 0.0000 (1.0) 0;0 1.3537 (0.80) 1 1
test_checkout_symlink-checkout-update[3.53.2] 709.9309 (1.19) 709.9309 (1.19) 709.9309 (1.19) 0.0000 (1.0) 709.9309 (1.19) 0.0000 (1.0) 0;0 1.4086 (0.84) 1 1
test_checkout_symlink-checkout-update[main] 594.5450 (1.0) 594.5450 (1.0) 594.5450 (1.0) 0.0000 (1.0) 594.5450 (1.0) 0.0000 (1.0) 0;0 1.6820 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 610.1081 (1.24) 610.1081 (1.24) 610.1081 (1.24) 0.0000 (1.0) 610.1081 (1.24) 0.0000 (1.0) 0;0 1.6391 (0.81) 1 1
test_data_status-data-changed[3.10.0] 644.9451 (1.31) 644.9451 (1.31) 644.9451 (1.31) 0.0000 (1.0) 644.9451 (1.31) 0.0000 (1.0) 0;0 1.5505 (0.76) 1 1
test_data_status-data-changed[3.53.2] 571.2456 (1.16) 571.2456 (1.16) 571.2456 (1.16) 0.0000 (1.0) 571.2456 (1.16) 0.0000 (1.0) 0;0 1.7506 (0.86) 1 1
test_data_status-data-changed[main] 492.5266 (1.0) 492.5266 (1.0) 492.5266 (1.0) 0.0000 (1.0) 492.5266 (1.0) 0.0000 (1.0) 0;0 2.0303 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 611.8084 (1.24) 611.8084 (1.24) 611.8084 (1.24) 0.0000 (1.0) 611.8084 (1.24) 0.0000 (1.0) 0;0 1.6345 (0.81) 1 1
test_data_status-data-changed-noop[3.10.0] 583.1421 (1.18) 583.1421 (1.18) 583.1421 (1.18) 0.0000 (1.0) 583.1421 (1.18) 0.0000 (1.0) 0;0 1.7148 (0.85) 1 1
test_data_status-data-changed-noop[3.53.2] 578.5621 (1.17) 578.5621 (1.17) 578.5621 (1.17) 0.0000 (1.0) 578.5621 (1.17) 0.0000 (1.0) 0;0 1.7284 (0.85) 1 1
test_data_status-data-changed-noop[main] 492.9651 (1.0) 492.9651 (1.0) 492.9651 (1.0) 0.0000 (1.0) 492.9651 (1.0) 0.0000 (1.0) 0;0 2.0285 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.3203 (1.72) 1.3203 (1.72) 1.3203 (1.72) 0.0000 (1.0) 1.3203 (1.72) 0.0000 (1.0) 0;0 0.7574 (0.58) 1 1
test_data_status-data-new[3.10.0] 1.2692 (1.65) 1.2692 (1.65) 1.2692 (1.65) 0.0000 (1.0) 1.2692 (1.65) 0.0000 (1.0) 0;0 0.7879 (0.60) 1 1
test_data_status-data-new[3.53.2] 1.2495 (1.63) 1.2495 (1.63) 1.2495 (1.63) 0.0000 (1.0) 1.2495 (1.63) 0.0000 (1.0) 0;0 0.8003 (0.61) 1 1
test_data_status-data-new[main] 0.7676 (1.0) 0.7676 (1.0) 0.7676 (1.0) 0.0000 (1.0) 0.7676 (1.0) 0.0000 (1.0) 0;0 1.3028 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 627.7193 (1.29) 627.7193 (1.29) 627.7193 (1.29) 0.0000 (1.0) 627.7193 (1.29) 0.0000 (1.0) 0;0 1.5931 (0.78) 1 1
test_data_status-data-noop[3.10.0] 585.4849 (1.20) 585.4849 (1.20) 585.4849 (1.20) 0.0000 (1.0) 585.4849 (1.20) 0.0000 (1.0) 0;0 1.7080 (0.83) 1 1
test_data_status-data-noop[3.53.2] 567.1318 (1.16) 567.1318 (1.16) 567.1318 (1.16) 0.0000 (1.0) 567.1318 (1.16) 0.0000 (1.0) 0;0 1.7633 (0.86) 1 1
test_data_status-data-noop[main] 487.8160 (1.0) 487.8160 (1.0) 487.8160 (1.0) 0.0000 (1.0) 487.8160 (1.0) 0.0000 (1.0) 0;0 2.0500 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.2305 (1.10) 1.2305 (1.10) 1.2305 (1.10) 0.0000 (1.0) 1.2305 (1.10) 0.0000 (1.0) 0;0 0.8127 (0.91) 1 1
test_data_status_all_flags-data-changed[3.10.0] 1.2043 (1.07) 1.2043 (1.07) 1.2043 (1.07) 0.0000 (1.0) 1.2043 (1.07) 0.0000 (1.0) 0;0 0.8304 (0.93) 1 1
test_data_status_all_flags-data-changed[3.53.2] 1.1449 (1.02) 1.1449 (1.02) 1.1449 (1.02) 0.0000 (1.0) 1.1449 (1.02) 0.0000 (1.0) 0;0 0.8734 (0.98) 1 1
test_data_status_all_flags-data-changed[main] 1.1236 (1.0) 1.1236 (1.0) 1.1236 (1.0) 0.0000 (1.0) 1.1236 (1.0) 0.0000 (1.0) 0;0 0.8900 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.2235 (1.10) 1.2235 (1.10) 1.2235 (1.10) 0.0000 (1.0) 1.2235 (1.10) 0.0000 (1.0) 0;0 0.8173 (0.91) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 1.2120 (1.09) 1.2120 (1.09) 1.2120 (1.09) 0.0000 (1.0) 1.2120 (1.09) 0.0000 (1.0) 0;0 0.8251 (0.92) 1 1
test_data_status_all_flags-data-changed-noop[3.53.2] 1.1642 (1.05) 1.1642 (1.05) 1.1642 (1.05) 0.0000 (1.0) 1.1642 (1.05) 0.0000 (1.0) 0;0 0.8589 (0.95) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.1107 (1.0) 1.1107 (1.0) 1.1107 (1.0) 0.0000 (1.0) 1.1107 (1.0) 0.0000 (1.0) 0;0 0.9003 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 1.9668 (1.39) 1.9668 (1.39) 1.9668 (1.39) 0.0000 (1.0) 1.9668 (1.39) 0.0000 (1.0) 0;0 0.5085 (0.72) 1 1
test_data_status_all_flags-data-new[3.10.0] 1.9101 (1.35) 1.9101 (1.35) 1.9101 (1.35) 0.0000 (1.0) 1.9101 (1.35) 0.0000 (1.0) 0;0 0.5235 (0.74) 1 1
test_data_status_all_flags-data-new[3.53.2] 2.1697 (1.53) 2.1697 (1.53) 2.1697 (1.53) 0.0000 (1.0) 2.1697 (1.53) 0.0000 (1.0) 0;0 0.4609 (0.65) 1 1
test_data_status_all_flags-data-new[main] 1.4143 (1.0) 1.4143 (1.0) 1.4143 (1.0) 0.0000 (1.0) 1.4143 (1.0) 0.0000 (1.0) 0;0 0.7070 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 1.2929 (1.18) 1.2929 (1.18) 1.2929 (1.18) 0.0000 (1.0) 1.2929 (1.18) 0.0000 (1.0) 0;0 0.7734 (0.84) 1 1
test_data_status_all_flags-data-noop[3.10.0] 1.1710 (1.07) 1.1710 (1.07) 1.1710 (1.07) 0.0000 (1.0) 1.1710 (1.07) 0.0000 (1.0) 0;0 0.8540 (0.93) 1 1
test_data_status_all_flags-data-noop[3.53.2] 1.1555 (1.06) 1.1555 (1.06) 1.1555 (1.06) 0.0000 (1.0) 1.1555 (1.06) 0.0000 (1.0) 0;0 0.8654 (0.94) 1 1
test_data_status_all_flags-data-noop[main] 1.0919 (1.0) 1.0919 (1.0) 1.0919 (1.0) 0.0000 (1.0) 1.0919 (1.0) 0.0000 (1.0) 0;0 0.9158 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.2821 (1.50) 1.2821 (1.50) 1.2821 (1.50) 0.0000 (1.0) 1.2821 (1.50) 0.0000 (1.0) 0;0 0.7800 (0.66) 1 1
test_diff-diff[3.10.0] 1.2922 (1.52) 1.2922 (1.52) 1.2922 (1.52) 0.0000 (1.0) 1.2922 (1.52) 0.0000 (1.0) 0;0 0.7738 (0.66) 1 1
test_diff-diff[3.53.2] 1.2594 (1.48) 1.2594 (1.48) 1.2594 (1.48) 0.0000 (1.0) 1.2594 (1.48) 0.0000 (1.0) 0;0 0.7940 (0.68) 1 1
test_diff-diff[main] 0.8520 (1.0) 0.8520 (1.0) 0.8520 (1.0) 0.0000 (1.0) 0.8520 (1.0) 0.0000 (1.0) 0;0 1.1737 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 686.0644 (1.22) 686.0644 (1.22) 686.0644 (1.22) 0.0000 (1.0) 686.0644 (1.22) 0.0000 (1.0) 0;0 1.4576 (0.82) 1 1
test_diff-diff-changed[3.10.0] 800.7089 (1.42) 800.7089 (1.42) 800.7089 (1.42) 0.0000 (1.0) 800.7089 (1.42) 0.0000 (1.0) 0;0 1.2489 (0.70) 1 1
test_diff-diff-changed[3.53.2] 638.9992 (1.14) 638.9992 (1.14) 638.9992 (1.14) 0.0000 (1.0) 638.9992 (1.14) 0.0000 (1.0) 0;0 1.5649 (0.88) 1 1
test_diff-diff-changed[main] 562.1661 (1.0) 562.1661 (1.0) 562.1661 (1.0) 0.0000 (1.0) 562.1661 (1.0) 0.0000 (1.0) 0;0 1.7788 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 656.4086 (1.18) 656.4086 (1.18) 656.4086 (1.18) 0.0000 (1.0) 656.4086 (1.18) 0.0000 (1.0) 0;0 1.5234 (0.85) 1 1
test_diff-diff-changed-noop[3.10.0] 653.0371 (1.17) 653.0371 (1.17) 653.0371 (1.17) 0.0000 (1.0) 653.0371 (1.17) 0.0000 (1.0) 0;0 1.5313 (0.85) 1 1
test_diff-diff-changed-noop[3.53.2] 640.0652 (1.15) 640.0652 (1.15) 640.0652 (1.15) 0.0000 (1.0) 640.0652 (1.15) 0.0000 (1.0) 0;0 1.5623 (0.87) 1 1
test_diff-diff-changed-noop[main] 558.0558 (1.0) 558.0558 (1.0) 558.0558 (1.0) 0.0000 (1.0) 558.0558 (1.0) 0.0000 (1.0) 0;0 1.7919 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 648.5345 (1.17) 648.5345 (1.17) 648.5345 (1.17) 0.0000 (1.0) 648.5345 (1.17) 0.0000 (1.0) 0;0 1.5419 (0.86) 1 1
test_diff-diff-noop[3.10.0] 619.9744 (1.12) 619.9744 (1.12) 619.9744 (1.12) 0.0000 (1.0) 619.9744 (1.12) 0.0000 (1.0) 0;0 1.6130 (0.90) 1 1
test_diff-diff-noop[3.53.2] 627.7415 (1.13) 627.7415 (1.13) 627.7415 (1.13) 0.0000 (1.0) 627.7415 (1.13) 0.0000 (1.0) 0;0 1.5930 (0.89) 1 1
test_diff-diff-noop[main] 555.8800 (1.0) 555.8800 (1.0) 555.8800 (1.0) 0.0000 (1.0) 555.8800 (1.0) 0.0000 (1.0) 0;0 1.7989 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 991.4037 (1.0) 991.4037 (1.0) 991.4037 (1.0) 0.0000 (1.0) 991.4037 (1.0) 0.0000 (1.0) 0;0 1.0087 (1.0) 1 1
test_exp_show-exp[3.10.0] 6,921.6824 (6.98) 6,921.6824 (6.98) 6,921.6824 (6.98) 0.0000 (1.0) 6,921.6824 (6.98) 0.0000 (1.0) 0;0 0.1445 (0.14) 1 1
test_exp_show-exp[3.53.2] 4,718.5165 (4.76) 4,718.5165 (4.76) 4,718.5165 (4.76) 0.0000 (1.0) 4,718.5165 (4.76) 0.0000 (1.0) 0;0 0.2119 (0.21) 1 1
test_exp_show-exp[main] 5,367.0369 (5.41) 5,367.0369 (5.41) 5,367.0369 (5.41) 0.0000 (1.0) 5,367.0369 (5.41) 0.0000 (1.0) 0;0 0.1863 (0.18) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 3.9184 (2.74) 3.9184 (2.74) 3.9184 (2.74) 0.0000 (1.0) 3.9184 (2.74) 0.0000 (1.0) 0;0 0.2552 (0.36) 1 1
test_fetch-fetch[3.10.0] 4.1835 (2.93) 4.1835 (2.93) 4.1835 (2.93) 0.0000 (1.0) 4.1835 (2.93) 0.0000 (1.0) 0;0 0.2390 (0.34) 1 1
test_fetch-fetch[3.53.2] 1.7532 (1.23) 1.7532 (1.23) 1.7532 (1.23) 0.0000 (1.0) 1.7532 (1.23) 0.0000 (1.0) 0;0 0.5704 (0.82) 1 1
test_fetch-fetch[main] 1.4293 (1.0) 1.4293 (1.0) 1.4293 (1.0) 0.0000 (1.0) 1.4293 (1.0) 0.0000 (1.0) 0;0 0.6997 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 501.5029 (1.01) 501.5029 (1.01) 501.5029 (1.01) 0.0000 (1.0) 501.5029 (1.01) 0.0000 (1.0) 0;0 1.9940 (0.99) 1 1
test_gc-gc[3.10.0] 522.1458 (1.05) 522.1458 (1.05) 522.1458 (1.05) 0.0000 (1.0) 522.1458 (1.05) 0.0000 (1.0) 0;0 1.9152 (0.96) 1 1
test_gc-gc[3.53.2] 498.8820 (1.0) 498.8820 (1.0) 498.8820 (1.0) 0.0000 (1.0) 498.8820 (1.0) 0.0000 (1.0) 0;0 2.0045 (1.0) 1 1
test_gc-gc[main] 500.2353 (1.00) 500.2353 (1.00) 500.2353 (1.00) 0.0000 (1.0) 500.2353 (1.00) 0.0000 (1.0) 0;0 1.9991 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 6.6418 (1.35) 6.6418 (1.35) 6.6418 (1.35) 0.0000 (1.0) 6.6418 (1.35) 0.0000 (1.0) 0;0 0.1506 (0.74) 1 1
test_get-get[3.10.0] 6.7575 (1.37) 6.7575 (1.37) 6.7575 (1.37) 0.0000 (1.0) 6.7575 (1.37) 0.0000 (1.0) 0;0 0.1480 (0.73) 1 1
test_get-get[3.53.2] 5.0209 (1.02) 5.0209 (1.02) 5.0209 (1.02) 0.0000 (1.0) 5.0209 (1.02) 0.0000 (1.0) 0;0 0.1992 (0.98) 1 1
test_get-get[main] 4.9270 (1.0) 4.9270 (1.0) 4.9270 (1.0) 0.0000 (1.0) 4.9270 (1.0) 0.0000 (1.0) 0;0 0.2030 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 2.9983 (3.16) 2.9983 (3.16) 2.9983 (3.16) 0.0000 (1.0) 2.9983 (3.16) 0.0000 (1.0) 0;0 0.3335 (0.32) 1 1
test_get_url-get-url[3.10.0] 3.1722 (3.35) 3.1722 (3.35) 3.1722 (3.35) 0.0000 (1.0) 3.1722 (3.35) 0.0000 (1.0) 0;0 0.3152 (0.30) 1 1
test_get_url-get-url[3.53.2] 0.9496 (1.00) 0.9496 (1.00) 0.9496 (1.00) 0.0000 (1.0) 0.9496 (1.00) 0.0000 (1.0) 0;0 1.0530 (1.00) 1 1
test_get_url-get-url[main] 0.9476 (1.0) 0.9476 (1.0) 0.9476 (1.0) 0.0000 (1.0) 0.9476 (1.0) 0.0000 (1.0) 0;0 1.0554 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 123.5523 (1.01) 127.4216 (1.0) 124.6772 (1.01) 0.6923 (1.0) 124.6064 (1.02) 0.7983 (1.27) 25;4 8.0207 (0.99) 100 1
test_help---help[3.10.0] 121.7642 (1.0) 132.0833 (1.04) 122.8769 (1.0) 1.1096 (1.60) 122.7368 (1.0) 0.7544 (1.20) 7;4 8.1382 (1.0) 100 1
test_help---help[3.53.2] 122.9101 (1.01) 144.6111 (1.13) 124.4992 (1.01) 2.2733 (3.28) 124.1430 (1.01) 0.8502 (1.35) 6;9 8.0322 (0.99) 100 1
test_help---help[main] 122.8182 (1.01) 138.1553 (1.08) 123.9666 (1.01) 1.7759 (2.57) 123.6892 (1.01) 0.6288 (1.0) 2;5 8.0667 (0.99) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 9.1164 (1.0) 9.1164 (1.0) 9.1164 (1.0) 0.0000 (1.0) 9.1164 (1.0) 0.0000 (1.0) 0;0 0.1097 (1.0) 1 1
test_import-import[3.10.0] 9.9103 (1.09) 9.9103 (1.09) 9.9103 (1.09) 0.0000 (1.0) 9.9103 (1.09) 0.0000 (1.0) 0;0 0.1009 (0.92) 1 1
test_import-import[3.53.2] 13.0427 (1.43) 13.0427 (1.43) 13.0427 (1.43) 0.0000 (1.0) 13.0427 (1.43) 0.0000 (1.0) 0;0 0.0767 (0.70) 1 1
test_import-import[main] 9.6940 (1.06) 9.6940 (1.06) 9.6940 (1.06) 0.0000 (1.0) 9.6940 (1.06) 0.0000 (1.0) 0;0 0.1032 (0.94) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 7.5310 (3.00) 7.5310 (3.00) 7.5310 (3.00) 0.0000 (1.0) 7.5310 (3.00) 0.0000 (1.0) 0;0 0.1328 (0.33) 1 1
test_import_url-import-url[3.10.0] 7.3185 (2.92) 7.3185 (2.92) 7.3185 (2.92) 0.0000 (1.0) 7.3185 (2.92) 0.0000 (1.0) 0;0 0.1366 (0.34) 1 1
test_import_url-import-url[3.53.2] 4.8214 (1.92) 4.8214 (1.92) 4.8214 (1.92) 0.0000 (1.0) 4.8214 (1.92) 0.0000 (1.0) 0;0 0.2074 (0.52) 1 1
test_import_url-import-url[main] 2.5071 (1.0) 2.5071 (1.0) 2.5071 (1.0) 0.0000 (1.0) 2.5071 (1.0) 0.0000 (1.0) 0;0 0.3989 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 391.0293 (1.0) 413.5695 (1.0) 399.4617 (1.0) 4.0352 (1.0) 399.0043 (1.0) 4.7495 (1.0) 22;3 2.5034 (1.0) 100 1
test_init-init[3.10.0] 405.4711 (1.04) 479.7897 (1.16) 414.0539 (1.04) 7.9221 (1.96) 413.0890 (1.04) 5.4917 (1.16) 4;3 2.4151 (0.96) 100 1
test_init-init[3.53.2] 392.2875 (1.00) 427.5187 (1.03) 401.9108 (1.01) 5.6019 (1.39) 400.6928 (1.00) 5.0554 (1.06) 16;5 2.4881 (0.99) 100 1
test_init-init[main] 397.4145 (1.02) 479.0811 (1.16) 404.6752 (1.01) 8.6086 (2.13) 403.2617 (1.01) 4.8870 (1.03) 5;5 2.4711 (0.99) 100 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 433.1757 (1.05) 433.1757 (1.05) 433.1757 (1.05) 0.0000 (1.0) 433.1757 (1.05) 0.0000 (1.0) 0;0 2.3085 (0.95) 1 1
test_list-list[3.10.0] 464.1433 (1.13) 464.1433 (1.13) 464.1433 (1.13) 0.0000 (1.0) 464.1433 (1.13) 0.0000 (1.0) 0;0 2.1545 (0.89) 1 1
test_list-list[3.53.2] 415.0918 (1.01) 415.0918 (1.01) 415.0918 (1.01) 0.0000 (1.0) 415.0918 (1.01) 0.0000 (1.0) 0;0 2.4091 (0.99) 1 1
test_list-list[main] 411.7644 (1.0) 411.7644 (1.0) 411.7644 (1.0) 0.0000 (1.0) 411.7644 (1.0) 0.0000 (1.0) 0;0 2.4286 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 426.8570 (1.08) 426.8570 (1.08) 426.8570 (1.08) 0.0000 (1.0) 426.8570 (1.08) 0.0000 (1.0) 0;0 2.3427 (0.93) 1 1
test_list-list-dvc-only[3.10.0] 438.9264 (1.11) 438.9264 (1.11) 438.9264 (1.11) 0.0000 (1.0) 438.9264 (1.11) 0.0000 (1.0) 0;0 2.2783 (0.90) 1 1
test_list-list-dvc-only[3.53.2] 419.8106 (1.06) 419.8106 (1.06) 419.8106 (1.06) 0.0000 (1.0) 419.8106 (1.06) 0.0000 (1.0) 0;0 2.3820 (0.94) 1 1
test_list-list-dvc-only[main] 395.8313 (1.0) 395.8313 (1.0) 395.8313 (1.0) 0.0000 (1.0) 395.8313 (1.0) 0.0000 (1.0) 0;0 2.5263 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 499.6367 (1.04) 499.6367 (1.04) 499.6367 (1.04) 0.0000 (1.0) 499.6367 (1.04) 0.0000 (1.0) 0;0 2.0015 (0.96) 1 1
test_list-list-recursive[3.10.0] 518.9034 (1.08) 518.9034 (1.08) 518.9034 (1.08) 0.0000 (1.0) 518.9034 (1.08) 0.0000 (1.0) 0;0 1.9271 (0.92) 1 1
test_list-list-recursive[3.53.2] 479.5207 (1.0) 479.5207 (1.0) 479.5207 (1.0) 0.0000 (1.0) 479.5207 (1.0) 0.0000 (1.0) 0;0 2.0854 (1.0) 1 1
test_list-list-recursive[main] 483.2884 (1.01) 483.2884 (1.01) 483.2884 (1.01) 0.0000 (1.0) 483.2884 (1.01) 0.0000 (1.0) 0;0 2.0692 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 430.6685 (1.08) 430.6685 (1.08) 430.6685 (1.08) 0.0000 (1.0) 430.6685 (1.08) 0.0000 (1.0) 0;0 2.3220 (0.93) 1 1
test_list-list-shallow[3.10.0] 427.8926 (1.07) 427.8926 (1.07) 427.8926 (1.07) 0.0000 (1.0) 427.8926 (1.07) 0.0000 (1.0) 0;0 2.3370 (0.93) 1 1
test_list-list-shallow[3.53.2] 399.9553 (1.0) 399.9553 (1.0) 399.9553 (1.0) 0.0000 (1.0) 399.9553 (1.0) 0.0000 (1.0) 0;0 2.5003 (1.0) 1 1
test_list-list-shallow[main] 405.0576 (1.01) 405.0576 (1.01) 405.0576 (1.01) 0.0000 (1.0) 405.0576 (1.01) 0.0000 (1.0) 0;0 2.4688 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.1946 (2.15) 2.1946 (2.15) 2.1946 (2.15) 0.0000 (1.0) 2.1946 (2.15) 0.0000 (1.0) 0;0 0.4557 (0.47) 1 1
test_partial_add-add[3.10.0] 2.0522 (2.01) 2.0522 (2.01) 2.0522 (2.01) 0.0000 (1.0) 2.0522 (2.01) 0.0000 (1.0) 0;0 0.4873 (0.50) 1 1
test_partial_add-add[3.53.2] 1.8410 (1.80) 1.8410 (1.80) 1.8410 (1.80) 0.0000 (1.0) 1.8410 (1.80) 0.0000 (1.0) 0;0 0.5432 (0.56) 1 1
test_partial_add-add[main] 1.0229 (1.0) 1.0229 (1.0) 1.0229 (1.0) 0.0000 (1.0) 1.0229 (1.0) 0.0000 (1.0) 0;0 0.9776 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 3.2779 (2.93) 3.2779 (2.93) 3.2779 (2.93) 0.0000 (1.0) 3.2779 (2.93) 0.0000 (1.0) 0;0 0.3051 (0.34) 1 1
test_partial_add-add-partial[3.10.0] 2.9942 (2.68) 2.9942 (2.68) 2.9942 (2.68) 0.0000 (1.0) 2.9942 (2.68) 0.0000 (1.0) 0;0 0.3340 (0.37) 1 1
test_partial_add-add-partial[3.53.2] 2.8654 (2.57) 2.8654 (2.57) 2.8654 (2.57) 0.0000 (1.0) 2.8654 (2.57) 0.0000 (1.0) 0;0 0.3490 (0.39) 1 1
test_partial_add-add-partial[main] 1.1169 (1.0) 1.1169 (1.0) 1.1169 (1.0) 0.0000 (1.0) 1.1169 (1.0) 0.0000 (1.0) 0;0 0.8953 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 607.2231 (1.0) 607.2231 (1.0) 607.2231 (1.0) 0.0000 (1.0) 607.2231 (1.0) 0.0000 (1.0) 0;0 1.6468 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 648.3748 (1.07) 648.3748 (1.07) 648.3748 (1.07) 0.0000 (1.0) 648.3748 (1.07) 0.0000 (1.0) 0;0 1.5423 (0.94) 1 1
test_partial_add-gc-cloud-noop[3.53.2] 640.7401 (1.06) 640.7401 (1.06) 640.7401 (1.06) 0.0000 (1.0) 640.7401 (1.06) 0.0000 (1.0) 0;0 1.5607 (0.95) 1 1
test_partial_add-gc-cloud-noop[main] 658.5818 (1.08) 658.5818 (1.08) 658.5818 (1.08) 0.0000 (1.0) 658.5818 (1.08) 0.0000 (1.0) 0;0 1.5184 (0.92) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 524.8235 (1.0) 524.8235 (1.0) 524.8235 (1.0) 0.0000 (1.0) 524.8235 (1.0) 0.0000 (1.0) 0;0 1.9054 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 566.3913 (1.08) 566.3913 (1.08) 566.3913 (1.08) 0.0000 (1.0) 566.3913 (1.08) 0.0000 (1.0) 0;0 1.7656 (0.93) 1 1
test_partial_add-gc-noop[3.53.2] 536.5252 (1.02) 536.5252 (1.02) 536.5252 (1.02) 0.0000 (1.0) 536.5252 (1.02) 0.0000 (1.0) 0;0 1.8638 (0.98) 1 1
test_partial_add-gc-noop[main] 545.2226 (1.04) 545.2226 (1.04) 545.2226 (1.04) 0.0000 (1.0) 545.2226 (1.04) 0.0000 (1.0) 0;0 1.8341 (0.96) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 1.9644 (1.81) 1.9644 (1.81) 1.9644 (1.81) 0.0000 (1.0) 1.9644 (1.81) 0.0000 (1.0) 0;0 0.5091 (0.55) 1 1
test_partial_add-push[3.10.0] 1.3363 (1.23) 1.3363 (1.23) 1.3363 (1.23) 0.0000 (1.0) 1.3363 (1.23) 0.0000 (1.0) 0;0 0.7483 (0.81) 1 1
test_partial_add-push[3.53.2] 1.0916 (1.01) 1.0916 (1.01) 1.0916 (1.01) 0.0000 (1.0) 1.0916 (1.01) 0.0000 (1.0) 0;0 0.9161 (0.99) 1 1
test_partial_add-push[main] 1.0830 (1.0) 1.0830 (1.0) 1.0830 (1.0) 0.0000 (1.0) 1.0830 (1.0) 0.0000 (1.0) 0;0 0.9234 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 2.0711 (1.74) 2.0711 (1.74) 2.0711 (1.74) 0.0000 (1.0) 2.0711 (1.74) 0.0000 (1.0) 0;0 0.4828 (0.57) 1 1
test_partial_add-push-partial[3.10.0] 1.2810 (1.08) 1.2810 (1.08) 1.2810 (1.08) 0.0000 (1.0) 1.2810 (1.08) 0.0000 (1.0) 0;0 0.7806 (0.93) 1 1
test_partial_add-push-partial[3.53.2] 1.1913 (1.00) 1.1913 (1.00) 1.1913 (1.00) 0.0000 (1.0) 1.1913 (1.00) 0.0000 (1.0) 0;0 0.8394 (1.00) 1 1
test_partial_add-push-partial[main] 1.1890 (1.0) 1.1890 (1.0) 1.1890 (1.0) 0.0000 (1.0) 1.1890 (1.0) 0.0000 (1.0) 0;0 0.8410 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.7350 (2.45) 3.7350 (2.45) 3.7350 (2.45) 0.0000 (1.0) 3.7350 (2.45) 0.0000 (1.0) 0;0 0.2677 (0.41) 1 1
test_partial_remove-add[3.10.0] 3.5977 (2.36) 3.5977 (2.36) 3.5977 (2.36) 0.0000 (1.0) 3.5977 (2.36) 0.0000 (1.0) 0;0 0.2780 (0.42) 1 1
test_partial_remove-add[3.53.2] 3.2861 (2.15) 3.2861 (2.15) 3.2861 (2.15) 0.0000 (1.0) 3.2861 (2.15) 0.0000 (1.0) 0;0 0.3043 (0.46) 1 1
test_partial_remove-add[main] 1.5258 (1.0) 1.5258 (1.0) 1.5258 (1.0) 0.0000 (1.0) 1.5258 (1.0) 0.0000 (1.0) 0;0 0.6554 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.5841 (2.46) 1.5841 (2.46) 1.5841 (2.46) 0.0000 (1.0) 1.5841 (2.46) 0.0000 (1.0) 0;0 0.6313 (0.41) 1 1
test_partial_remove-add-update[3.10.0] 1.5474 (2.40) 1.5474 (2.40) 1.5474 (2.40) 0.0000 (1.0) 1.5474 (2.40) 0.0000 (1.0) 0;0 0.6462 (0.42) 1 1
test_partial_remove-add-update[3.53.2] 1.4099 (2.19) 1.4099 (2.19) 1.4099 (2.19) 0.0000 (1.0) 1.4099 (2.19) 0.0000 (1.0) 0;0 0.7093 (0.46) 1 1
test_partial_remove-add-update[main] 0.6449 (1.0) 0.6449 (1.0) 0.6449 (1.0) 0.0000 (1.0) 0.6449 (1.0) 0.0000 (1.0) 0;0 1.5507 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 544.1839 (1.0) 544.1839 (1.0) 544.1839 (1.0) 0.0000 (1.0) 544.1839 (1.0) 0.0000 (1.0) 0;0 1.8376 (1.0) 1 1
test_partial_remove-gc[3.10.0] 588.5626 (1.08) 588.5626 (1.08) 588.5626 (1.08) 0.0000 (1.0) 588.5626 (1.08) 0.0000 (1.0) 0;0 1.6991 (0.92) 1 1
test_partial_remove-gc[3.53.2] 567.6621 (1.04) 567.6621 (1.04) 567.6621 (1.04) 0.0000 (1.0) 567.6621 (1.04) 0.0000 (1.0) 0;0 1.7616 (0.96) 1 1
test_partial_remove-gc[main] 557.8595 (1.03) 557.8595 (1.03) 557.8595 (1.03) 0.0000 (1.0) 557.8595 (1.03) 0.0000 (1.0) 0;0 1.7926 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 635.9259 (1.02) 635.9259 (1.02) 635.9259 (1.02) 0.0000 (1.0) 635.9259 (1.02) 0.0000 (1.0) 0;0 1.5725 (0.98) 1 1
test_partial_remove-gc-cloud[3.10.0] 655.5876 (1.05) 655.5876 (1.05) 655.5876 (1.05) 0.0000 (1.0) 655.5876 (1.05) 0.0000 (1.0) 0;0 1.5253 (0.95) 1 1
test_partial_remove-gc-cloud[3.53.2] 635.4605 (1.02) 635.4605 (1.02) 635.4605 (1.02) 0.0000 (1.0) 635.4605 (1.02) 0.0000 (1.0) 0;0 1.5737 (0.98) 1 1
test_partial_remove-gc-cloud[main] 622.7088 (1.0) 622.7088 (1.0) 622.7088 (1.0) 0.0000 (1.0) 622.7088 (1.0) 0.0000 (1.0) 0;0 1.6059 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 3.4734 (2.39) 3.4734 (2.39) 3.4734 (2.39) 0.0000 (1.0) 3.4734 (2.39) 0.0000 (1.0) 0;0 0.2879 (0.42) 1 1
test_partial_remove-push[3.10.0] 1.9576 (1.35) 1.9576 (1.35) 1.9576 (1.35) 0.0000 (1.0) 1.9576 (1.35) 0.0000 (1.0) 0;0 0.5108 (0.74) 1 1
test_partial_remove-push[3.53.2] 1.5455 (1.06) 1.5455 (1.06) 1.5455 (1.06) 0.0000 (1.0) 1.5455 (1.06) 0.0000 (1.0) 0;0 0.6470 (0.94) 1 1
test_partial_remove-push[main] 1.4540 (1.0) 1.4540 (1.0) 1.4540 (1.0) 0.0000 (1.0) 1.4540 (1.0) 0.0000 (1.0) 0;0 0.6877 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 538.6710 (1.00) 538.6710 (1.00) 538.6710 (1.00) 0.0000 (1.0) 538.6710 (1.00) 0.0000 (1.0) 0;0 1.8564 (1.00) 1 1
test_partial_remove-push-update[3.10.0] 537.1479 (1.0) 537.1479 (1.0) 537.1479 (1.0) 0.0000 (1.0) 537.1479 (1.0) 0.0000 (1.0) 0;0 1.8617 (1.0) 1 1
test_partial_remove-push-update[3.53.2] 838.7545 (1.56) 838.7545 (1.56) 838.7545 (1.56) 0.0000 (1.0) 838.7545 (1.56) 0.0000 (1.0) 0;0 1.1922 (0.64) 1 1
test_partial_remove-push-update[main] 861.5543 (1.60) 861.5543 (1.60) 861.5543 (1.60) 0.0000 (1.0) 861.5543 (1.60) 0.0000 (1.0) 0;0 1.1607 (0.62) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 487.8629 (1.0) 497.1365 (1.0) 490.1642 (1.0) 3.9174 (2.74) 488.7893 (1.0) 2.7335 (1.19) 1;1 2.0401 (1.0) 5 3
test_plots-plots-diff[3.10.0] 827.7959 (1.70) 831.2761 (1.67) 829.7652 (1.69) 1.4313 (1.0) 829.5980 (1.70) 2.2969 (1.0) 2;0 1.2052 (0.59) 5 3
test_plots-plots-diff[3.53.2] 791.1029 (1.62) 811.2297 (1.63) 799.8760 (1.63) 7.3335 (5.12) 798.4112 (1.63) 7.7315 (3.37) 2;0 1.2502 (0.61) 5 3
test_plots-plots-diff[main] 791.4706 (1.62) 799.8336 (1.61) 794.6162 (1.62) 3.3742 (2.36) 794.5849 (1.63) 4.7615 (2.07) 1;0 1.2585 (0.62) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 503.8635 (1.0) 515.3117 (1.0) 510.2526 (1.0) 4.3131 (1.0) 511.4290 (1.0) 5.5870 (1.0) 2;0 1.9598 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,051.6288 (2.09) 1,064.4036 (2.07) 1,056.9063 (2.07) 5.2942 (1.23) 1,054.2689 (2.06) 8.0553 (1.44) 1;0 0.9462 (0.48) 5 3
test_plots-plots-diff-json[3.53.2] 867.0876 (1.72) 920.5474 (1.79) 893.9686 (1.75) 24.5914 (5.70) 905.4163 (1.77) 43.3044 (7.75) 3;0 1.1186 (0.57) 5 3
test_plots-plots-diff-json[main] 864.7944 (1.72) 887.4033 (1.72) 874.1551 (1.71) 8.6675 (2.01) 874.7148 (1.71) 11.1797 (2.00) 2;0 1.1440 (0.58) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 429.1470 (1.0) 444.0717 (1.0) 436.0698 (1.0) 5.3273 (1.29) 436.1523 (1.0) 4.7270 (1.03) 2;0 2.2932 (1.0) 5 3
test_plots-plots-show[3.10.0] 675.9431 (1.58) 692.9256 (1.56) 682.8490 (1.57) 6.7963 (1.65) 681.7058 (1.56) 10.2613 (2.23) 2;0 1.4645 (0.64) 5 3
test_plots-plots-show[3.53.2] 666.2351 (1.55) 677.3205 (1.53) 671.9800 (1.54) 4.9131 (1.19) 674.0168 (1.55) 8.5370 (1.85) 2;0 1.4881 (0.65) 5 3
test_plots-plots-show[main] 657.0937 (1.53) 667.5467 (1.50) 660.6301 (1.51) 4.1150 (1.0) 659.3506 (1.51) 4.6097 (1.0) 1;0 1.5137 (0.66) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 457.0509 (1.0) 483.2653 (1.0) 470.8836 (1.0) 9.9717 (3.13) 470.4658 (1.0) 14.1408 (3.16) 2;0 2.1237 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 800.0919 (1.75) 816.0578 (1.69) 808.6393 (1.72) 6.2802 (1.97) 807.5083 (1.72) 9.3833 (2.09) 2;0 1.2366 (0.58) 5 3
test_plots-plots-show-json[3.53.2] 699.6503 (1.53) 706.5880 (1.46) 702.9088 (1.49) 3.1815 (1.0) 703.3205 (1.49) 5.9528 (1.33) 3;0 1.4227 (0.67) 5 3
test_plots-plots-show-json[main] 707.0991 (1.55) 717.6532 (1.49) 713.5253 (1.52) 4.0008 (1.26) 713.5087 (1.52) 4.4792 (1.0) 2;0 1.4015 (0.66) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 3.4945 (2.35) 3.4945 (2.35) 3.4945 (2.35) 0.0000 (1.0) 3.4945 (2.35) 0.0000 (1.0) 0;0 0.2862 (0.43) 1 1
test_push-push[3.10.0] 1.9811 (1.33) 1.9811 (1.33) 1.9811 (1.33) 0.0000 (1.0) 1.9811 (1.33) 0.0000 (1.0) 0;0 0.5048 (0.75) 1 1
test_push-push[3.53.2] 1.5792 (1.06) 1.5792 (1.06) 1.5792 (1.06) 0.0000 (1.0) 1.5792 (1.06) 0.0000 (1.0) 0;0 0.6332 (0.94) 1 1
test_push-push[main] 1.4881 (1.0) 1.4881 (1.0) 1.4881 (1.0) 0.0000 (1.0) 1.4881 (1.0) 0.0000 (1.0) 0;0 0.6720 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2] 3.7090 (2.46) 3.7090 (2.46) 3.7090 (2.46) 0.0000 (1.0) 3.7090 (2.46) 0.0000 (1.0) 0;0 0.2696 (0.41) 1 1
test_sharing-add[3.10.0] 3.6433 (2.42) 3.6433 (2.42) 3.6433 (2.42) 0.0000 (1.0) 3.6433 (2.42) 0.0000 (1.0) 0;0 0.2745 (0.41) 1 1
test_sharing-add[3.53.2] 3.2024 (2.13) 3.2024 (2.13) 3.2024 (2.13) 0.0000 (1.0) 3.2024 (2.13) 0.0000 (1.0) 0;0 0.3123 (0.47) 1 1
test_sharing-add[main] 1.5064 (1.0) 1.5064 (1.0) 1.5064 (1.0) 0.0000 (1.0) 1.5064 (1.0) 0.0000 (1.0) 0;0 0.6638 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2] 2.5405 (3.77) 2.5405 (3.77) 2.5405 (3.77) 0.0000 (1.0) 2.5405 (3.77) 0.0000 (1.0) 0;0 0.3936 (0.27) 1 1
test_sharing-add-noop[3.10.0] 2.4539 (3.64) 2.4539 (3.64) 2.4539 (3.64) 0.0000 (1.0) 2.4539 (3.64) 0.0000 (1.0) 0;0 0.4075 (0.27) 1 1
test_sharing-add-noop[3.53.2] 2.2213 (3.30) 2.2213 (3.30) 2.2213 (3.30) 0.0000 (1.0) 2.2213 (3.30) 0.0000 (1.0) 0;0 0.4502 (0.30) 1 1
test_sharing-add-noop[main] 0.6740 (1.0) 0.6740 (1.0) 0.6740 (1.0) 0.0000 (1.0) 0.6740 (1.0) 0.0000 (1.0) 0;0 1.4837 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2] 1.8349 (1.60) 1.8349 (1.60) 1.8349 (1.60) 0.0000 (1.0) 1.8349 (1.60) 0.0000 (1.0) 0;0 0.5450 (0.62) 1 1
test_sharing-checkout[3.10.0] 3.6825 (3.22) 3.6825 (3.22) 3.6825 (3.22) 0.0000 (1.0) 3.6825 (3.22) 0.0000 (1.0) 0;0 0.2716 (0.31) 1 1
test_sharing-checkout[3.53.2] 1.3880 (1.21) 1.3880 (1.21) 1.3880 (1.21) 0.0000 (1.0) 1.3880 (1.21) 0.0000 (1.0) 0;0 0.7204 (0.83) 1 1
test_sharing-checkout[main] 1.1453 (1.0) 1.1453 (1.0) 1.1453 (1.0) 0.0000 (1.0) 1.1453 (1.0) 0.0000 (1.0) 0;0 0.8731 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2] 614.2035 (1.19) 614.2035 (1.19) 614.2035 (1.19) 0.0000 (1.0) 614.2035 (1.19) 0.0000 (1.0) 0;0 1.6281 (0.84) 1 1
test_sharing-checkout-noop[3.10.0] 600.5084 (1.17) 600.5084 (1.17) 600.5084 (1.17) 0.0000 (1.0) 600.5084 (1.17) 0.0000 (1.0) 0;0 1.6653 (0.86) 1 1
test_sharing-checkout-noop[3.53.2] 588.9225 (1.14) 588.9225 (1.14) 588.9225 (1.14) 0.0000 (1.0) 588.9225 (1.14) 0.0000 (1.0) 0;0 1.6980 (0.87) 1 1
test_sharing-checkout-noop[main] 514.9912 (1.0) 514.9912 (1.0) 514.9912 (1.0) 0.0000 (1.0) 514.9912 (1.0) 0.0000 (1.0) 0;0 1.9418 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 3.9336 (2.65) 3.9336 (2.65) 3.9336 (2.65) 0.0000 (1.0) 3.9336 (2.65) 0.0000 (1.0) 0;0 0.2542 (0.38) 1 1
test_sharing-fetch[3.10.0] 4.2359 (2.85) 4.2359 (2.85) 4.2359 (2.85) 0.0000 (1.0) 4.2359 (2.85) 0.0000 (1.0) 0;0 0.2361 (0.35) 1 1
test_sharing-fetch[3.53.2] 1.9413 (1.31) 1.9413 (1.31) 1.9413 (1.31) 0.0000 (1.0) 1.9413 (1.31) 0.0000 (1.0) 0;0 0.5151 (0.77) 1 1
test_sharing-fetch[main] 1.4866 (1.0) 1.4866 (1.0) 1.4866 (1.0) 0.0000 (1.0) 1.4866 (1.0) 0.0000 (1.0) 0;0 0.6727 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 471.2181 (1.0) 471.2181 (1.0) 471.2181 (1.0) 0.0000 (1.0) 471.2181 (1.0) 0.0000 (1.0) 0;0 2.1222 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 549.3064 (1.17) 549.3064 (1.17) 549.3064 (1.17) 0.0000 (1.0) 549.3064 (1.17) 0.0000 (1.0) 0;0 1.8205 (0.86) 1 1
test_sharing-fetch-noop[3.53.2] 825.3392 (1.75) 825.3392 (1.75) 825.3392 (1.75) 0.0000 (1.0) 825.3392 (1.75) 0.0000 (1.0) 0;0 1.2116 (0.57) 1 1
test_sharing-fetch-noop[main] 853.8452 (1.81) 853.8452 (1.81) 853.8452 (1.81) 0.0000 (1.0) 853.8452 (1.81) 0.0000 (1.0) 0;0 1.1712 (0.55) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 3.4098 (2.31) 3.4098 (2.31) 3.4098 (2.31) 0.0000 (1.0) 3.4098 (2.31) 0.0000 (1.0) 0;0 0.2933 (0.43) 1 1
test_sharing-push[3.10.0] 1.9197 (1.30) 1.9197 (1.30) 1.9197 (1.30) 0.0000 (1.0) 1.9197 (1.30) 0.0000 (1.0) 0;0 0.5209 (0.77) 1 1
test_sharing-push[3.53.2] 1.5245 (1.03) 1.5245 (1.03) 1.5245 (1.03) 0.0000 (1.0) 1.5245 (1.03) 0.0000 (1.0) 0;0 0.6560 (0.97) 1 1
test_sharing-push[main] 1.4790 (1.0) 1.4790 (1.0) 1.4790 (1.0) 0.0000 (1.0) 1.4790 (1.0) 0.0000 (1.0) 0;0 0.6761 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 496.6935 (1.0) 496.6935 (1.0) 496.6935 (1.0) 0.0000 (1.0) 496.6935 (1.0) 0.0000 (1.0) 0;0 2.0133 (1.0) 1 1
test_sharing-push-noop[3.10.0] 497.2026 (1.00) 497.2026 (1.00) 497.2026 (1.00) 0.0000 (1.0) 497.2026 (1.00) 0.0000 (1.0) 0;0 2.0113 (1.00) 1 1
test_sharing-push-noop[3.53.2] 864.2403 (1.74) 864.2403 (1.74) 864.2403 (1.74) 0.0000 (1.0) 864.2403 (1.74) 0.0000 (1.0) 0;0 1.1571 (0.57) 1 1
test_sharing-push-noop[main] 825.3742 (1.66) 825.3742 (1.66) 825.3742 (1.66) 0.0000 (1.0) 825.3742 (1.66) 0.0000 (1.0) 0;0 1.2116 (0.60) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.3448 (1.85) 1.3448 (1.85) 1.3448 (1.85) 0.0000 (1.0) 1.3448 (1.85) 0.0000 (1.0) 0;0 0.7436 (0.54) 1 1
test_status-status[3.10.0] 1.2729 (1.75) 1.2729 (1.75) 1.2729 (1.75) 0.0000 (1.0) 1.2729 (1.75) 0.0000 (1.0) 0;0 0.7856 (0.57) 1 1
test_status-status[3.53.2] 1.1725 (1.61) 1.1725 (1.61) 1.1725 (1.61) 0.0000 (1.0) 1.1725 (1.61) 0.0000 (1.0) 0;0 0.8529 (0.62) 1 1
test_status-status[main] 0.7270 (1.0) 0.7270 (1.0) 0.7270 (1.0) 0.0000 (1.0) 0.7270 (1.0) 0.0000 (1.0) 0;0 1.3755 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 606.3466 (1.26) 606.3466 (1.26) 606.3466 (1.26) 0.0000 (1.0) 606.3466 (1.26) 0.0000 (1.0) 0;0 1.6492 (0.79) 1 1
test_status-status-changed[3.10.0] 626.9314 (1.30) 626.9314 (1.30) 626.9314 (1.30) 0.0000 (1.0) 626.9314 (1.30) 0.0000 (1.0) 0;0 1.5951 (0.77) 1 1
test_status-status-changed[3.53.2] 624.8653 (1.30) 624.8653 (1.30) 624.8653 (1.30) 0.0000 (1.0) 624.8653 (1.30) 0.0000 (1.0) 0;0 1.6003 (0.77) 1 1
test_status-status-changed[main] 480.7209 (1.0) 480.7209 (1.0) 480.7209 (1.0) 0.0000 (1.0) 480.7209 (1.0) 0.0000 (1.0) 0;0 2.0802 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 616.3263 (1.22) 616.3263 (1.22) 616.3263 (1.22) 0.0000 (1.0) 616.3263 (1.22) 0.0000 (1.0) 0;0 1.6225 (0.82) 1 1
test_status-status-changed-noop[3.10.0] 615.7783 (1.22) 615.7783 (1.22) 615.7783 (1.22) 0.0000 (1.0) 615.7783 (1.22) 0.0000 (1.0) 0;0 1.6240 (0.82) 1 1
test_status-status-changed-noop[3.53.2] 597.8958 (1.19) 597.8958 (1.19) 597.8958 (1.19) 0.0000 (1.0) 597.8958 (1.19) 0.0000 (1.0) 0;0 1.6725 (0.84) 1 1
test_status-status-changed-noop[main] 504.3011 (1.0) 504.3011 (1.0) 504.3011 (1.0) 0.0000 (1.0) 504.3011 (1.0) 0.0000 (1.0) 0;0 1.9829 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 616.7750 (1.27) 616.7750 (1.27) 616.7750 (1.27) 0.0000 (1.0) 616.7750 (1.27) 0.0000 (1.0) 0;0 1.6213 (0.79) 1 1
test_status-status-noop[3.10.0] 606.5756 (1.25) 606.5756 (1.25) 606.5756 (1.25) 0.0000 (1.0) 606.5756 (1.25) 0.0000 (1.0) 0;0 1.6486 (0.80) 1 1
test_status-status-noop[3.53.2] 586.3176 (1.21) 586.3176 (1.21) 586.3176 (1.21) 0.0000 (1.0) 586.3176 (1.21) 0.0000 (1.0) 0;0 1.7056 (0.83) 1 1
test_status-status-noop[main] 484.8805 (1.0) 484.8805 (1.0) 484.8805 (1.0) 0.0000 (1.0) 484.8805 (1.0) 0.0000 (1.0) 0;0 2.0624 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 7.2286 (3.02) 7.2286 (3.02) 7.2286 (3.02) 0.0000 (1.0) 7.2286 (3.02) 0.0000 (1.0) 0;0 0.1383 (0.33) 1 1
test_update-import-url[3.10.0] 7.0917 (2.97) 7.0917 (2.97) 7.0917 (2.97) 0.0000 (1.0) 7.0917 (2.97) 0.0000 (1.0) 0;0 0.1410 (0.34) 1 1
test_update-import-url[3.53.2] 4.6844 (1.96) 4.6844 (1.96) 4.6844 (1.96) 0.0000 (1.0) 4.6844 (1.96) 0.0000 (1.0) 0;0 0.2135 (0.51) 1 1
test_update-import-url[main] 2.3906 (1.0) 2.3906 (1.0) 2.3906 (1.0) 0.0000 (1.0) 2.3906 (1.0) 0.0000 (1.0) 0;0 0.4183 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 6.4381 (3.75) 6.4381 (3.75) 6.4381 (3.75) 0.0000 (1.0) 6.4381 (3.75) 0.0000 (1.0) 0;0 0.1553 (0.27) 1 1
test_update-update[3.10.0] 6.3319 (3.69) 6.3319 (3.69) 6.3319 (3.69) 0.0000 (1.0) 6.3319 (3.69) 0.0000 (1.0) 0;0 0.1579 (0.27) 1 1
test_update-update[3.53.2] 3.9973 (2.33) 3.9973 (2.33) 3.9973 (2.33) 0.0000 (1.0) 3.9973 (2.33) 0.0000 (1.0) 0;0 0.2502 (0.43) 1 1
test_update-update[main] 1.7153 (1.0) 1.7153 (1.0) 1.7153 (1.0) 0.0000 (1.0) 1.7153 (1.0) 0.0000 (1.0) 0;0 0.5830 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 946.6073 (1.56) 946.6073 (1.56) 946.6073 (1.56) 0.0000 (1.0) 946.6073 (1.56) 0.0000 (1.0) 0;0 1.0564 (0.64) 1 1
test_update-update-noop[3.10.0] 936.2764 (1.54) 936.2764 (1.54) 936.2764 (1.54) 0.0000 (1.0) 936.2764 (1.54) 0.0000 (1.0) 0;0 1.0681 (0.65) 1 1
test_update-update-noop[3.53.2] 882.6814 (1.45) 882.6814 (1.45) 882.6814 (1.45) 0.0000 (1.0) 882.6814 (1.45) 0.0000 (1.0) 0;0 1.1329 (0.69) 1 1
test_update-update-noop[main] 608.7214 (1.0) 608.7214 (1.0) 608.7214 (1.0) 0.0000 (1.0) 608.7214 (1.0) 0.0000 (1.0) 0;0 1.6428 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
Bumps actions/cache from 3 to 4.
Release notes
Sourced from actions/cache's releases.
... (truncated)
Changelog
Sourced from actions/cache's changelog.
... (truncated)
Commits
0c45773Merge pull request #1327 from cdce8p/fix-fail-on-cache-miss8a55f83Add test case for process exit3884cacBump versione29dad3Fix fail-on-cache-miss not workingab5e6d0Merge pull request #1341 from bethanyj28/main89c7d86licensed cached2c84daupdate@actions/cache37e7d4eMerge pull request #1340 from actions/bethanyj28/update-publish-flowa18323fadd release actiona2ed59dMerge pull request #1305 from actions/yacaovsnc/update_examplesDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show