github-actions[bot]
commented
1 year ago
Tue Sep 5 09:35:20 UTC 2023
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 6.5731 (1.80) 6.5731 (1.80) 6.5731 (1.80) 0.0000 (1.0) 6.5731 (1.80) 0.0000 (1.0) 0;0 0.1521 (0.56) 1 1
test_add-add[2.40.0] 5.5532 (1.52) 5.5532 (1.52) 5.5532 (1.52) 0.0000 (1.0) 5.5532 (1.52) 0.0000 (1.0) 0;0 0.1801 (0.66) 1 1
test_add-add[2.58.2] 4.0878 (1.12) 4.0878 (1.12) 4.0878 (1.12) 0.0000 (1.0) 4.0878 (1.12) 0.0000 (1.0) 0;0 0.2446 (0.89) 1 1
test_add-add[3.0.0] 4.3847 (1.20) 4.3847 (1.20) 4.3847 (1.20) 0.0000 (1.0) 4.3847 (1.20) 0.0000 (1.0) 0;0 0.2281 (0.83) 1 1
test_add-add[main] 3.6581 (1.0) 3.6581 (1.0) 3.6581 (1.0) 0.0000 (1.0) 3.6581 (1.0) 0.0000 (1.0) 0;0 0.2734 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.40.0] 750.3097 (1.10) 750.3097 (1.10) 750.3097 (1.10) 0.0000 (1.0) 750.3097 (1.10) 0.0000 (1.0) 0;0 1.3328 (0.91) 1 1
test_data_status-data-changed[2.58.2] 1,058.5671 (1.56) 1,058.5671 (1.56) 1,058.5671 (1.56) 0.0000 (1.0) 1,058.5671 (1.56) 0.0000 (1.0) 0;0 0.9447 (0.64) 1 1
test_data_status-data-changed[3.0.0] 740.7426 (1.09) 740.7426 (1.09) 740.7426 (1.09) 0.0000 (1.0) 740.7426 (1.09) 0.0000 (1.0) 0;0 1.3500 (0.92) 1 1
test_data_status-data-changed[main] 680.7498 (1.0) 680.7498 (1.0) 680.7498 (1.0) 0.0000 (1.0) 680.7498 (1.0) 0.0000 (1.0) 0;0 1.4690 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.40.0] 745.8694 (1.10) 745.8694 (1.10) 745.8694 (1.10) 0.0000 (1.0) 745.8694 (1.10) 0.0000 (1.0) 0;0 1.3407 (0.91) 1 1
test_data_status-data-changed-noop[2.58.2] 719.0959 (1.06) 719.0959 (1.06) 719.0959 (1.06) 0.0000 (1.0) 719.0959 (1.06) 0.0000 (1.0) 0;0 1.3906 (0.94) 1 1
test_data_status-data-changed-noop[3.0.0] 733.5622 (1.08) 733.5622 (1.08) 733.5622 (1.08) 0.0000 (1.0) 733.5622 (1.08) 0.0000 (1.0) 0;0 1.3632 (0.92) 1 1
test_data_status-data-changed-noop[main] 677.3963 (1.0) 677.3963 (1.0) 677.3963 (1.0) 0.0000 (1.0) 677.3963 (1.0) 0.0000 (1.0) 0;0 1.4762 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.40.0] 1.6459 (1.11) 1.6459 (1.11) 1.6459 (1.11) 0.0000 (1.0) 1.6459 (1.11) 0.0000 (1.0) 0;0 0.6076 (0.90) 1 1
test_data_status-data-new[2.58.2] 1.5288 (1.03) 1.5288 (1.03) 1.5288 (1.03) 0.0000 (1.0) 1.5288 (1.03) 0.0000 (1.0) 0;0 0.6541 (0.97) 1 1
test_data_status-data-new[3.0.0] 1.5714 (1.06) 1.5714 (1.06) 1.5714 (1.06) 0.0000 (1.0) 1.5714 (1.06) 0.0000 (1.0) 0;0 0.6364 (0.95) 1 1
test_data_status-data-new[main] 1.4850 (1.0) 1.4850 (1.0) 1.4850 (1.0) 0.0000 (1.0) 1.4850 (1.0) 0.0000 (1.0) 0;0 0.6734 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.40.0] 731.6939 (1.07) 731.6939 (1.07) 731.6939 (1.07) 0.0000 (1.0) 731.6939 (1.07) 0.0000 (1.0) 0;0 1.3667 (0.94) 1 1
test_data_status-data-noop[2.58.2] 720.6534 (1.05) 720.6534 (1.05) 720.6534 (1.05) 0.0000 (1.0) 720.6534 (1.05) 0.0000 (1.0) 0;0 1.3876 (0.95) 1 1
test_data_status-data-noop[3.0.0] 737.0076 (1.07) 737.0076 (1.07) 737.0076 (1.07) 0.0000 (1.0) 737.0076 (1.07) 0.0000 (1.0) 0;0 1.3568 (0.93) 1 1
test_data_status-data-noop[main] 685.9335 (1.0) 685.9335 (1.0) 685.9335 (1.0) 0.0000 (1.0) 685.9335 (1.0) 0.0000 (1.0) 0;0 1.4579 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 5.0867 (1.30) 5.0867 (1.30) 5.0867 (1.30) 0.0000 (1.0) 5.0867 (1.30) 0.0000 (1.0) 0;0 0.1966 (0.77) 1 1
test_get-get[2.40.0] 3.8997 (1.0) 3.8997 (1.0) 3.8997 (1.0) 0.0000 (1.0) 3.8997 (1.0) 0.0000 (1.0) 0;0 0.2564 (1.0) 1 1
test_get-get[2.58.2] 6.1699 (1.58) 6.1699 (1.58) 6.1699 (1.58) 0.0000 (1.0) 6.1699 (1.58) 0.0000 (1.0) 0;0 0.1621 (0.63) 1 1
test_get-get[3.0.0] 6.1241 (1.57) 6.1241 (1.57) 6.1241 (1.57) 0.0000 (1.0) 6.1241 (1.57) 0.0000 (1.0) 0;0 0.1633 (0.64) 1 1
test_get-get[main] 6.8771 (1.76) 6.8771 (1.76) 6.8771 (1.76) 0.0000 (1.0) 6.8771 (1.76) 0.0000 (1.0) 0;0 0.1454 (0.57) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 2.9293 (1.55) 2.9293 (1.55) 2.9293 (1.55) 0.0000 (1.0) 2.9293 (1.55) 0.0000 (1.0) 0;0 0.3414 (0.64) 1 1
test_checkout_copy-checkout[2.40.0] 3.4824 (1.85) 3.4824 (1.85) 3.4824 (1.85) 0.0000 (1.0) 3.4824 (1.85) 0.0000 (1.0) 0;0 0.2872 (0.54) 1 1
test_checkout_copy-checkout[2.58.2] 1.8841 (1.0) 1.8841 (1.0) 1.8841 (1.0) 0.0000 (1.0) 1.8841 (1.0) 0.0000 (1.0) 0;0 0.5308 (1.0) 1 1
test_checkout_copy-checkout[3.0.0] 3.6752 (1.95) 3.6752 (1.95) 3.6752 (1.95) 0.0000 (1.0) 3.6752 (1.95) 0.0000 (1.0) 0;0 0.2721 (0.51) 1 1
test_checkout_copy-checkout[main] 3.6072 (1.91) 3.6072 (1.91) 3.6072 (1.91) 0.0000 (1.0) 3.6072 (1.91) 0.0000 (1.0) 0;0 0.2772 (0.52) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 480.7895 (1.0) 480.7895 (1.0) 480.7895 (1.0) 0.0000 (1.0) 480.7895 (1.0) 0.0000 (1.0) 0;0 2.0799 (1.0) 1 1
test_checkout_copy-checkout-noop[2.40.0] 564.5384 (1.17) 564.5384 (1.17) 564.5384 (1.17) 0.0000 (1.0) 564.5384 (1.17) 0.0000 (1.0) 0;0 1.7714 (0.85) 1 1
test_checkout_copy-checkout-noop[2.58.2] 627.2033 (1.30) 627.2033 (1.30) 627.2033 (1.30) 0.0000 (1.0) 627.2033 (1.30) 0.0000 (1.0) 0;0 1.5944 (0.77) 1 1
test_checkout_copy-checkout-noop[3.0.0] 657.3006 (1.37) 657.3006 (1.37) 657.3006 (1.37) 0.0000 (1.0) 657.3006 (1.37) 0.0000 (1.0) 0;0 1.5214 (0.73) 1 1
test_checkout_copy-checkout-noop[main] 655.1899 (1.36) 655.1899 (1.36) 655.1899 (1.36) 0.0000 (1.0) 655.1899 (1.36) 0.0000 (1.0) 0;0 1.5263 (0.73) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.2024 (1.88) 1.2024 (1.88) 1.2024 (1.88) 0.0000 (1.0) 1.2024 (1.88) 0.0000 (1.0) 0;0 0.8316 (0.53) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.6382 (1.0) 0.6382 (1.0) 0.6382 (1.0) 0.0000 (1.0) 0.6382 (1.0) 0.0000 (1.0) 0;0 1.5669 (1.0) 1 1
test_checkout_copy-checkout-update[2.58.2] 1.2910 (2.02) 1.2910 (2.02) 1.2910 (2.02) 0.0000 (1.0) 1.2910 (2.02) 0.0000 (1.0) 0;0 0.7746 (0.49) 1 1
test_checkout_copy-checkout-update[3.0.0] 0.7240 (1.13) 0.7240 (1.13) 0.7240 (1.13) 0.0000 (1.0) 0.7240 (1.13) 0.0000 (1.0) 0;0 1.3813 (0.88) 1 1
test_checkout_copy-checkout-update[main] 0.7243 (1.13) 0.7243 (1.13) 0.7243 (1.13) 0.0000 (1.0) 0.7243 (1.13) 0.0000 (1.0) 0;0 1.3806 (0.88) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 470.0704 (1.0) 470.0704 (1.0) 470.0704 (1.0) 0.0000 (1.0) 470.0704 (1.0) 0.0000 (1.0) 0;0 2.1273 (1.0) 1 1
test_gc-gc[2.40.0] 512.1836 (1.09) 512.1836 (1.09) 512.1836 (1.09) 0.0000 (1.0) 512.1836 (1.09) 0.0000 (1.0) 0;0 1.9524 (0.92) 1 1
test_gc-gc[2.58.2] 584.1706 (1.24) 584.1706 (1.24) 584.1706 (1.24) 0.0000 (1.0) 584.1706 (1.24) 0.0000 (1.0) 0;0 1.7118 (0.80) 1 1
test_gc-gc[3.0.0] 559.1403 (1.19) 559.1403 (1.19) 559.1403 (1.19) 0.0000 (1.0) 559.1403 (1.19) 0.0000 (1.0) 0;0 1.7885 (0.84) 1 1
test_gc-gc[main] 558.5714 (1.19) 558.5714 (1.19) 558.5714 (1.19) 0.0000 (1.0) 558.5714 (1.19) 0.0000 (1.0) 0;0 1.7903 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 1.4553 (1.12) 1.4553 (1.12) 1.4553 (1.12) 0.0000 (1.0) 1.4553 (1.12) 0.0000 (1.0) 0;0 0.6872 (0.89) 1 1
test_checkout_symlink-checkout[2.40.0] 1.3958 (1.08) 1.3958 (1.08) 1.3958 (1.08) 0.0000 (1.0) 1.3958 (1.08) 0.0000 (1.0) 0;0 0.7164 (0.93) 1 1
test_checkout_symlink-checkout[2.58.2] 1.9371 (1.49) 1.9371 (1.49) 1.9371 (1.49) 0.0000 (1.0) 1.9371 (1.49) 0.0000 (1.0) 0;0 0.5162 (0.67) 1 1
test_checkout_symlink-checkout[3.0.0] 1.8798 (1.45) 1.8798 (1.45) 1.8798 (1.45) 0.0000 (1.0) 1.8798 (1.45) 0.0000 (1.0) 0;0 0.5320 (0.69) 1 1
test_checkout_symlink-checkout[main] 1.2976 (1.0) 1.2976 (1.0) 1.2976 (1.0) 0.0000 (1.0) 1.2976 (1.0) 0.0000 (1.0) 0;0 0.7707 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 540.7019 (1.0) 540.7019 (1.0) 540.7019 (1.0) 0.0000 (1.0) 540.7019 (1.0) 0.0000 (1.0) 0;0 1.8494 (1.0) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 614.9670 (1.14) 614.9670 (1.14) 614.9670 (1.14) 0.0000 (1.0) 614.9670 (1.14) 0.0000 (1.0) 0;0 1.6261 (0.88) 1 1
test_checkout_symlink-checkout-noop[2.58.2] 709.3263 (1.31) 709.3263 (1.31) 709.3263 (1.31) 0.0000 (1.0) 709.3263 (1.31) 0.0000 (1.0) 0;0 1.4098 (0.76) 1 1
test_checkout_symlink-checkout-noop[3.0.0] 730.4136 (1.35) 730.4136 (1.35) 730.4136 (1.35) 0.0000 (1.0) 730.4136 (1.35) 0.0000 (1.0) 0;0 1.3691 (0.74) 1 1
test_checkout_symlink-checkout-noop[main] 713.8438 (1.32) 713.8438 (1.32) 713.8438 (1.32) 0.0000 (1.0) 713.8438 (1.32) 0.0000 (1.0) 0;0 1.4009 (0.76) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 1.5136 (2.06) 1.5136 (2.06) 1.5136 (2.06) 0.0000 (1.0) 1.5136 (2.06) 0.0000 (1.0) 0;0 0.6607 (0.49) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.7354 (1.0) 0.7354 (1.0) 0.7354 (1.0) 0.0000 (1.0) 0.7354 (1.0) 0.0000 (1.0) 0;0 1.3598 (1.0) 1 1
test_checkout_symlink-checkout-update[2.58.2] 0.9317 (1.27) 0.9317 (1.27) 0.9317 (1.27) 0.0000 (1.0) 0.9317 (1.27) 0.0000 (1.0) 0;0 1.0733 (0.79) 1 1
test_checkout_symlink-checkout-update[3.0.0] 0.8581 (1.17) 0.8581 (1.17) 0.8581 (1.17) 0.0000 (1.0) 0.8581 (1.17) 0.0000 (1.0) 0;0 1.1654 (0.86) 1 1
test_checkout_symlink-checkout-update[main] 0.8143 (1.11) 0.8143 (1.11) 0.8143 (1.11) 0.0000 (1.0) 0.8143 (1.11) 0.0000 (1.0) 0;0 1.2281 (0.90) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_pull-pull': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 9.9277 (1.33) 9.9277 (1.33) 9.9277 (1.33) 0.0000 (1.0) 9.9277 (1.33) 0.0000 (1.0) 0;0 0.1007 (0.75) 1 1
test_pull-pull[2.40.0] 11.3011 (1.52) 11.3011 (1.52) 11.3011 (1.52) 0.0000 (1.0) 11.3011 (1.52) 0.0000 (1.0) 0;0 0.0885 (0.66) 1 1
test_pull-pull[2.58.2] 7.4436 (1.0) 7.4436 (1.0) 7.4436 (1.0) 0.0000 (1.0) 7.4436 (1.0) 0.0000 (1.0) 0;0 0.1343 (1.0) 1 1
test_pull-pull[3.0.0] 10.8233 (1.45) 10.8233 (1.45) 10.8233 (1.45) 0.0000 (1.0) 10.8233 (1.45) 0.0000 (1.0) 0;0 0.0924 (0.69) 1 1
test_pull-pull[main] 10.3892 (1.40) 10.3892 (1.40) 10.3892 (1.40) 0.0000 (1.0) 10.3892 (1.40) 0.0000 (1.0) 0;0 0.0963 (0.72) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_sharing-add': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 10.4598 (1.81) 10.4598 (1.81) 10.4598 (1.81) 0.0000 (1.0) 10.4598 (1.81) 0.0000 (1.0) 0;0 0.0956 (0.55) 1 1
test_sharing-add[2.40.0] 8.7639 (1.52) 8.7639 (1.52) 8.7639 (1.52) 0.0000 (1.0) 8.7639 (1.52) 0.0000 (1.0) 0;0 0.1141 (0.66) 1 1
test_sharing-add[2.58.2] 5.9305 (1.03) 5.9305 (1.03) 5.9305 (1.03) 0.0000 (1.0) 5.9305 (1.03) 0.0000 (1.0) 0;0 0.1686 (0.97) 1 1
test_sharing-add[3.0.0] 5.7801 (1.0) 5.7801 (1.0) 5.7801 (1.0) 0.0000 (1.0) 5.7801 (1.0) 0.0000 (1.0) 0;0 0.1730 (1.0) 1 1
test_sharing-add[main] 5.9902 (1.04) 5.9902 (1.04) 5.9902 (1.04) 0.0000 (1.0) 5.9902 (1.04) 0.0000 (1.0) 0;0 0.1669 (0.96) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 4.8493 (1.35) 4.8493 (1.35) 4.8493 (1.35) 0.0000 (1.0) 4.8493 (1.35) 0.0000 (1.0) 0;0 0.2062 (0.74) 1 1
test_sharing-add-noop[2.40.0] 3.5886 (1.0) 3.5886 (1.0) 3.5886 (1.0) 0.0000 (1.0) 3.5886 (1.0) 0.0000 (1.0) 0;0 0.2787 (1.0) 1 1
test_sharing-add-noop[2.58.2] 3.8122 (1.06) 3.8122 (1.06) 3.8122 (1.06) 0.0000 (1.0) 3.8122 (1.06) 0.0000 (1.0) 0;0 0.2623 (0.94) 1 1
test_sharing-add-noop[3.0.0] 4.0149 (1.12) 4.0149 (1.12) 4.0149 (1.12) 0.0000 (1.0) 4.0149 (1.12) 0.0000 (1.0) 0;0 0.2491 (0.89) 1 1
test_sharing-add-noop[main] 3.9623 (1.10) 3.9623 (1.10) 3.9623 (1.10) 0.0000 (1.0) 3.9623 (1.10) 0.0000 (1.0) 0;0 0.2524 (0.91) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 658.4671 (1.0) 658.4671 (1.0) 658.4671 (1.0) 0.0000 (1.0) 658.4671 (1.0) 0.0000 (1.0) 0;0 1.5187 (1.0) 1 1
test_sharing-checkout-noop[2.40.0] 846.0628 (1.28) 846.0628 (1.28) 846.0628 (1.28) 0.0000 (1.0) 846.0628 (1.28) 0.0000 (1.0) 0;0 1.1819 (0.78) 1 1
test_sharing-checkout-noop[2.58.2] 943.0980 (1.43) 943.0980 (1.43) 943.0980 (1.43) 0.0000 (1.0) 943.0980 (1.43) 0.0000 (1.0) 0;0 1.0603 (0.70) 1 1
test_sharing-checkout-noop[3.0.0] 982.6426 (1.49) 982.6426 (1.49) 982.6426 (1.49) 0.0000 (1.0) 982.6426 (1.49) 0.0000 (1.0) 0;0 1.0177 (0.67) 1 1
test_sharing-checkout-noop[main] 966.4334 (1.47) 966.4334 (1.47) 966.4334 (1.47) 0.0000 (1.0) 966.4334 (1.47) 0.0000 (1.0) 0;0 1.0347 (0.68) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing-pull': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 10.5941 (1.32) 10.5941 (1.32) 10.5941 (1.32) 0.0000 (1.0) 10.5941 (1.32) 0.0000 (1.0) 0;0 0.0944 (0.76) 1 1
test_sharing-pull[2.40.0] 12.9295 (1.61) 12.9295 (1.61) 12.9295 (1.61) 0.0000 (1.0) 12.9295 (1.61) 0.0000 (1.0) 0;0 0.0773 (0.62) 1 1
test_sharing-pull[2.58.2] 8.0248 (1.0) 8.0248 (1.0) 8.0248 (1.0) 0.0000 (1.0) 8.0248 (1.0) 0.0000 (1.0) 0;0 0.1246 (1.0) 1 1
test_sharing-pull[3.0.0] 11.5372 (1.44) 11.5372 (1.44) 11.5372 (1.44) 0.0000 (1.0) 11.5372 (1.44) 0.0000 (1.0) 0;0 0.0867 (0.70) 1 1
test_sharing-pull[main] 11.5271 (1.44) 11.5271 (1.44) 11.5271 (1.44) 0.0000 (1.0) 11.5271 (1.44) 0.0000 (1.0) 0;0 0.0868 (0.70) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 723.3362 (1.0) 723.3362 (1.0) 723.3362 (1.0) 0.0000 (1.0) 723.3362 (1.0) 0.0000 (1.0) 0;0 1.3825 (1.0) 1 1
test_sharing-pull-noop[2.40.0] 904.7312 (1.25) 904.7312 (1.25) 904.7312 (1.25) 0.0000 (1.0) 904.7312 (1.25) 0.0000 (1.0) 0;0 1.1053 (0.80) 1 1
test_sharing-pull-noop[2.58.2] 1,001.3033 (1.38) 1,001.3033 (1.38) 1,001.3033 (1.38) 0.0000 (1.0) 1,001.3033 (1.38) 0.0000 (1.0) 0;0 0.9987 (0.72) 1 1
test_sharing-pull-noop[3.0.0] 1,177.5162 (1.63) 1,177.5162 (1.63) 1,177.5162 (1.63) 0.0000 (1.0) 1,177.5162 (1.63) 0.0000 (1.0) 0;0 0.8492 (0.61) 1 1
test_sharing-pull-noop[main] 1,168.2392 (1.62) 1,168.2392 (1.62) 1,168.2392 (1.62) 0.0000 (1.0) 1,168.2392 (1.62) 0.0000 (1.0) 0;0 0.8560 (0.62) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 5.8336 (2.22) 5.8336 (2.22) 5.8336 (2.22) 0.0000 (1.0) 5.8336 (2.22) 0.0000 (1.0) 0;0 0.1714 (0.45) 1 1
test_sharing-push[2.40.0] 7.7863 (2.96) 7.7863 (2.96) 7.7863 (2.96) 0.0000 (1.0) 7.7863 (2.96) 0.0000 (1.0) 0;0 0.1284 (0.34) 1 1
test_sharing-push[2.58.2] 5.0343 (1.92) 5.0343 (1.92) 5.0343 (1.92) 0.0000 (1.0) 5.0343 (1.92) 0.0000 (1.0) 0;0 0.1986 (0.52) 1 1
test_sharing-push[3.0.0] 2.6288 (1.0) 2.6288 (1.0) 2.6288 (1.0) 0.0000 (1.0) 2.6288 (1.0) 0.0000 (1.0) 0;0 0.3804 (1.0) 1 1
test_sharing-push[main] 5.1137 (1.95) 5.1137 (1.95) 5.1137 (1.95) 0.0000 (1.0) 5.1137 (1.95) 0.0000 (1.0) 0;0 0.1956 (0.51) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 578.2661 (1.0) 578.2661 (1.0) 578.2661 (1.0) 0.0000 (1.0) 578.2661 (1.0) 0.0000 (1.0) 0;0 1.7293 (1.0) 1 1
test_sharing-push-noop[2.40.0] 701.0706 (1.21) 701.0706 (1.21) 701.0706 (1.21) 0.0000 (1.0) 701.0706 (1.21) 0.0000 (1.0) 0;0 1.4264 (0.82) 1 1
test_sharing-push-noop[2.58.2] 708.8312 (1.23) 708.8312 (1.23) 708.8312 (1.23) 0.0000 (1.0) 708.8312 (1.23) 0.0000 (1.0) 0;0 1.4108 (0.82) 1 1
test_sharing-push-noop[3.0.0] 719.3428 (1.24) 719.3428 (1.24) 719.3428 (1.24) 0.0000 (1.0) 719.3428 (1.24) 0.0000 (1.0) 0;0 1.3902 (0.80) 1 1
test_sharing-push-noop[main] 741.8874 (1.28) 741.8874 (1.28) 741.8874 (1.28) 0.0000 (1.0) 741.8874 (1.28) 0.0000 (1.0) 0;0 1.3479 (0.78) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 1.8170 (1.21) 1.8170 (1.21) 1.8170 (1.21) 0.0000 (1.0) 1.8170 (1.21) 0.0000 (1.0) 0;0 0.5504 (0.83) 1 1
test_diff-diff[2.40.0] 1.5832 (1.05) 1.5832 (1.05) 1.5832 (1.05) 0.0000 (1.0) 1.5832 (1.05) 0.0000 (1.0) 0;0 0.6316 (0.95) 1 1
test_diff-diff[2.58.2] 1.5078 (1.0) 1.5078 (1.0) 1.5078 (1.0) 0.0000 (1.0) 1.5078 (1.0) 0.0000 (1.0) 0;0 0.6632 (1.0) 1 1
test_diff-diff[3.0.0] 1.7407 (1.15) 1.7407 (1.15) 1.7407 (1.15) 0.0000 (1.0) 1.7407 (1.15) 0.0000 (1.0) 0;0 0.5745 (0.87) 1 1
test_diff-diff[main] 1.5460 (1.03) 1.5460 (1.03) 1.5460 (1.03) 0.0000 (1.0) 1.5460 (1.03) 0.0000 (1.0) 0;0 0.6468 (0.98) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.2187 (1.68) 1.2187 (1.68) 1.2187 (1.68) 0.0000 (1.0) 1.2187 (1.68) 0.0000 (1.0) 0;0 0.8205 (0.59) 1 1
test_diff-diff-changed[2.40.0] 0.7239 (1.0) 0.7239 (1.0) 0.7239 (1.0) 0.0000 (1.0) 0.7239 (1.0) 0.0000 (1.0) 0;0 1.3814 (1.0) 1 1
test_diff-diff-changed[2.58.2] 0.7999 (1.10) 0.7999 (1.10) 0.7999 (1.10) 0.0000 (1.0) 0.7999 (1.10) 0.0000 (1.0) 0;0 1.2501 (0.91) 1 1
test_diff-diff-changed[3.0.0] 0.8487 (1.17) 0.8487 (1.17) 0.8487 (1.17) 0.0000 (1.0) 0.8487 (1.17) 0.0000 (1.0) 0;0 1.1783 (0.85) 1 1
test_diff-diff-changed[main] 0.8193 (1.13) 0.8193 (1.13) 0.8193 (1.13) 0.0000 (1.0) 0.8193 (1.13) 0.0000 (1.0) 0;0 1.2206 (0.88) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 531.9169 (1.0) 531.9169 (1.0) 531.9169 (1.0) 0.0000 (1.0) 531.9169 (1.0) 0.0000 (1.0) 0;0 1.8800 (1.0) 1 1
test_diff-diff-changed-noop[2.40.0] 730.1560 (1.37) 730.1560 (1.37) 730.1560 (1.37) 0.0000 (1.0) 730.1560 (1.37) 0.0000 (1.0) 0;0 1.3696 (0.73) 1 1
test_diff-diff-changed-noop[2.58.2] 770.9219 (1.45) 770.9219 (1.45) 770.9219 (1.45) 0.0000 (1.0) 770.9219 (1.45) 0.0000 (1.0) 0;0 1.2971 (0.69) 1 1
test_diff-diff-changed-noop[3.0.0] 785.7900 (1.48) 785.7900 (1.48) 785.7900 (1.48) 0.0000 (1.0) 785.7900 (1.48) 0.0000 (1.0) 0;0 1.2726 (0.68) 1 1
test_diff-diff-changed-noop[main] 767.0805 (1.44) 767.0805 (1.44) 767.0805 (1.44) 0.0000 (1.0) 767.0805 (1.44) 0.0000 (1.0) 0;0 1.3036 (0.69) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 485.6711 (1.0) 485.6711 (1.0) 485.6711 (1.0) 0.0000 (1.0) 485.6711 (1.0) 0.0000 (1.0) 0;0 2.0590 (1.0) 1 1
test_diff-diff-noop[2.40.0] 686.5076 (1.41) 686.5076 (1.41) 686.5076 (1.41) 0.0000 (1.0) 686.5076 (1.41) 0.0000 (1.0) 0;0 1.4566 (0.71) 1 1
test_diff-diff-noop[2.58.2] 707.3552 (1.46) 707.3552 (1.46) 707.3552 (1.46) 0.0000 (1.0) 707.3552 (1.46) 0.0000 (1.0) 0;0 1.4137 (0.69) 1 1
test_diff-diff-noop[3.0.0] 729.3017 (1.50) 729.3017 (1.50) 729.3017 (1.50) 0.0000 (1.0) 729.3017 (1.50) 0.0000 (1.0) 0;0 1.3712 (0.67) 1 1
test_diff-diff-noop[main] 715.2906 (1.47) 715.2906 (1.47) 715.2906 (1.47) 0.0000 (1.0) 715.2906 (1.47) 0.0000 (1.0) 0;0 1.3980 (0.68) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 13.5337 (1.41) 13.5337 (1.41) 13.5337 (1.41) 0.0000 (1.0) 13.5337 (1.41) 0.0000 (1.0) 0;0 0.0739 (0.71) 1 1
test_import_url-import-url[2.40.0] 11.7479 (1.22) 11.7479 (1.22) 11.7479 (1.22) 0.0000 (1.0) 11.7479 (1.22) 0.0000 (1.0) 0;0 0.0851 (0.82) 1 1
test_import_url-import-url[2.58.2] 9.6848 (1.01) 9.6848 (1.01) 9.6848 (1.01) 0.0000 (1.0) 9.6848 (1.01) 0.0000 (1.0) 0;0 0.1033 (0.99) 1 1
test_import_url-import-url[3.0.0] 9.6286 (1.0) 9.6286 (1.0) 9.6286 (1.0) 0.0000 (1.0) 9.6286 (1.0) 0.0000 (1.0) 0;0 0.1039 (1.0) 1 1
test_import_url-import-url[main] 9.6774 (1.01) 9.6774 (1.01) 9.6774 (1.01) 0.0000 (1.0) 9.6774 (1.01) 0.0000 (1.0) 0;0 0.1033 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.40.0] 544.6908 (1.04) 565.8289 (1.07) 550.3352 (1.04) 8.7715 (4.39) 546.6336 (1.04) 7.1945 (2.10) 1;1 1.8171 (0.96) 5 3
test_plots-plots-diff[2.58.2] 524.2754 (1.0) 528.9310 (1.0) 526.7917 (1.0) 1.9997 (1.0) 526.8558 (1.0) 3.5436 (1.03) 2;0 1.8983 (1.0) 5 3
test_plots-plots-diff[3.0.0] 961.4204 (1.83) 968.0988 (1.83) 965.1292 (1.83) 2.5257 (1.26) 965.2715 (1.83) 3.4264 (1.0) 2;0 1.0361 (0.55) 5 3
test_plots-plots-diff[main] 983.0634 (1.88) 991.6901 (1.87) 987.2967 (1.87) 3.7142 (1.86) 988.9302 (1.88) 6.0799 (1.77) 2;0 1.0129 (0.53) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.40.0] 582.1732 (1.08) 635.6577 (1.14) 596.4157 (1.09) 22.2146 (8.18) 589.0573 (1.09) 18.2811 (3.56) 1;1 1.6767 (0.91) 5 3
test_plots-plots-diff-json[2.58.2] 538.5884 (1.0) 556.5571 (1.0) 545.0996 (1.0) 6.8717 (2.53) 542.7697 (1.0) 7.1665 (1.40) 1;0 1.8345 (1.0) 5 3
test_plots-plots-diff-json[3.0.0] 1,342.9615 (2.49) 1,366.1227 (2.45) 1,351.5970 (2.48) 9.4296 (3.47) 1,352.4042 (2.49) 13.0632 (2.55) 1;0 0.7399 (0.40) 5 3
test_plots-plots-diff-json[main] 1,390.9498 (2.58) 1,396.7396 (2.51) 1,394.2018 (2.56) 2.7162 (1.0) 1,394.8547 (2.57) 5.1320 (1.0) 1;0 0.7173 (0.39) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.40.0] 418.1951 (1.0) 429.2175 (1.0) 425.2790 (1.0) 4.5121 (1.0) 425.9798 (1.0) 6.4698 (1.0) 1;0 2.3514 (1.0) 5 3
test_plots-plots-show[2.58.2] 484.4690 (1.16) 498.1538 (1.16) 491.3449 (1.16) 5.1533 (1.14) 489.9599 (1.15) 6.7098 (1.04) 2;0 2.0352 (0.87) 5 3
test_plots-plots-show[3.0.0] 799.7635 (1.91) 817.2251 (1.90) 807.1673 (1.90) 7.3921 (1.64) 805.1261 (1.89) 12.4599 (1.93) 2;0 1.2389 (0.53) 5 3
test_plots-plots-show[main] 788.0136 (1.88) 805.3573 (1.88) 797.0477 (1.87) 6.5118 (1.44) 797.0011 (1.87) 8.9164 (1.38) 2;0 1.2546 (0.53) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.40.0] 466.6222 (1.0) 494.9630 (1.0) 481.9403 (1.0) 10.9016 (2.15) 481.9682 (1.0) 15.8682 (1.78) 2;0 2.0749 (1.0) 5 3
test_plots-plots-show-json[2.58.2] 501.6546 (1.08) 512.9618 (1.04) 506.4270 (1.05) 5.0613 (1.0) 504.3640 (1.05) 8.8910 (1.0) 1;0 1.9746 (0.95) 5 3
test_plots-plots-show-json[3.0.0] 1,000.2638 (2.14) 1,030.7071 (2.08) 1,009.5346 (2.09) 12.3343 (2.44) 1,007.5452 (2.09) 12.4981 (1.41) 1;0 0.9906 (0.48) 5 3
test_plots-plots-show-json[main] 1,000.4737 (2.14) 1,014.5882 (2.05) 1,007.6511 (2.09) 5.8244 (1.15) 1,009.8242 (2.10) 9.2859 (1.04) 2;0 0.9924 (0.48) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.11.0] 7.1525 (1.76) 7.1525 (1.76) 7.1525 (1.76) 0.0000 (1.0) 7.1525 (1.76) 0.0000 (1.0) 0;0 0.1398 (0.57) 1 1
test_sharing_gs-add[2.11.0] 7.5701 (1.86) 7.5701 (1.86) 7.5701 (1.86) 0.0000 (1.0) 7.5701 (1.86) 0.0000 (1.0) 0;0 0.1321 (0.54) 1 1
test_sharing_gs-add[2.40.0] 5.9700 (1.46) 5.9700 (1.46) 5.9700 (1.46) 0.0000 (1.0) 5.9700 (1.46) 0.0000 (1.0) 0;0 0.1675 (0.68) 1 1
test_sharing_gs-add[2.40.0] 6.0207 (1.48) 6.0207 (1.48) 6.0207 (1.48) 0.0000 (1.0) 6.0207 (1.48) 0.0000 (1.0) 0;0 0.1661 (0.68) 1 1
test_sharing_gs-add[2.58.2] 4.1633 (1.02) 4.1633 (1.02) 4.1633 (1.02) 0.0000 (1.0) 4.1633 (1.02) 0.0000 (1.0) 0;0 0.2402 (0.98) 1 1
test_sharing_gs-add[2.58.2] 4.1289 (1.01) 4.1289 (1.01) 4.1289 (1.01) 0.0000 (1.0) 4.1289 (1.01) 0.0000 (1.0) 0;0 0.2422 (0.99) 1 1
test_sharing_gs-add[3.0.0] 4.1006 (1.01) 4.1006 (1.01) 4.1006 (1.01) 0.0000 (1.0) 4.1006 (1.01) 0.0000 (1.0) 0;0 0.2439 (0.99) 1 1
test_sharing_gs-add[3.0.0] 4.1187 (1.01) 4.1187 (1.01) 4.1187 (1.01) 0.0000 (1.0) 4.1187 (1.01) 0.0000 (1.0) 0;0 0.2428 (0.99) 1 1
test_sharing_gs-add[main] 4.0752 (1.0) 4.0752 (1.0) 4.0752 (1.0) 0.0000 (1.0) 4.0752 (1.0) 0.0000 (1.0) 0;0 0.2454 (1.0) 1 1
test_sharing_gs-add[main] 4.1643 (1.02) 4.1643 (1.02) 4.1643 (1.02) 0.0000 (1.0) 4.1643 (1.02) 0.0000 (1.0) 0;0 0.2401 (0.98) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.11.0] 3.5617 (1.42) 3.5617 (1.42) 3.5617 (1.42) 0.0000 (1.0) 3.5617 (1.42) 0.0000 (1.0) 0;0 0.2808 (0.70) 1 1
test_sharing_gs-add-noop[2.11.0] 3.5169 (1.41) 3.5169 (1.41) 3.5169 (1.41) 0.0000 (1.0) 3.5169 (1.41) 0.0000 (1.0) 0;0 0.2843 (0.71) 1 1
test_sharing_gs-add-noop[2.40.0] 2.5501 (1.02) 2.5501 (1.02) 2.5501 (1.02) 0.0000 (1.0) 2.5501 (1.02) 0.0000 (1.0) 0;0 0.3921 (0.98) 1 1
test_sharing_gs-add-noop[2.40.0] 2.5017 (1.0) 2.5017 (1.0) 2.5017 (1.0) 0.0000 (1.0) 2.5017 (1.0) 0.0000 (1.0) 0;0 0.3997 (1.0) 1 1
test_sharing_gs-add-noop[2.58.2] 2.7470 (1.10) 2.7470 (1.10) 2.7470 (1.10) 0.0000 (1.0) 2.7470 (1.10) 0.0000 (1.0) 0;0 0.3640 (0.91) 1 1
test_sharing_gs-add-noop[2.58.2] 2.7264 (1.09) 2.7264 (1.09) 2.7264 (1.09) 0.0000 (1.0) 2.7264 (1.09) 0.0000 (1.0) 0;0 0.3668 (0.92) 1 1
test_sharing_gs-add-noop[3.0.0] 2.7435 (1.10) 2.7435 (1.10) 2.7435 (1.10) 0.0000 (1.0) 2.7435 (1.10) 0.0000 (1.0) 0;0 0.3645 (0.91) 1 1
test_sharing_gs-add-noop[3.0.0] 2.7125 (1.08) 2.7125 (1.08) 2.7125 (1.08) 0.0000 (1.0) 2.7125 (1.08) 0.0000 (1.0) 0;0 0.3687 (0.92) 1 1
test_sharing_gs-add-noop[main] 2.7153 (1.09) 2.7153 (1.09) 2.7153 (1.09) 0.0000 (1.0) 2.7153 (1.09) 0.0000 (1.0) 0;0 0.3683 (0.92) 1 1
test_sharing_gs-add-noop[main] 2.7278 (1.09) 2.7278 (1.09) 2.7278 (1.09) 0.0000 (1.0) 2.7278 (1.09) 0.0000 (1.0) 0;0 0.3666 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.11.0] 518.1023 (1.0) 518.1023 (1.0) 518.1023 (1.0) 0.0000 (1.0) 518.1023 (1.0) 0.0000 (1.0) 0;0 1.9301 (1.0) 1 1
test_sharing_gs-checkout-noop[2.11.0] 518.3298 (1.00) 518.3298 (1.00) 518.3298 (1.00) 0.0000 (1.0) 518.3298 (1.00) 0.0000 (1.0) 0;0 1.9293 (1.00) 1 1
test_sharing_gs-checkout-noop[2.40.0] 614.4897 (1.19) 614.4897 (1.19) 614.4897 (1.19) 0.0000 (1.0) 614.4897 (1.19) 0.0000 (1.0) 0;0 1.6274 (0.84) 1 1
test_sharing_gs-checkout-noop[2.40.0] 604.4105 (1.17) 604.4105 (1.17) 604.4105 (1.17) 0.0000 (1.0) 604.4105 (1.17) 0.0000 (1.0) 0;0 1.6545 (0.86) 1 1
test_sharing_gs-checkout-noop[2.58.2] 675.1504 (1.30) 675.1504 (1.30) 675.1504 (1.30) 0.0000 (1.0) 675.1504 (1.30) 0.0000 (1.0) 0;0 1.4812 (0.77) 1 1
test_sharing_gs-checkout-noop[2.58.2] 669.2604 (1.29) 669.2604 (1.29) 669.2604 (1.29) 0.0000 (1.0) 669.2604 (1.29) 0.0000 (1.0) 0;0 1.4942 (0.77) 1 1
test_sharing_gs-checkout-noop[3.0.0] 691.5487 (1.33) 691.5487 (1.33) 691.5487 (1.33) 0.0000 (1.0) 691.5487 (1.33) 0.0000 (1.0) 0;0 1.4460 (0.75) 1 1
test_sharing_gs-checkout-noop[3.0.0] 683.0261 (1.32) 683.0261 (1.32) 683.0261 (1.32) 0.0000 (1.0) 683.0261 (1.32) 0.0000 (1.0) 0;0 1.4641 (0.76) 1 1
test_sharing_gs-checkout-noop[main] 683.1323 (1.32) 683.1323 (1.32) 683.1323 (1.32) 0.0000 (1.0) 683.1323 (1.32) 0.0000 (1.0) 0;0 1.4638 (0.76) 1 1
test_sharing_gs-checkout-noop[main] 681.9964 (1.32) 681.9964 (1.32) 681.9964 (1.32) 0.0000 (1.0) 681.9964 (1.32) 0.0000 (1.0) 0;0 1.4663 (0.76) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-pull': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull[2.11.0] 7.2762 (1.32) 7.2762 (1.32) 7.2762 (1.32) 0.0000 (1.0) 7.2762 (1.32) 0.0000 (1.0) 0;0 0.1374 (0.76) 1 1
test_sharing_gs-pull[2.11.0] 7.7662 (1.41) 7.7662 (1.41) 7.7662 (1.41) 0.0000 (1.0) 7.7662 (1.41) 0.0000 (1.0) 0;0 0.1288 (0.71) 1 1
test_sharing_gs-pull[2.40.0] 8.7606 (1.59) 8.7606 (1.59) 8.7606 (1.59) 0.0000 (1.0) 8.7606 (1.59) 0.0000 (1.0) 0;0 0.1141 (0.63) 1 1
test_sharing_gs-pull[2.40.0] 9.0723 (1.65) 9.0723 (1.65) 9.0723 (1.65) 0.0000 (1.0) 9.0723 (1.65) 0.0000 (1.0) 0;0 0.1102 (0.61) 1 1
test_sharing_gs-pull[2.58.2] 5.6155 (1.02) 5.6155 (1.02) 5.6155 (1.02) 0.0000 (1.0) 5.6155 (1.02) 0.0000 (1.0) 0;0 0.1781 (0.98) 1 1
test_sharing_gs-pull[2.58.2] 5.5068 (1.0) 5.5068 (1.0) 5.5068 (1.0) 0.0000 (1.0) 5.5068 (1.0) 0.0000 (1.0) 0;0 0.1816 (1.0) 1 1
test_sharing_gs-pull[3.0.0] 7.8435 (1.42) 7.8435 (1.42) 7.8435 (1.42) 0.0000 (1.0) 7.8435 (1.42) 0.0000 (1.0) 0;0 0.1275 (0.70) 1 1
test_sharing_gs-pull[3.0.0] 7.8298 (1.42) 7.8298 (1.42) 7.8298 (1.42) 0.0000 (1.0) 7.8298 (1.42) 0.0000 (1.0) 0;0 0.1277 (0.70) 1 1
test_sharing_gs-pull[main] 7.8203 (1.42) 7.8203 (1.42) 7.8203 (1.42) 0.0000 (1.0) 7.8203 (1.42) 0.0000 (1.0) 0;0 0.1279 (0.70) 1 1
test_sharing_gs-pull[main] 7.9097 (1.44) 7.9097 (1.44) 7.9097 (1.44) 0.0000 (1.0) 7.9097 (1.44) 0.0000 (1.0) 0;0 0.1264 (0.70) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull-noop[2.11.0] 542.2864 (1.0) 542.2864 (1.0) 542.2864 (1.0) 0.0000 (1.0) 542.2864 (1.0) 0.0000 (1.0) 0;0 1.8440 (1.0) 1 1
test_sharing_gs-pull-noop[2.11.0] 552.4029 (1.02) 552.4029 (1.02) 552.4029 (1.02) 0.0000 (1.0) 552.4029 (1.02) 0.0000 (1.0) 0;0 1.8103 (0.98) 1 1
test_sharing_gs-pull-noop[2.40.0] 647.0808 (1.19) 647.0808 (1.19) 647.0808 (1.19) 0.0000 (1.0) 647.0808 (1.19) 0.0000 (1.0) 0;0 1.5454 (0.84) 1 1
test_sharing_gs-pull-noop[2.40.0] 636.1574 (1.17) 636.1574 (1.17) 636.1574 (1.17) 0.0000 (1.0) 636.1574 (1.17) 0.0000 (1.0) 0;0 1.5719 (0.85) 1 1
test_sharing_gs-pull-noop[2.58.2] 725.2343 (1.34) 725.2343 (1.34) 725.2343 (1.34) 0.0000 (1.0) 725.2343 (1.34) 0.0000 (1.0) 0;0 1.3789 (0.75) 1 1
test_sharing_gs-pull-noop[2.58.2] 721.5059 (1.33) 721.5059 (1.33) 721.5059 (1.33) 0.0000 (1.0) 721.5059 (1.33) 0.0000 (1.0) 0;0 1.3860 (0.75) 1 1
test_sharing_gs-pull-noop[3.0.0] 825.3152 (1.52) 825.3152 (1.52) 825.3152 (1.52) 0.0000 (1.0) 825.3152 (1.52) 0.0000 (1.0) 0;0 1.2117 (0.66) 1 1
test_sharing_gs-pull-noop[3.0.0] 830.6590 (1.53) 830.6590 (1.53) 830.6590 (1.53) 0.0000 (1.0) 830.6590 (1.53) 0.0000 (1.0) 0;0 1.2039 (0.65) 1 1
test_sharing_gs-pull-noop[main] 822.5658 (1.52) 822.5658 (1.52) 822.5658 (1.52) 0.0000 (1.0) 822.5658 (1.52) 0.0000 (1.0) 0;0 1.2157 (0.66) 1 1
test_sharing_gs-pull-noop[main] 819.9580 (1.51) 819.9580 (1.51) 819.9580 (1.51) 0.0000 (1.0) 819.9580 (1.51) 0.0000 (1.0) 0;0 1.2196 (0.66) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.11.0] 4.0958 (2.31) 4.0958 (2.31) 4.0958 (2.31) 0.0000 (1.0) 4.0958 (2.31) 0.0000 (1.0) 0;0 0.2441 (0.43) 1 1
test_sharing_gs-push[2.11.0] 4.1167 (2.32) 4.1167 (2.32) 4.1167 (2.32) 0.0000 (1.0) 4.1167 (2.32) 0.0000 (1.0) 0;0 0.2429 (0.43) 1 1
test_sharing_gs-push[2.40.0] 5.2154 (2.94) 5.2154 (2.94) 5.2154 (2.94) 0.0000 (1.0) 5.2154 (2.94) 0.0000 (1.0) 0;0 0.1917 (0.34) 1 1
test_sharing_gs-push[2.40.0] 5.3317 (3.00) 5.3317 (3.00) 5.3317 (3.00) 0.0000 (1.0) 5.3317 (3.00) 0.0000 (1.0) 0;0 0.1876 (0.33) 1 1
test_sharing_gs-push[2.58.2] 3.5372 (1.99) 3.5372 (1.99) 3.5372 (1.99) 0.0000 (1.0) 3.5372 (1.99) 0.0000 (1.0) 0;0 0.2827 (0.50) 1 1
test_sharing_gs-push[2.58.2] 3.7284 (2.10) 3.7284 (2.10) 3.7284 (2.10) 0.0000 (1.0) 3.7284 (2.10) 0.0000 (1.0) 0;0 0.2682 (0.48) 1 1
test_sharing_gs-push[3.0.0] 1.7761 (1.0) 1.7761 (1.0) 1.7761 (1.0) 0.0000 (1.0) 1.7761 (1.0) 0.0000 (1.0) 0;0 0.5630 (1.0) 1 1
test_sharing_gs-push[3.0.0] 2.0701 (1.17) 2.0701 (1.17) 2.0701 (1.17) 0.0000 (1.0) 2.0701 (1.17) 0.0000 (1.0) 0;0 0.4831 (0.86) 1 1
test_sharing_gs-push[main] 3.5084 (1.98) 3.5084 (1.98) 3.5084 (1.98) 0.0000 (1.0) 3.5084 (1.98) 0.0000 (1.0) 0;0 0.2850 (0.51) 1 1
test_sharing_gs-push[main] 3.7834 (2.13) 3.7834 (2.13) 3.7834 (2.13) 0.0000 (1.0) 3.7834 (2.13) 0.0000 (1.0) 0;0 0.2643 (0.47) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.11.0] 463.9781 (1.01) 463.9781 (1.01) 463.9781 (1.01) 0.0000 (1.0) 463.9781 (1.01) 0.0000 (1.0) 0;0 2.1553 (0.99) 1 1
test_sharing_gs-push-noop[2.11.0] 460.7591 (1.0) 460.7591 (1.0) 460.7591 (1.0) 0.0000 (1.0) 460.7591 (1.0) 0.0000 (1.0) 0;0 2.1703 (1.0) 1 1
test_sharing_gs-push-noop[2.40.0] 496.0294 (1.08) 496.0294 (1.08) 496.0294 (1.08) 0.0000 (1.0) 496.0294 (1.08) 0.0000 (1.0) 0;0 2.0160 (0.93) 1 1
test_sharing_gs-push-noop[2.40.0] 501.4499 (1.09) 501.4499 (1.09) 501.4499 (1.09) 0.0000 (1.0) 501.4499 (1.09) 0.0000 (1.0) 0;0 1.9942 (0.92) 1 1
test_sharing_gs-push-noop[2.58.2] 546.8821 (1.19) 546.8821 (1.19) 546.8821 (1.19) 0.0000 (1.0) 546.8821 (1.19) 0.0000 (1.0) 0;0 1.8285 (0.84) 1 1
test_sharing_gs-push-noop[2.58.2] 551.0025 (1.20) 551.0025 (1.20) 551.0025 (1.20) 0.0000 (1.0) 551.0025 (1.20) 0.0000 (1.0) 0;0 1.8149 (0.84) 1 1
test_sharing_gs-push-noop[3.0.0] 543.0455 (1.18) 543.0455 (1.18) 543.0455 (1.18) 0.0000 (1.0) 543.0455 (1.18) 0.0000 (1.0) 0;0 1.8415 (0.85) 1 1
test_sharing_gs-push-noop[3.0.0] 778.7730 (1.69) 778.7730 (1.69) 778.7730 (1.69) 0.0000 (1.0) 778.7730 (1.69) 0.0000 (1.0) 0;0 1.2841 (0.59) 1 1
test_sharing_gs-push-noop[main] 537.1030 (1.17) 537.1030 (1.17) 537.1030 (1.17) 0.0000 (1.0) 537.1030 (1.17) 0.0000 (1.0) 0;0 1.8618 (0.86) 1 1
test_sharing_gs-push-noop[main] 540.1592 (1.17) 540.1592 (1.17) 540.1592 (1.17) 0.0000 (1.0) 540.1592 (1.17) 0.0000 (1.0) 0;0 1.8513 (0.85) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 332.2141 (1.0) 381.6674 (1.0) 338.6474 (1.0) 6.6745 (1.72) 337.5138 (1.0) 3.3703 (1.0) 5;7 2.9529 (1.0) 100 1
test_init-init[2.40.0] 389.4716 (1.17) 430.1368 (1.13) 395.4111 (1.17) 4.4636 (1.15) 394.6626 (1.17) 4.0390 (1.20) 10;2 2.5290 (0.86) 100 1
test_init-init[2.58.2] 440.2380 (1.33) 459.7990 (1.20) 447.8757 (1.32) 3.8800 (1.0) 447.6609 (1.33) 4.2460 (1.26) 24;5 2.2328 (0.76) 100 1
test_init-init[3.0.0] 432.9005 (1.30) 528.1459 (1.38) 441.8911 (1.30) 9.9701 (2.57) 439.9384 (1.30) 5.1677 (1.53) 7;9 2.2630 (0.77) 100 1
test_init-init[main] 443.0895 (1.33) 639.3676 (1.68) 452.9835 (1.34) 19.4293 (5.01) 450.1424 (1.33) 4.3289 (1.28) 1;10 2.2076 (0.75) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 406.4758 (1.0) 406.4758 (1.0) 406.4758 (1.0) 0.0000 (1.0) 406.4758 (1.0) 0.0000 (1.0) 0;0 2.4602 (1.0) 1 1
test_list-list[2.40.0] 407.6970 (1.00) 407.6970 (1.00) 407.6970 (1.00) 0.0000 (1.0) 407.6970 (1.00) 0.0000 (1.0) 0;0 2.4528 (1.00) 1 1
test_list-list[2.58.2] 480.2675 (1.18) 480.2675 (1.18) 480.2675 (1.18) 0.0000 (1.0) 480.2675 (1.18) 0.0000 (1.0) 0;0 2.0822 (0.85) 1 1
test_list-list[3.0.0] 478.7149 (1.18) 478.7149 (1.18) 478.7149 (1.18) 0.0000 (1.0) 478.7149 (1.18) 0.0000 (1.0) 0;0 2.0889 (0.85) 1 1
test_list-list[main] 456.5987 (1.12) 456.5987 (1.12) 456.5987 (1.12) 0.0000 (1.0) 456.5987 (1.12) 0.0000 (1.0) 0;0 2.1901 (0.89) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 395.1363 (1.01) 395.1363 (1.01) 395.1363 (1.01) 0.0000 (1.0) 395.1363 (1.01) 0.0000 (1.0) 0;0 2.5308 (0.99) 1 1
test_list-list-dvc-only[2.40.0] 390.6099 (1.0) 390.6099 (1.0) 390.6099 (1.0) 0.0000 (1.0) 390.6099 (1.0) 0.0000 (1.0) 0;0 2.5601 (1.0) 1 1
test_list-list-dvc-only[2.58.2] 461.8120 (1.18) 461.8120 (1.18) 461.8120 (1.18) 0.0000 (1.0) 461.8120 (1.18) 0.0000 (1.0) 0;0 2.1654 (0.85) 1 1
test_list-list-dvc-only[3.0.0] 453.7408 (1.16) 453.7408 (1.16) 453.7408 (1.16) 0.0000 (1.0) 453.7408 (1.16) 0.0000 (1.0) 0;0 2.2039 (0.86) 1 1
test_list-list-dvc-only[main] 450.7989 (1.15) 450.7989 (1.15) 450.7989 (1.15) 0.0000 (1.0) 450.7989 (1.15) 0.0000 (1.0) 0;0 2.2183 (0.87) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.6761 (3.64) 1.6761 (3.64) 1.6761 (3.64) 0.0000 (1.0) 1.6761 (3.64) 0.0000 (1.0) 0;0 0.5966 (0.27) 1 1
test_list-list-recursive[2.40.0] 0.4600 (1.0) 0.4600 (1.0) 0.4600 (1.0) 0.0000 (1.0) 0.4600 (1.0) 0.0000 (1.0) 0;0 2.1738 (1.0) 1 1
test_list-list-recursive[2.58.2] 0.5571 (1.21) 0.5571 (1.21) 0.5571 (1.21) 0.0000 (1.0) 0.5571 (1.21) 0.0000 (1.0) 0;0 1.7949 (0.83) 1 1
test_list-list-recursive[3.0.0] 0.5526 (1.20) 0.5526 (1.20) 0.5526 (1.20) 0.0000 (1.0) 0.5526 (1.20) 0.0000 (1.0) 0;0 1.8098 (0.83) 1 1
test_list-list-recursive[main] 0.5483 (1.19) 0.5483 (1.19) 0.5483 (1.19) 0.0000 (1.0) 0.5483 (1.19) 0.0000 (1.0) 0;0 1.8238 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 398.1372 (1.0) 398.1372 (1.0) 398.1372 (1.0) 0.0000 (1.0) 398.1372 (1.0) 0.0000 (1.0) 0;0 2.5117 (1.0) 1 1
test_list-list-shallow[2.40.0] 421.7355 (1.06) 421.7355 (1.06) 421.7355 (1.06) 0.0000 (1.0) 421.7355 (1.06) 0.0000 (1.0) 0;0 2.3712 (0.94) 1 1
test_list-list-shallow[2.58.2] 460.8802 (1.16) 460.8802 (1.16) 460.8802 (1.16) 0.0000 (1.0) 460.8802 (1.16) 0.0000 (1.0) 0;0 2.1698 (0.86) 1 1
test_list-list-shallow[3.0.0] 453.7251 (1.14) 453.7251 (1.14) 453.7251 (1.14) 0.0000 (1.0) 453.7251 (1.14) 0.0000 (1.0) 0;0 2.2040 (0.88) 1 1
test_list-list-shallow[main] 452.5756 (1.14) 452.5756 (1.14) 452.5756 (1.14) 0.0000 (1.0) 452.5756 (1.14) 0.0000 (1.0) 0;0 2.2096 (0.88) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 7.3820 (1.79) 7.3820 (1.79) 7.3820 (1.79) 0.0000 (1.0) 7.3820 (1.79) 0.0000 (1.0) 0;0 0.1355 (0.56) 1 1
test_partial_remove-add[2.40.0] 6.0368 (1.46) 6.0368 (1.46) 6.0368 (1.46) 0.0000 (1.0) 6.0368 (1.46) 0.0000 (1.0) 0;0 0.1657 (0.68) 1 1
test_partial_remove-add[2.58.2] 4.1595 (1.01) 4.1595 (1.01) 4.1595 (1.01) 0.0000 (1.0) 4.1595 (1.01) 0.0000 (1.0) 0;0 0.2404 (0.99) 1 1
test_partial_remove-add[3.0.0] 4.1920 (1.02) 4.1920 (1.02) 4.1920 (1.02) 0.0000 (1.0) 4.1920 (1.02) 0.0000 (1.0) 0;0 0.2385 (0.98) 1 1
test_partial_remove-add[main] 4.1228 (1.0) 4.1228 (1.0) 4.1228 (1.0) 0.0000 (1.0) 4.1228 (1.0) 0.0000 (1.0) 0;0 0.2426 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.11.0] 2.7979 (1.78) 2.7979 (1.78) 2.7979 (1.78) 0.0000 (1.0) 2.7979 (1.78) 0.0000 (1.0) 0;0 0.3574 (0.56) 1 1
test_partial_remove-add-update[2.40.0] 1.5732 (1.0) 1.5732 (1.0) 1.5732 (1.0) 0.0000 (1.0) 1.5732 (1.0) 0.0000 (1.0) 0;0 0.6357 (1.0) 1 1
test_partial_remove-add-update[2.58.2] 1.7026 (1.08) 1.7026 (1.08) 1.7026 (1.08) 0.0000 (1.0) 1.7026 (1.08) 0.0000 (1.0) 0;0 0.5873 (0.92) 1 1
test_partial_remove-add-update[3.0.0] 1.6772 (1.07) 1.6772 (1.07) 1.6772 (1.07) 0.0000 (1.0) 1.6772 (1.07) 0.0000 (1.0) 0;0 0.5962 (0.94) 1 1
test_partial_remove-add-update[main] 1.6610 (1.06) 1.6610 (1.06) 1.6610 (1.06) 0.0000 (1.0) 1.6610 (1.06) 0.0000 (1.0) 0;0 0.6020 (0.95) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 458.4227 (1.0) 458.4227 (1.0) 458.4227 (1.0) 0.0000 (1.0) 458.4227 (1.0) 0.0000 (1.0) 0;0 2.1814 (1.0) 1 1
test_partial_remove-gc[2.40.0] 520.6574 (1.14) 520.6574 (1.14) 520.6574 (1.14) 0.0000 (1.0) 520.6574 (1.14) 0.0000 (1.0) 0;0 1.9206 (0.88) 1 1
test_partial_remove-gc[2.58.2] 610.7831 (1.33) 610.7831 (1.33) 610.7831 (1.33) 0.0000 (1.0) 610.7831 (1.33) 0.0000 (1.0) 0;0 1.6372 (0.75) 1 1
test_partial_remove-gc[3.0.0] 649.4245 (1.42) 649.4245 (1.42) 649.4245 (1.42) 0.0000 (1.0) 649.4245 (1.42) 0.0000 (1.0) 0;0 1.5398 (0.71) 1 1
test_partial_remove-gc[main] 651.5842 (1.42) 651.5842 (1.42) 651.5842 (1.42) 0.0000 (1.0) 651.5842 (1.42) 0.0000 (1.0) 0;0 1.5347 (0.70) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 510.2917 (1.0) 510.2917 (1.0) 510.2917 (1.0) 0.0000 (1.0) 510.2917 (1.0) 0.0000 (1.0) 0;0 1.9597 (1.0) 1 1
test_partial_remove-gc-cloud[2.40.0] 572.9758 (1.12) 572.9758 (1.12) 572.9758 (1.12) 0.0000 (1.0) 572.9758 (1.12) 0.0000 (1.0) 0;0 1.7453 (0.89) 1 1
test_partial_remove-gc-cloud[2.58.2] 672.9313 (1.32) 672.9313 (1.32) 672.9313 (1.32) 0.0000 (1.0) 672.9313 (1.32) 0.0000 (1.0) 0;0 1.4860 (0.76) 1 1
test_partial_remove-gc-cloud[3.0.0] 728.5418 (1.43) 728.5418 (1.43) 728.5418 (1.43) 0.0000 (1.0) 728.5418 (1.43) 0.0000 (1.0) 0;0 1.3726 (0.70) 1 1
test_partial_remove-gc-cloud[main] 726.2302 (1.42) 726.2302 (1.42) 726.2302 (1.42) 0.0000 (1.0) 726.2302 (1.42) 0.0000 (1.0) 0;0 1.3770 (0.70) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 4.0829 (2.27) 4.0829 (2.27) 4.0829 (2.27) 0.0000 (1.0) 4.0829 (2.27) 0.0000 (1.0) 0;0 0.2449 (0.44) 1 1
test_partial_remove-push[2.40.0] 5.1932 (2.89) 5.1932 (2.89) 5.1932 (2.89) 0.0000 (1.0) 5.1932 (2.89) 0.0000 (1.0) 0;0 0.1926 (0.35) 1 1
test_partial_remove-push[2.58.2] 3.6495 (2.03) 3.6495 (2.03) 3.6495 (2.03) 0.0000 (1.0) 3.6495 (2.03) 0.0000 (1.0) 0;0 0.2740 (0.49) 1 1
test_partial_remove-push[3.0.0] 1.7968 (1.0) 1.7968 (1.0) 1.7968 (1.0) 0.0000 (1.0) 1.7968 (1.0) 0.0000 (1.0) 0;0 0.5565 (1.0) 1 1
test_partial_remove-push[main] 3.5756 (1.99) 3.5756 (1.99) 3.5756 (1.99) 0.0000 (1.0) 3.5756 (1.99) 0.0000 (1.0) 0;0 0.2797 (0.50) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.11.0] 493.0906 (1.0) 493.0906 (1.0) 493.0906 (1.0) 0.0000 (1.0) 493.0906 (1.0) 0.0000 (1.0) 0;0 2.0280 (1.0) 1 1
test_partial_remove-push-update[2.40.0] 540.4036 (1.10) 540.4036 (1.10) 540.4036 (1.10) 0.0000 (1.0) 540.4036 (1.10) 0.0000 (1.0) 0;0 1.8505 (0.91) 1 1
test_partial_remove-push-update[2.58.2] 606.0417 (1.23) 606.0417 (1.23) 606.0417 (1.23) 0.0000 (1.0) 606.0417 (1.23) 0.0000 (1.0) 0;0 1.6501 (0.81) 1 1
test_partial_remove-push-update[3.0.0] 599.7379 (1.22) 599.7379 (1.22) 599.7379 (1.22) 0.0000 (1.0) 599.7379 (1.22) 0.0000 (1.0) 0;0 1.6674 (0.82) 1 1
test_partial_remove-push-update[main] 582.7339 (1.18) 582.7339 (1.18) 582.7339 (1.18) 0.0000 (1.0) 582.7339 (1.18) 0.0000 (1.0) 0;0 1.7160 (0.85) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 204.7945 (1.01) 290.5587 (1.17) 227.4197 (1.03) 14.3026 (1.83) 225.6794 (1.04) 15.4623 (1.44) 25;4 4.3972 (0.97) 100 1
test_help---help[2.40.0] 267.5035 (1.32) 324.8362 (1.31) 289.5868 (1.31) 13.6895 (1.75) 286.8789 (1.32) 19.6023 (1.83) 30;0 3.4532 (0.76) 100 1
test_help---help[2.58.2] 206.1064 (1.02) 259.4308 (1.05) 232.7278 (1.05) 10.6178 (1.35) 232.2020 (1.07) 14.5218 (1.35) 36;0 4.2969 (0.95) 100 1
test_help---help[3.0.0] 207.8760 (1.02) 247.9637 (1.0) 221.0827 (1.0) 7.8360 (1.0) 219.9913 (1.01) 10.7258 (1.0) 35;1 4.5232 (1.0) 100 1
test_help---help[main] 202.9941 (1.0) 280.1078 (1.13) 221.2984 (1.00) 12.6887 (1.62) 217.1375 (1.0) 13.8168 (1.29) 20;3 4.5188 (1.00) 100 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 3.0212 (1.0) 3.0212 (1.0) 3.0212 (1.0) 0.0000 (1.0) 3.0212 (1.0) 0.0000 (1.0) 0;0 0.3310 (1.0) 1 1
test_get_url-get-url[2.40.0] 3.0882 (1.02) 3.0882 (1.02) 3.0882 (1.02) 0.0000 (1.0) 3.0882 (1.02) 0.0000 (1.0) 0;0 0.3238 (0.98) 1 1
test_get_url-get-url[2.58.2] 3.1443 (1.04) 3.1443 (1.04) 3.1443 (1.04) 0.0000 (1.0) 3.1443 (1.04) 0.0000 (1.0) 0;0 0.3180 (0.96) 1 1
test_get_url-get-url[3.0.0] 3.1230 (1.03) 3.1230 (1.03) 3.1230 (1.03) 0.0000 (1.0) 3.1230 (1.03) 0.0000 (1.0) 0;0 0.3202 (0.97) 1 1
test_get_url-get-url[main] 3.2226 (1.07) 3.2226 (1.07) 3.2226 (1.07) 0.0000 (1.0) 3.2226 (1.07) 0.0000 (1.0) 0;0 0.3103 (0.94) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.40.0] 1.1208 (1.0) 1.1208 (1.0) 1.1208 (1.0) 0.0000 (1.0) 1.1208 (1.0) 0.0000 (1.0) 0;0 0.8923 (1.0) 1 1
test_exp_show-exp[2.58.2] 1.3540 (1.21) 1.3540 (1.21) 1.3540 (1.21) 0.0000 (1.0) 1.3540 (1.21) 0.0000 (1.0) 0;0 0.7386 (0.83) 1 1
test_exp_show-exp[3.0.0] 1.9454 (1.74) 1.9454 (1.74) 1.9454 (1.74) 0.0000 (1.0) 1.9454 (1.74) 0.0000 (1.0) 0;0 0.5140 (0.58) 1 1
test_exp_show-exp[main] 2.0006 (1.79) 2.0006 (1.79) 2.0006 (1.79) 0.0000 (1.0) 2.0006 (1.79) 0.0000 (1.0) 0;0 0.4999 (0.56) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.1701 (1.06) 1.1701 (1.06) 1.1701 (1.06) 0.0000 (1.0) 1.1701 (1.06) 0.0000 (1.0) 0;0 0.8546 (0.95) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.1310 (1.02) 1.1310 (1.02) 1.1310 (1.02) 0.0000 (1.0) 1.1310 (1.02) 0.0000 (1.0) 0;0 0.8842 (0.98) 1 1
test_checkout_hardlink-checkout[2.58.2] 1.2662 (1.14) 1.2662 (1.14) 1.2662 (1.14) 0.0000 (1.0) 1.2662 (1.14) 0.0000 (1.0) 0;0 0.7898 (0.87) 1 1
test_checkout_hardlink-checkout[3.0.0] 1.1297 (1.02) 1.1297 (1.02) 1.1297 (1.02) 0.0000 (1.0) 1.1297 (1.02) 0.0000 (1.0) 0;0 0.8852 (0.98) 1 1
test_checkout_hardlink-checkout[main] 1.1061 (1.0) 1.1061 (1.0) 1.1061 (1.0) 0.0000 (1.0) 1.1061 (1.0) 0.0000 (1.0) 0;0 0.9041 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 506.6379 (1.0) 506.6379 (1.0) 506.6379 (1.0) 0.0000 (1.0) 506.6379 (1.0) 0.0000 (1.0) 0;0 1.9738 (1.0) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 566.8430 (1.12) 566.8430 (1.12) 566.8430 (1.12) 0.0000 (1.0) 566.8430 (1.12) 0.0000 (1.0) 0;0 1.7642 (0.89) 1 1
test_checkout_hardlink-checkout-noop[2.58.2] 631.1681 (1.25) 631.1681 (1.25) 631.1681 (1.25) 0.0000 (1.0) 631.1681 (1.25) 0.0000 (1.0) 0;0 1.5844 (0.80) 1 1
test_checkout_hardlink-checkout-noop[3.0.0] 651.0624 (1.29) 651.0624 (1.29) 651.0624 (1.29) 0.0000 (1.0) 651.0624 (1.29) 0.0000 (1.0) 0;0 1.5360 (0.78) 1 1
test_checkout_hardlink-checkout-noop[main] 644.2032 (1.27) 644.2032 (1.27) 644.2032 (1.27) 0.0000 (1.0) 644.2032 (1.27) 0.0000 (1.0) 0;0 1.5523 (0.79) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.2056 (1.92) 1.2056 (1.92) 1.2056 (1.92) 0.0000 (1.0) 1.2056 (1.92) 0.0000 (1.0) 0;0 0.8295 (0.52) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.6294 (1.0) 0.6294 (1.0) 0.6294 (1.0) 0.0000 (1.0) 0.6294 (1.0) 0.0000 (1.0) 0;0 1.5888 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.58.2] 0.8097 (1.29) 0.8097 (1.29) 0.8097 (1.29) 0.0000 (1.0) 0.8097 (1.29) 0.0000 (1.0) 0;0 1.2351 (0.78) 1 1
test_checkout_hardlink-checkout-update[3.0.0] 0.7190 (1.14) 0.7190 (1.14) 0.7190 (1.14) 0.0000 (1.0) 0.7190 (1.14) 0.0000 (1.0) 0;0 1.3908 (0.88) 1 1
test_checkout_hardlink-checkout-update[main] 0.7111 (1.13) 0.7111 (1.13) 0.7111 (1.13) 0.0000 (1.0) 0.7111 (1.13) 0.0000 (1.0) 0;0 1.4063 (0.89) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.11.0] 3.5105 (1.67) 3.5105 (1.67) 3.5105 (1.67) 0.0000 (1.0) 3.5105 (1.67) 0.0000 (1.0) 0;0 0.2849 (0.60) 1 1
test_partial_add-add[2.40.0] 2.9482 (1.40) 2.9482 (1.40) 2.9482 (1.40) 0.0000 (1.0) 2.9482 (1.40) 0.0000 (1.0) 0;0 0.3392 (0.71) 1 1
test_partial_add-add[2.58.2] 2.5961 (1.24) 2.5961 (1.24) 2.5961 (1.24) 0.0000 (1.0) 2.5961 (1.24) 0.0000 (1.0) 0;0 0.3852 (0.81) 1 1
test_partial_add-add[3.0.0] 2.5419 (1.21) 2.5419 (1.21) 2.5419 (1.21) 0.0000 (1.0) 2.5419 (1.21) 0.0000 (1.0) 0;0 0.3934 (0.83) 1 1
test_partial_add-add[main] 2.0991 (1.0) 2.0991 (1.0) 2.0991 (1.0) 0.0000 (1.0) 2.0991 (1.0) 0.0000 (1.0) 0;0 0.4764 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.11.0] 5.5302 (1.81) 5.5302 (1.81) 5.5302 (1.81) 0.0000 (1.0) 5.5302 (1.81) 0.0000 (1.0) 0;0 0.1808 (0.55) 1 1
test_partial_add-add-partial[2.40.0] 3.8566 (1.26) 3.8566 (1.26) 3.8566 (1.26) 0.0000 (1.0) 3.8566 (1.26) 0.0000 (1.0) 0;0 0.2593 (0.79) 1 1
test_partial_add-add-partial[2.58.2] 3.0772 (1.01) 3.0772 (1.01) 3.0772 (1.01) 0.0000 (1.0) 3.0772 (1.01) 0.0000 (1.0) 0;0 0.3250 (0.99) 1 1
test_partial_add-add-partial[3.0.0] 3.0490 (1.0) 3.0490 (1.0) 3.0490 (1.0) 0.0000 (1.0) 3.0490 (1.0) 0.0000 (1.0) 0;0 0.3280 (1.0) 1 1
test_partial_add-add-partial[main] 3.0818 (1.01) 3.0818 (1.01) 3.0818 (1.01) 0.0000 (1.0) 3.0818 (1.01) 0.0000 (1.0) 0;0 0.3245 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 479.1541 (1.0) 479.1541 (1.0) 479.1541 (1.0) 0.0000 (1.0) 479.1541 (1.0) 0.0000 (1.0) 0;0 2.0870 (1.0) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 548.1166 (1.14) 548.1166 (1.14) 548.1166 (1.14) 0.0000 (1.0) 548.1166 (1.14) 0.0000 (1.0) 0;0 1.8244 (0.87) 1 1
test_partial_add-gc-cloud-noop[2.58.2] 673.3719 (1.41) 673.3719 (1.41) 673.3719 (1.41) 0.0000 (1.0) 673.3719 (1.41) 0.0000 (1.0) 0;0 1.4851 (0.71) 1 1
test_partial_add-gc-cloud-noop[3.0.0] 772.3656 (1.61) 772.3656 (1.61) 772.3656 (1.61) 0.0000 (1.0) 772.3656 (1.61) 0.0000 (1.0) 0;0 1.2947 (0.62) 1 1
test_partial_add-gc-cloud-noop[main] 754.9134 (1.58) 754.9134 (1.58) 754.9134 (1.58) 0.0000 (1.0) 754.9134 (1.58) 0.0000 (1.0) 0;0 1.3247 (0.63) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 446.4385 (1.0) 446.4385 (1.0) 446.4385 (1.0) 0.0000 (1.0) 446.4385 (1.0) 0.0000 (1.0) 0;0 2.2400 (1.0) 1 1
test_partial_add-gc-noop[2.40.0] 486.9207 (1.09) 486.9207 (1.09) 486.9207 (1.09) 0.0000 (1.0) 486.9207 (1.09) 0.0000 (1.0) 0;0 2.0537 (0.92) 1 1
test_partial_add-gc-noop[2.58.2] 574.4310 (1.29) 574.4310 (1.29) 574.4310 (1.29) 0.0000 (1.0) 574.4310 (1.29) 0.0000 (1.0) 0;0 1.7409 (0.78) 1 1
test_partial_add-gc-noop[3.0.0] 660.2473 (1.48) 660.2473 (1.48) 660.2473 (1.48) 0.0000 (1.0) 660.2473 (1.48) 0.0000 (1.0) 0;0 1.5146 (0.68) 1 1
test_partial_add-gc-noop[main] 664.5834 (1.49) 664.5834 (1.49) 664.5834 (1.49) 0.0000 (1.0) 664.5834 (1.49) 0.0000 (1.0) 0;0 1.5047 (0.67) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.11.0] 2.0344 (1.92) 2.0344 (1.92) 2.0344 (1.92) 0.0000 (1.0) 2.0344 (1.92) 0.0000 (1.0) 0;0 0.4916 (0.52) 1 1
test_partial_add-push[2.40.0] 2.5519 (2.40) 2.5519 (2.40) 2.5519 (2.40) 0.0000 (1.0) 2.5519 (2.40) 0.0000 (1.0) 0;0 0.3919 (0.42) 1 1
test_partial_add-push[2.58.2] 1.8787 (1.77) 1.8787 (1.77) 1.8787 (1.77) 0.0000 (1.0) 1.8787 (1.77) 0.0000 (1.0) 0;0 0.5323 (0.56) 1 1
test_partial_add-push[3.0.0] 1.0613 (1.0) 1.0613 (1.0) 1.0613 (1.0) 0.0000 (1.0) 1.0613 (1.0) 0.0000 (1.0) 0;0 0.9422 (1.0) 1 1
test_partial_add-push[main] 1.8431 (1.74) 1.8431 (1.74) 1.8431 (1.74) 0.0000 (1.0) 1.8431 (1.74) 0.0000 (1.0) 0;0 0.5426 (0.58) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.11.0] 2.1001 (1.92) 2.1001 (1.92) 2.1001 (1.92) 0.0000 (1.0) 2.1001 (1.92) 0.0000 (1.0) 0;0 0.4762 (0.52) 1 1
test_partial_add-push-partial[2.40.0] 2.6325 (2.41) 2.6325 (2.41) 2.6325 (2.41) 0.0000 (1.0) 2.6325 (2.41) 0.0000 (1.0) 0;0 0.3799 (0.41) 1 1
test_partial_add-push-partial[2.58.2] 1.9266 (1.76) 1.9266 (1.76) 1.9266 (1.76) 0.0000 (1.0) 1.9266 (1.76) 0.0000 (1.0) 0;0 0.5191 (0.57) 1 1
test_partial_add-push-partial[3.0.0] 1.0917 (1.0) 1.0917 (1.0) 1.0917 (1.0) 0.0000 (1.0) 1.0917 (1.0) 0.0000 (1.0) 0;0 0.9160 (1.0) 1 1
test_partial_add-push-partial[main] 1.9305 (1.77) 1.9305 (1.77) 1.9305 (1.77) 0.0000 (1.0) 1.9305 (1.77) 0.0000 (1.0) 0;0 0.5180 (0.57) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.11.0] 6.3994 (1.74) 6.3994 (1.74) 6.3994 (1.74) 0.0000 (1.0) 6.3994 (1.74) 0.0000 (1.0) 0;0 0.1563 (0.57) 1 1
test_sharing_azure-add[2.11.0] 6.4225 (1.75) 6.4225 (1.75) 6.4225 (1.75) 0.0000 (1.0) 6.4225 (1.75) 0.0000 (1.0) 0;0 0.1557 (0.57) 1 1
test_sharing_azure-add[2.40.0] 5.4510 (1.49) 5.4510 (1.49) 5.4510 (1.49) 0.0000 (1.0) 5.4510 (1.49) 0.0000 (1.0) 0;0 0.1835 (0.67) 1 1
test_sharing_azure-add[2.40.0] 5.4994 (1.50) 5.4994 (1.50) 5.4994 (1.50) 0.0000 (1.0) 5.4994 (1.50) 0.0000 (1.0) 0;0 0.1818 (0.67) 1 1
test_sharing_azure-add[2.58.2] 3.7048 (1.01) 3.7048 (1.01) 3.7048 (1.01) 0.0000 (1.0) 3.7048 (1.01) 0.0000 (1.0) 0;0 0.2699 (0.99) 1 1
test_sharing_azure-add[2.58.2] 3.6678 (1.0) 3.6678 (1.0) 3.6678 (1.0) 0.0000 (1.0) 3.6678 (1.0) 0.0000 (1.0) 0;0 0.2726 (1.0) 1 1
test_sharing_azure-add[3.0.0] 3.6796 (1.00) 3.6796 (1.00) 3.6796 (1.00) 0.0000 (1.0) 3.6796 (1.00) 0.0000 (1.0) 0;0 0.2718 (1.00) 1 1
test_sharing_azure-add[3.0.0] 3.7064 (1.01) 3.7064 (1.01) 3.7064 (1.01) 0.0000 (1.0) 3.7064 (1.01) 0.0000 (1.0) 0;0 0.2698 (0.99) 1 1
test_sharing_azure-add[main] 3.6823 (1.00) 3.6823 (1.00) 3.6823 (1.00) 0.0000 (1.0) 3.6823 (1.00) 0.0000 (1.0) 0;0 0.2716 (1.00) 1 1
test_sharing_azure-add[main] 3.6983 (1.01) 3.6983 (1.01) 3.6983 (1.01) 0.0000 (1.0) 3.6983 (1.01) 0.0000 (1.0) 0;0 0.2704 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.11.0] 3.2145 (1.45) 3.2145 (1.45) 3.2145 (1.45) 0.0000 (1.0) 3.2145 (1.45) 0.0000 (1.0) 0;0 0.3111 (0.69) 1 1
test_sharing_azure-add-noop[2.11.0] 3.2111 (1.45) 3.2111 (1.45) 3.2111 (1.45) 0.0000 (1.0) 3.2111 (1.45) 0.0000 (1.0) 0;0 0.3114 (0.69) 1 1
test_sharing_azure-add-noop[2.40.0] 2.2556 (1.02) 2.2556 (1.02) 2.2556 (1.02) 0.0000 (1.0) 2.2556 (1.02) 0.0000 (1.0) 0;0 0.4433 (0.98) 1 1
test_sharing_azure-add-noop[2.40.0] 2.2192 (1.0) 2.2192 (1.0) 2.2192 (1.0) 0.0000 (1.0) 2.2192 (1.0) 0.0000 (1.0) 0;0 0.4506 (1.0) 1 1
test_sharing_azure-add-noop[2.58.2] 2.4380 (1.10) 2.4380 (1.10) 2.4380 (1.10) 0.0000 (1.0) 2.4380 (1.10) 0.0000 (1.0) 0;0 0.4102 (0.91) 1 1
test_sharing_azure-add-noop[2.58.2] 2.4236 (1.09) 2.4236 (1.09) 2.4236 (1.09) 0.0000 (1.0) 2.4236 (1.09) 0.0000 (1.0) 0;0 0.4126 (0.92) 1 1
test_sharing_azure-add-noop[3.0.0] 2.4593 (1.11) 2.4593 (1.11) 2.4593 (1.11) 0.0000 (1.0) 2.4593 (1.11) 0.0000 (1.0) 0;0 0.4066 (0.90) 1 1
test_sharing_azure-add-noop[3.0.0] 2.4180 (1.09) 2.4180 (1.09) 2.4180 (1.09) 0.0000 (1.0) 2.4180 (1.09) 0.0000 (1.0) 0;0 0.4136 (0.92) 1 1
test_sharing_azure-add-noop[main] 2.4712 (1.11) 2.4712 (1.11) 2.4712 (1.11) 0.0000 (1.0) 2.4712 (1.11) 0.0000 (1.0) 0;0 0.4047 (0.90) 1 1
test_sharing_azure-add-noop[main] 2.4515 (1.10) 2.4515 (1.10) 2.4515 (1.10) 0.0000 (1.0) 2.4515 (1.10) 0.0000 (1.0) 0;0 0.4079 (0.91) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.11.0] 481.5668 (1.0) 481.5668 (1.0) 481.5668 (1.0) 0.0000 (1.0) 481.5668 (1.0) 0.0000 (1.0) 0;0 2.0766 (1.0) 1 1
test_sharing_azure-checkout-noop[2.11.0] 485.5764 (1.01) 485.5764 (1.01) 485.5764 (1.01) 0.0000 (1.0) 485.5764 (1.01) 0.0000 (1.0) 0;0 2.0594 (0.99) 1 1
test_sharing_azure-checkout-noop[2.40.0] 558.7566 (1.16) 558.7566 (1.16) 558.7566 (1.16) 0.0000 (1.0) 558.7566 (1.16) 0.0000 (1.0) 0;0 1.7897 (0.86) 1 1
test_sharing_azure-checkout-noop[2.40.0] 561.5415 (1.17) 561.5415 (1.17) 561.5415 (1.17) 0.0000 (1.0) 561.5415 (1.17) 0.0000 (1.0) 0;0 1.7808 (0.86) 1 1
test_sharing_azure-checkout-noop[2.58.2] 631.1594 (1.31) 631.1594 (1.31) 631.1594 (1.31) 0.0000 (1.0) 631.1594 (1.31) 0.0000 (1.0) 0;0 1.5844 (0.76) 1 1
test_sharing_azure-checkout-noop[2.58.2] 622.3740 (1.29) 622.3740 (1.29) 622.3740 (1.29) 0.0000 (1.0) 622.3740 (1.29) 0.0000 (1.0) 0;0 1.6068 (0.77) 1 1
test_sharing_azure-checkout-noop[3.0.0] 644.0903 (1.34) 644.0903 (1.34) 644.0903 (1.34) 0.0000 (1.0) 644.0903 (1.34) 0.0000 (1.0) 0;0 1.5526 (0.75) 1 1
test_sharing_azure-checkout-noop[3.0.0] 641.4281 (1.33) 641.4281 (1.33) 641.4281 (1.33) 0.0000 (1.0) 641.4281 (1.33) 0.0000 (1.0) 0;0 1.5590 (0.75) 1 1
test_sharing_azure-checkout-noop[main] 652.3325 (1.35) 652.3325 (1.35) 652.3325 (1.35) 0.0000 (1.0) 652.3325 (1.35) 0.0000 (1.0) 0;0 1.5330 (0.74) 1 1
test_sharing_azure-checkout-noop[main] 641.5356 (1.33) 641.5356 (1.33) 641.5356 (1.33) 0.0000 (1.0) 641.5356 (1.33) 0.0000 (1.0) 0;0 1.5588 (0.75) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull[2.11.0] 6.6436 (1.34) 6.6436 (1.34) 6.6436 (1.34) 0.0000 (1.0) 6.6436 (1.34) 0.0000 (1.0) 0;0 0.1505 (0.75) 1 1
test_sharing_azure-pull[2.11.0] 6.8059 (1.37) 6.8059 (1.37) 6.8059 (1.37) 0.0000 (1.0) 6.8059 (1.37) 0.0000 (1.0) 0;0 0.1469 (0.73) 1 1
test_sharing_azure-pull[2.40.0] 7.9117 (1.59) 7.9117 (1.59) 7.9117 (1.59) 0.0000 (1.0) 7.9117 (1.59) 0.0000 (1.0) 0;0 0.1264 (0.63) 1 1
test_sharing_azure-pull[2.40.0] 7.7502 (1.56) 7.7502 (1.56) 7.7502 (1.56) 0.0000 (1.0) 7.7502 (1.56) 0.0000 (1.0) 0;0 0.1290 (0.64) 1 1
test_sharing_azure-pull[2.58.2] 4.9838 (1.00) 4.9838 (1.00) 4.9838 (1.00) 0.0000 (1.0) 4.9838 (1.00) 0.0000 (1.0) 0;0 0.2006 (1.00) 1 1
test_sharing_azure-pull[2.58.2] 4.9671 (1.0) 4.9671 (1.0) 4.9671 (1.0) 0.0000 (1.0) 4.9671 (1.0) 0.0000 (1.0) 0;0 0.2013 (1.0) 1 1
test_sharing_azure-pull[3.0.0] 7.1787 (1.45) 7.1787 (1.45) 7.1787 (1.45) 0.0000 (1.0) 7.1787 (1.45) 0.0000 (1.0) 0;0 0.1393 (0.69) 1 1
test_sharing_azure-pull[3.0.0] 7.8840 (1.59) 7.8840 (1.59) 7.8840 (1.59) 0.0000 (1.0) 7.8840 (1.59) 0.0000 (1.0) 0;0 0.1268 (0.63) 1 1
test_sharing_azure-pull[main] 7.1531 (1.44) 7.1531 (1.44) 7.1531 (1.44) 0.0000 (1.0) 7.1531 (1.44) 0.0000 (1.0) 0;0 0.1398 (0.69) 1 1
test_sharing_azure-pull[main] 7.0427 (1.42) 7.0427 (1.42) 7.0427 (1.42) 0.0000 (1.0) 7.0427 (1.42) 0.0000 (1.0) 0;0 0.1420 (0.71) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull-noop[2.11.0] 507.2113 (1.0) 507.2113 (1.0) 507.2113 (1.0) 0.0000 (1.0) 507.2113 (1.0) 0.0000 (1.0) 0;0 1.9716 (1.0) 1 1
test_sharing_azure-pull-noop[2.11.0] 512.9868 (1.01) 512.9868 (1.01) 512.9868 (1.01) 0.0000 (1.0) 512.9868 (1.01) 0.0000 (1.0) 0;0 1.9494 (0.99) 1 1
test_sharing_azure-pull-noop[2.40.0] 605.2991 (1.19) 605.2991 (1.19) 605.2991 (1.19) 0.0000 (1.0) 605.2991 (1.19) 0.0000 (1.0) 0;0 1.6521 (0.84) 1 1
test_sharing_azure-pull-noop[2.40.0] 588.7855 (1.16) 588.7855 (1.16) 588.7855 (1.16) 0.0000 (1.0) 588.7855 (1.16) 0.0000 (1.0) 0;0 1.6984 (0.86) 1 1
test_sharing_azure-pull-noop[2.58.2] 683.3106 (1.35) 683.3106 (1.35) 683.3106 (1.35) 0.0000 (1.0) 683.3106 (1.35) 0.0000 (1.0) 0;0 1.4635 (0.74) 1 1
test_sharing_azure-pull-noop[2.58.2] 670.8335 (1.32) 670.8335 (1.32) 670.8335 (1.32) 0.0000 (1.0) 670.8335 (1.32) 0.0000 (1.0) 0;0 1.4907 (0.76) 1 1
test_sharing_azure-pull-noop[3.0.0] 775.3515 (1.53) 775.3515 (1.53) 775.3515 (1.53) 0.0000 (1.0) 775.3515 (1.53) 0.0000 (1.0) 0;0 1.2897 (0.65) 1 1
test_sharing_azure-pull-noop[3.0.0] 775.3343 (1.53) 775.3343 (1.53) 775.3343 (1.53) 0.0000 (1.0) 775.3343 (1.53) 0.0000 (1.0) 0;0 1.2898 (0.65) 1 1
test_sharing_azure-pull-noop[main] 779.9216 (1.54) 779.9216 (1.54) 779.9216 (1.54) 0.0000 (1.0) 779.9216 (1.54) 0.0000 (1.0) 0;0 1.2822 (0.65) 1 1
test_sharing_azure-pull-noop[main] 772.2793 (1.52) 772.2793 (1.52) 772.2793 (1.52) 0.0000 (1.0) 772.2793 (1.52) 0.0000 (1.0) 0;0 1.2949 (0.66) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.11.0] 3.6833 (2.42) 3.6833 (2.42) 3.6833 (2.42) 0.0000 (1.0) 3.6833 (2.42) 0.0000 (1.0) 0;0 0.2715 (0.41) 1 1
test_sharing_azure-push[2.11.0] 3.6782 (2.41) 3.6782 (2.41) 3.6782 (2.41) 0.0000 (1.0) 3.6782 (2.41) 0.0000 (1.0) 0;0 0.2719 (0.41) 1 1
test_sharing_azure-push[2.40.0] 4.8216 (3.16) 4.8216 (3.16) 4.8216 (3.16) 0.0000 (1.0) 4.8216 (3.16) 0.0000 (1.0) 0;0 0.2074 (0.32) 1 1
test_sharing_azure-push[2.40.0] 4.7783 (3.13) 4.7783 (3.13) 4.7783 (3.13) 0.0000 (1.0) 4.7783 (3.13) 0.0000 (1.0) 0;0 0.2093 (0.32) 1 1
test_sharing_azure-push[2.58.2] 3.2826 (2.15) 3.2826 (2.15) 3.2826 (2.15) 0.0000 (1.0) 3.2826 (2.15) 0.0000 (1.0) 0;0 0.3046 (0.46) 1 1
test_sharing_azure-push[2.58.2] 3.3217 (2.18) 3.3217 (2.18) 3.3217 (2.18) 0.0000 (1.0) 3.3217 (2.18) 0.0000 (1.0) 0;0 0.3011 (0.46) 1 1
test_sharing_azure-push[3.0.0] 1.6326 (1.07) 1.6326 (1.07) 1.6326 (1.07) 0.0000 (1.0) 1.6326 (1.07) 0.0000 (1.0) 0;0 0.6125 (0.93) 1 1
test_sharing_azure-push[3.0.0] 1.5250 (1.0) 1.5250 (1.0) 1.5250 (1.0) 0.0000 (1.0) 1.5250 (1.0) 0.0000 (1.0) 0;0 0.6557 (1.0) 1 1
test_sharing_azure-push[main] 3.2833 (2.15) 3.2833 (2.15) 3.2833 (2.15) 0.0000 (1.0) 3.2833 (2.15) 0.0000 (1.0) 0;0 0.3046 (0.46) 1 1
test_sharing_azure-push[main] 3.7633 (2.47) 3.7633 (2.47) 3.7633 (2.47) 0.0000 (1.0) 3.7633 (2.47) 0.0000 (1.0) 0;0 0.2657 (0.41) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.11.0] 437.2265 (1.02) 437.2265 (1.02) 437.2265 (1.02) 0.0000 (1.0) 437.2265 (1.02) 0.0000 (1.0) 0;0 2.2871 (0.98) 1 1
test_sharing_azure-push-noop[2.11.0] 429.8762 (1.0) 429.8762 (1.0) 429.8762 (1.0) 0.0000 (1.0) 429.8762 (1.0) 0.0000 (1.0) 0;0 2.3263 (1.0) 1 1
test_sharing_azure-push-noop[2.40.0] 472.9834 (1.10) 472.9834 (1.10) 472.9834 (1.10) 0.0000 (1.0) 472.9834 (1.10) 0.0000 (1.0) 0;0 2.1142 (0.91) 1 1
test_sharing_azure-push-noop[2.40.0] 462.8391 (1.08) 462.8391 (1.08) 462.8391 (1.08) 0.0000 (1.0) 462.8391 (1.08) 0.0000 (1.0) 0;0 2.1606 (0.93) 1 1
test_sharing_azure-push-noop[2.58.2] 529.1672 (1.23) 529.1672 (1.23) 529.1672 (1.23) 0.0000 (1.0) 529.1672 (1.23) 0.0000 (1.0) 0;0 1.8898 (0.81) 1 1
test_sharing_azure-push-noop[2.58.2] 508.5936 (1.18) 508.5936 (1.18) 508.5936 (1.18) 0.0000 (1.0) 508.5936 (1.18) 0.0000 (1.0) 0;0 1.9662 (0.85) 1 1
test_sharing_azure-push-noop[3.0.0] 522.5790 (1.22) 522.5790 (1.22) 522.5790 (1.22) 0.0000 (1.0) 522.5790 (1.22) 0.0000 (1.0) 0;0 1.9136 (0.82) 1 1
test_sharing_azure-push-noop[3.0.0] 503.4776 (1.17) 503.4776 (1.17) 503.4776 (1.17) 0.0000 (1.0) 503.4776 (1.17) 0.0000 (1.0) 0;0 1.9862 (0.85) 1 1
test_sharing_azure-push-noop[main] 523.3007 (1.22) 523.3007 (1.22) 523.3007 (1.22) 0.0000 (1.0) 523.3007 (1.22) 0.0000 (1.0) 0;0 1.9109 (0.82) 1 1
test_sharing_azure-push-noop[main] 499.1579 (1.16) 499.1579 (1.16) 499.1579 (1.16) 0.0000 (1.0) 499.1579 (1.16) 0.0000 (1.0) 0;0 2.0034 (0.86) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.40.0] 1.2078 (1.03) 1.2078 (1.03) 1.2078 (1.03) 0.0000 (1.0) 1.2078 (1.03) 0.0000 (1.0) 0;0 0.8280 (0.97) 1 1
test_data_status_all_flags-data-changed[2.58.2] 1.1942 (1.02) 1.1942 (1.02) 1.1942 (1.02) 0.0000 (1.0) 1.1942 (1.02) 0.0000 (1.0) 0;0 0.8374 (0.98) 1 1
test_data_status_all_flags-data-changed[3.0.0] 1.1847 (1.01) 1.1847 (1.01) 1.1847 (1.01) 0.0000 (1.0) 1.1847 (1.01) 0.0000 (1.0) 0;0 0.8441 (0.99) 1 1
test_data_status_all_flags-data-changed[main] 1.1676 (1.0) 1.1676 (1.0) 1.1676 (1.0) 0.0000 (1.0) 1.1676 (1.0) 0.0000 (1.0) 0;0 0.8564 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.40.0] 1.2112 (1.04) 1.2112 (1.04) 1.2112 (1.04) 0.0000 (1.0) 1.2112 (1.04) 0.0000 (1.0) 0;0 0.8256 (0.96) 1 1
test_data_status_all_flags-data-changed-noop[2.58.2] 1.1915 (1.02) 1.1915 (1.02) 1.1915 (1.02) 0.0000 (1.0) 1.1915 (1.02) 0.0000 (1.0) 0;0 0.8392 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[3.0.0] 1.1912 (1.02) 1.1912 (1.02) 1.1912 (1.02) 0.0000 (1.0) 1.1912 (1.02) 0.0000 (1.0) 0;0 0.8395 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.1647 (1.0) 1.1647 (1.0) 1.1647 (1.0) 0.0000 (1.0) 1.1647 (1.0) 0.0000 (1.0) 0;0 0.8586 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.40.0] 1.9652 (1.05) 1.9652 (1.05) 1.9652 (1.05) 0.0000 (1.0) 1.9652 (1.05) 0.0000 (1.0) 0;0 0.5089 (0.95) 1 1
test_data_status_all_flags-data-new[2.58.2] 2.1788 (1.16) 2.1788 (1.16) 2.1788 (1.16) 0.0000 (1.0) 2.1788 (1.16) 0.0000 (1.0) 0;0 0.4590 (0.86) 1 1
test_data_status_all_flags-data-new[3.0.0] 2.5479 (1.36) 2.5479 (1.36) 2.5479 (1.36) 0.0000 (1.0) 2.5479 (1.36) 0.0000 (1.0) 0;0 0.3925 (0.74) 1 1
test_data_status_all_flags-data-new[main] 1.8740 (1.0) 1.8740 (1.0) 1.8740 (1.0) 0.0000 (1.0) 1.8740 (1.0) 0.0000 (1.0) 0;0 0.5336 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.40.0] 1.1572 (1.01) 1.1572 (1.01) 1.1572 (1.01) 0.0000 (1.0) 1.1572 (1.01) 0.0000 (1.0) 0;0 0.8642 (0.99) 1 1
test_data_status_all_flags-data-noop[2.58.2] 1.1479 (1.00) 1.1479 (1.00) 1.1479 (1.00) 0.0000 (1.0) 1.1479 (1.00) 0.0000 (1.0) 0;0 0.8712 (1.00) 1 1
test_data_status_all_flags-data-noop[3.0.0] 1.1587 (1.01) 1.1587 (1.01) 1.1587 (1.01) 0.0000 (1.0) 1.1587 (1.01) 0.0000 (1.0) 0;0 0.8630 (0.99) 1 1
test_data_status_all_flags-data-noop[main] 1.1440 (1.0) 1.1440 (1.0) 1.1440 (1.0) 0.0000 (1.0) 1.1440 (1.0) 0.0000 (1.0) 0;0 0.8741 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 14.4953 (1.21) 14.4953 (1.21) 14.4953 (1.21) 0.0000 (1.0) 14.4953 (1.21) 0.0000 (1.0) 0;0 0.0690 (0.82) 1 1
test_import-import[2.40.0] 11.9454 (1.0) 11.9454 (1.0) 11.9454 (1.0) 0.0000 (1.0) 11.9454 (1.0) 0.0000 (1.0) 0;0 0.0837 (1.0) 1 1
test_import-import[2.58.2] 12.1551 (1.02) 12.1551 (1.02) 12.1551 (1.02) 0.0000 (1.0) 12.1551 (1.02) 0.0000 (1.0) 0;0 0.0823 (0.98) 1 1
test_import-import[3.0.0] 12.4612 (1.04) 12.4612 (1.04) 12.4612 (1.04) 0.0000 (1.0) 12.4612 (1.04) 0.0000 (1.0) 0;0 0.0802 (0.96) 1 1
test_import-import[main] 13.2546 (1.11) 13.2546 (1.11) 13.2546 (1.11) 0.0000 (1.0) 13.2546 (1.11) 0.0000 (1.0) 0;0 0.0754 (0.90) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 4.0319 (2.36) 4.0319 (2.36) 4.0319 (2.36) 0.0000 (1.0) 4.0319 (2.36) 0.0000 (1.0) 0;0 0.2480 (0.42) 1 1
test_push-push[2.40.0] 5.1055 (2.98) 5.1055 (2.98) 5.1055 (2.98) 0.0000 (1.0) 5.1055 (2.98) 0.0000 (1.0) 0;0 0.1959 (0.34) 1 1
test_push-push[2.58.2] 3.4883 (2.04) 3.4883 (2.04) 3.4883 (2.04) 0.0000 (1.0) 3.4883 (2.04) 0.0000 (1.0) 0;0 0.2867 (0.49) 1 1
test_push-push[3.0.0] 1.7110 (1.0) 1.7110 (1.0) 1.7110 (1.0) 0.0000 (1.0) 1.7110 (1.0) 0.0000 (1.0) 0;0 0.5844 (1.0) 1 1
test_push-push[main] 3.4750 (2.03) 3.4750 (2.03) 3.4750 (2.03) 0.0000 (1.0) 3.4750 (2.03) 0.0000 (1.0) 0;0 0.2878 (0.49) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0] 6.3800 (1.76) 6.3800 (1.76) 6.3800 (1.76) 0.0000 (1.0) 6.3800 (1.76) 0.0000 (1.0) 0;0 0.1567 (0.57) 1 1
test_sharing_s3-add[2.11.0] 6.3542 (1.76) 6.3542 (1.76) 6.3542 (1.76) 0.0000 (1.0) 6.3542 (1.76) 0.0000 (1.0) 0;0 0.1574 (0.57) 1 1
test_sharing_s3-add[2.40.0] 5.3389 (1.48) 5.3389 (1.48) 5.3389 (1.48) 0.0000 (1.0) 5.3389 (1.48) 0.0000 (1.0) 0;0 0.1873 (0.68) 1 1
test_sharing_s3-add[2.40.0] 5.7791 (1.60) 5.7791 (1.60) 5.7791 (1.60) 0.0000 (1.0) 5.7791 (1.60) 0.0000 (1.0) 0;0 0.1730 (0.63) 1 1
test_sharing_s3-add[2.58.2] 3.6298 (1.00) 3.6298 (1.00) 3.6298 (1.00) 0.0000 (1.0) 3.6298 (1.00) 0.0000 (1.0) 0;0 0.2755 (1.00) 1 1
test_sharing_s3-add[2.58.2] 3.6179 (1.0) 3.6179 (1.0) 3.6179 (1.0) 0.0000 (1.0) 3.6179 (1.0) 0.0000 (1.0) 0;0 0.2764 (1.0) 1 1
test_sharing_s3-add[3.0.0] 3.6423 (1.01) 3.6423 (1.01) 3.6423 (1.01) 0.0000 (1.0) 3.6423 (1.01) 0.0000 (1.0) 0;0 0.2746 (0.99) 1 1
test_sharing_s3-add[3.0.0] 3.7614 (1.04) 3.7614 (1.04) 3.7614 (1.04) 0.0000 (1.0) 3.7614 (1.04) 0.0000 (1.0) 0;0 0.2659 (0.96) 1 1
test_sharing_s3-add[main] 3.6328 (1.00) 3.6328 (1.00) 3.6328 (1.00) 0.0000 (1.0) 3.6328 (1.00) 0.0000 (1.0) 0;0 0.2753 (1.00) 1 1
test_sharing_s3-add[main] 3.6470 (1.01) 3.6470 (1.01) 3.6470 (1.01) 0.0000 (1.0) 3.6470 (1.01) 0.0000 (1.0) 0;0 0.2742 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0] 3.2229 (1.44) 3.2229 (1.44) 3.2229 (1.44) 0.0000 (1.0) 3.2229 (1.44) 0.0000 (1.0) 0;0 0.3103 (0.69) 1 1
test_sharing_s3-add-noop[2.11.0] 3.1995 (1.43) 3.1995 (1.43) 3.1995 (1.43) 0.0000 (1.0) 3.1995 (1.43) 0.0000 (1.0) 0;0 0.3125 (0.70) 1 1
test_sharing_s3-add-noop[2.40.0] 2.2638 (1.01) 2.2638 (1.01) 2.2638 (1.01) 0.0000 (1.0) 2.2638 (1.01) 0.0000 (1.0) 0;0 0.4417 (0.99) 1 1
test_sharing_s3-add-noop[2.40.0] 2.2355 (1.0) 2.2355 (1.0) 2.2355 (1.0) 0.0000 (1.0) 2.2355 (1.0) 0.0000 (1.0) 0;0 0.4473 (1.0) 1 1
test_sharing_s3-add-noop[2.58.2] 2.4491 (1.10) 2.4491 (1.10) 2.4491 (1.10) 0.0000 (1.0) 2.4491 (1.10) 0.0000 (1.0) 0;0 0.4083 (0.91) 1 1
test_sharing_s3-add-noop[2.58.2] 2.4107 (1.08) 2.4107 (1.08) 2.4107 (1.08) 0.0000 (1.0) 2.4107 (1.08) 0.0000 (1.0) 0;0 0.4148 (0.93) 1 1
test_sharing_s3-add-noop[3.0.0] 2.4245 (1.08) 2.4245 (1.08) 2.4245 (1.08) 0.0000 (1.0) 2.4245 (1.08) 0.0000 (1.0) 0;0 0.4125 (0.92) 1 1
test_sharing_s3-add-noop[3.0.0] 2.5454 (1.14) 2.5454 (1.14) 2.5454 (1.14) 0.0000 (1.0) 2.5454 (1.14) 0.0000 (1.0) 0;0 0.3929 (0.88) 1 1
test_sharing_s3-add-noop[main] 2.4263 (1.09) 2.4263 (1.09) 2.4263 (1.09) 0.0000 (1.0) 2.4263 (1.09) 0.0000 (1.0) 0;0 0.4121 (0.92) 1 1
test_sharing_s3-add-noop[main] 2.4252 (1.08) 2.4252 (1.08) 2.4252 (1.08) 0.0000 (1.0) 2.4252 (1.08) 0.0000 (1.0) 0;0 0.4123 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0] 481.0743 (1.0) 481.0743 (1.0) 481.0743 (1.0) 0.0000 (1.0) 481.0743 (1.0) 0.0000 (1.0) 0;0 2.0787 (1.0) 1 1
test_sharing_s3-checkout-noop[2.11.0] 488.0306 (1.01) 488.0306 (1.01) 488.0306 (1.01) 0.0000 (1.0) 488.0306 (1.01) 0.0000 (1.0) 0;0 2.0491 (0.99) 1 1
test_sharing_s3-checkout-noop[2.40.0] 560.9046 (1.17) 560.9046 (1.17) 560.9046 (1.17) 0.0000 (1.0) 560.9046 (1.17) 0.0000 (1.0) 0;0 1.7828 (0.86) 1 1
test_sharing_s3-checkout-noop[2.40.0] 558.7532 (1.16) 558.7532 (1.16) 558.7532 (1.16) 0.0000 (1.0) 558.7532 (1.16) 0.0000 (1.0) 0;0 1.7897 (0.86) 1 1
test_sharing_s3-checkout-noop[2.58.2] 616.1479 (1.28) 616.1479 (1.28) 616.1479 (1.28) 0.0000 (1.0) 616.1479 (1.28) 0.0000 (1.0) 0;0 1.6230 (0.78) 1 1
test_sharing_s3-checkout-noop[2.58.2] 621.9100 (1.29) 621.9100 (1.29) 621.9100 (1.29) 0.0000 (1.0) 621.9100 (1.29) 0.0000 (1.0) 0;0 1.6079 (0.77) 1 1
test_sharing_s3-checkout-noop[3.0.0] 843.5769 (1.75) 843.5769 (1.75) 843.5769 (1.75) 0.0000 (1.0) 843.5769 (1.75) 0.0000 (1.0) 0;0 1.1854 (0.57) 1 1
test_sharing_s3-checkout-noop[3.0.0] 817.4350 (1.70) 817.4350 (1.70) 817.4350 (1.70) 0.0000 (1.0) 817.4350 (1.70) 0.0000 (1.0) 0;0 1.2233 (0.59) 1 1
test_sharing_s3-checkout-noop[main] 639.7754 (1.33) 639.7754 (1.33) 639.7754 (1.33) 0.0000 (1.0) 639.7754 (1.33) 0.0000 (1.0) 0;0 1.5630 (0.75) 1 1
test_sharing_s3-checkout-noop[main] 646.9577 (1.34) 646.9577 (1.34) 646.9577 (1.34) 0.0000 (1.0) 646.9577 (1.34) 0.0000 (1.0) 0;0 1.5457 (0.74) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0] 13.3558 (1.33) 13.3558 (1.33) 13.3558 (1.33) 0.0000 (1.0) 13.3558 (1.33) 0.0000 (1.0) 0;0 0.0749 (0.75) 1 1
test_sharing_s3-pull[2.11.0] 13.3937 (1.33) 13.3937 (1.33) 13.3937 (1.33) 0.0000 (1.0) 13.3937 (1.33) 0.0000 (1.0) 0;0 0.0747 (0.75) 1 1
test_sharing_s3-pull[2.40.0] 14.5511 (1.45) 14.5511 (1.45) 14.5511 (1.45) 0.0000 (1.0) 14.5511 (1.45) 0.0000 (1.0) 0;0 0.0687 (0.69) 1 1
test_sharing_s3-pull[2.40.0] 14.8863 (1.48) 14.8863 (1.48) 14.8863 (1.48) 0.0000 (1.0) 14.8863 (1.48) 0.0000 (1.0) 0;0 0.0672 (0.68) 1 1
test_sharing_s3-pull[2.58.2] 10.0562 (1.0) 10.0562 (1.0) 10.0562 (1.0) 0.0000 (1.0) 10.0562 (1.0) 0.0000 (1.0) 0;0 0.0994 (1.0) 1 1
test_sharing_s3-pull[2.58.2] 10.1239 (1.01) 10.1239 (1.01) 10.1239 (1.01) 0.0000 (1.0) 10.1239 (1.01) 0.0000 (1.0) 0;0 0.0988 (0.99) 1 1
test_sharing_s3-pull[3.0.0] 12.1744 (1.21) 12.1744 (1.21) 12.1744 (1.21) 0.0000 (1.0) 12.1744 (1.21) 0.0000 (1.0) 0;0 0.0821 (0.83) 1 1
test_sharing_s3-pull[3.0.0] 11.9514 (1.19) 11.9514 (1.19) 11.9514 (1.19) 0.0000 (1.0) 11.9514 (1.19) 0.0000 (1.0) 0;0 0.0837 (0.84) 1 1
test_sharing_s3-pull[main] 11.8464 (1.18) 11.8464 (1.18) 11.8464 (1.18) 0.0000 (1.0) 11.8464 (1.18) 0.0000 (1.0) 0;0 0.0844 (0.85) 1 1
test_sharing_s3-pull[main] 12.0336 (1.20) 12.0336 (1.20) 12.0336 (1.20) 0.0000 (1.0) 12.0336 (1.20) 0.0000 (1.0) 0;0 0.0831 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0] 700.3734 (1.00) 700.3734 (1.00) 700.3734 (1.00) 0.0000 (1.0) 700.3734 (1.00) 0.0000 (1.0) 0;0 1.4278 (1.00) 1 1
test_sharing_s3-pull-noop[2.11.0] 699.3389 (1.0) 699.3389 (1.0) 699.3389 (1.0) 0.0000 (1.0) 699.3389 (1.0) 0.0000 (1.0) 0;0 1.4299 (1.0) 1 1
test_sharing_s3-pull-noop[2.40.0] 772.7711 (1.11) 772.7711 (1.11) 772.7711 (1.11) 0.0000 (1.0) 772.7711 (1.11) 0.0000 (1.0) 0;0 1.2940 (0.90) 1 1
test_sharing_s3-pull-noop[2.40.0] 775.4023 (1.11) 775.4023 (1.11) 775.4023 (1.11) 0.0000 (1.0) 775.4023 (1.11) 0.0000 (1.0) 0;0 1.2897 (0.90) 1 1
test_sharing_s3-pull-noop[2.58.2] 836.5964 (1.20) 836.5964 (1.20) 836.5964 (1.20) 0.0000 (1.0) 836.5964 (1.20) 0.0000 (1.0) 0;0 1.1953 (0.84) 1 1
test_sharing_s3-pull-noop[2.58.2] 837.3533 (1.20) 837.3533 (1.20) 837.3533 (1.20) 0.0000 (1.0) 837.3533 (1.20) 0.0000 (1.0) 0;0 1.1942 (0.84) 1 1
test_sharing_s3-pull-noop[3.0.0] 969.2744 (1.39) 969.2744 (1.39) 969.2744 (1.39) 0.0000 (1.0) 969.2744 (1.39) 0.0000 (1.0) 0;0 1.0317 (0.72) 1 1
test_sharing_s3-pull-noop[3.0.0] 969.1015 (1.39) 969.1015 (1.39) 969.1015 (1.39) 0.0000 (1.0) 969.1015 (1.39) 0.0000 (1.0) 0;0 1.0319 (0.72) 1 1
test_sharing_s3-pull-noop[main] 1,302.2566 (1.86) 1,302.2566 (1.86) 1,302.2566 (1.86) 0.0000 (1.0) 1,302.2566 (1.86) 0.0000 (1.0) 0;0 0.7679 (0.54) 1 1
test_sharing_s3-pull-noop[main] 1,315.5221 (1.88) 1,315.5221 (1.88) 1,315.5221 (1.88) 0.0000 (1.0) 1,315.5221 (1.88) 0.0000 (1.0) 0;0 0.7602 (0.53) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0] 21.0697 (2.59) 21.0697 (2.59) 21.0697 (2.59) 0.0000 (1.0) 21.0697 (2.59) 0.0000 (1.0) 0;0 0.0475 (0.39) 1 1
test_sharing_s3-push[2.11.0] 20.7601 (2.56) 20.7601 (2.56) 20.7601 (2.56) 0.0000 (1.0) 20.7601 (2.56) 0.0000 (1.0) 0;0 0.0482 (0.39) 1 1
test_sharing_s3-push[2.40.0] 22.6710 (2.79) 22.6710 (2.79) 22.6710 (2.79) 0.0000 (1.0) 22.6710 (2.79) 0.0000 (1.0) 0;0 0.0441 (0.36) 1 1
test_sharing_s3-push[2.40.0] 22.3223 (2.75) 22.3223 (2.75) 22.3223 (2.75) 0.0000 (1.0) 22.3223 (2.75) 0.0000 (1.0) 0;0 0.0448 (0.36) 1 1
test_sharing_s3-push[2.58.2] 9.2168 (1.13) 9.2168 (1.13) 9.2168 (1.13) 0.0000 (1.0) 9.2168 (1.13) 0.0000 (1.0) 0;0 0.1085 (0.88) 1 1
test_sharing_s3-push[2.58.2] 9.1719 (1.13) 9.1719 (1.13) 9.1719 (1.13) 0.0000 (1.0) 9.1719 (1.13) 0.0000 (1.0) 0;0 0.1090 (0.89) 1 1
test_sharing_s3-push[3.0.0] 8.1214 (1.0) 8.1214 (1.0) 8.1214 (1.0) 0.0000 (1.0) 8.1214 (1.0) 0.0000 (1.0) 0;0 0.1231 (1.0) 1 1
test_sharing_s3-push[3.0.0] 8.1222 (1.00) 8.1222 (1.00) 8.1222 (1.00) 0.0000 (1.0) 8.1222 (1.00) 0.0000 (1.0) 0;0 0.1231 (1.00) 1 1
test_sharing_s3-push[main] 9.1674 (1.13) 9.1674 (1.13) 9.1674 (1.13) 0.0000 (1.0) 9.1674 (1.13) 0.0000 (1.0) 0;0 0.1091 (0.89) 1 1
test_sharing_s3-push[main] 9.2913 (1.14) 9.2913 (1.14) 9.2913 (1.14) 0.0000 (1.0) 9.2913 (1.14) 0.0000 (1.0) 0;0 0.1076 (0.87) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0] 948.9789 (1.0) 948.9789 (1.0) 948.9789 (1.0) 0.0000 (1.0) 948.9789 (1.0) 0.0000 (1.0) 0;0 1.0538 (1.0) 1 1
test_sharing_s3-push-noop[2.11.0] 971.1864 (1.02) 971.1864 (1.02) 971.1864 (1.02) 0.0000 (1.0) 971.1864 (1.02) 0.0000 (1.0) 0;0 1.0297 (0.98) 1 1
test_sharing_s3-push-noop[2.40.0] 981.2291 (1.03) 981.2291 (1.03) 981.2291 (1.03) 0.0000 (1.0) 981.2291 (1.03) 0.0000 (1.0) 0;0 1.0191 (0.97) 1 1
test_sharing_s3-push-noop[2.40.0] 975.7039 (1.03) 975.7039 (1.03) 975.7039 (1.03) 0.0000 (1.0) 975.7039 (1.03) 0.0000 (1.0) 0;0 1.0249 (0.97) 1 1
test_sharing_s3-push-noop[2.58.2] 1,021.1128 (1.08) 1,021.1128 (1.08) 1,021.1128 (1.08) 0.0000 (1.0) 1,021.1128 (1.08) 0.0000 (1.0) 0;0 0.9793 (0.93) 1 1
test_sharing_s3-push-noop[2.58.2] 1,031.0885 (1.09) 1,031.0885 (1.09) 1,031.0885 (1.09) 0.0000 (1.0) 1,031.0885 (1.09) 0.0000 (1.0) 0;0 0.9698 (0.92) 1 1
test_sharing_s3-push-noop[3.0.0] 1,015.6288 (1.07) 1,015.6288 (1.07) 1,015.6288 (1.07) 0.0000 (1.0) 1,015.6288 (1.07) 0.0000 (1.0) 0;0 0.9846 (0.93) 1 1
test_sharing_s3-push-noop[3.0.0] 1,013.6966 (1.07) 1,013.6966 (1.07) 1,013.6966 (1.07) 0.0000 (1.0) 1,013.6966 (1.07) 0.0000 (1.0) 0;0 0.9865 (0.94) 1 1
test_sharing_s3-push-noop[main] 1,015.6042 (1.07) 1,015.6042 (1.07) 1,015.6042 (1.07) 0.0000 (1.0) 1,015.6042 (1.07) 0.0000 (1.0) 0;0 0.9846 (0.93) 1 1
test_sharing_s3-push-noop[main] 1,013.0033 (1.07) 1,013.0033 (1.07) 1,013.0033 (1.07) 0.0000 (1.0) 1,013.0033 (1.07) 0.0000 (1.0) 0;0 0.9872 (0.94) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 2.5864 (1.55) 2.5864 (1.55) 2.5864 (1.55) 0.0000 (1.0) 2.5864 (1.55) 0.0000 (1.0) 0;0 0.3866 (0.65) 1 1
test_status-status[2.40.0] 1.7111 (1.02) 1.7111 (1.02) 1.7111 (1.02) 0.0000 (1.0) 1.7111 (1.02) 0.0000 (1.0) 0;0 0.5844 (0.98) 1 1
test_status-status[2.58.2] 1.6972 (1.02) 1.6972 (1.02) 1.6972 (1.02) 0.0000 (1.0) 1.6972 (1.02) 0.0000 (1.0) 0;0 0.5892 (0.98) 1 1
test_status-status[3.0.0] 1.6701 (1.0) 1.6701 (1.0) 1.6701 (1.0) 0.0000 (1.0) 1.6701 (1.0) 0.0000 (1.0) 0;0 0.5988 (1.0) 1 1
test_status-status[main] 1.6775 (1.00) 1.6775 (1.00) 1.6775 (1.00) 0.0000 (1.0) 1.6775 (1.00) 0.0000 (1.0) 0;0 0.5961 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 1.8476 (2.88) 1.8476 (2.88) 1.8476 (2.88) 0.0000 (1.0) 1.8476 (2.88) 0.0000 (1.0) 0;0 0.5412 (0.35) 1 1
test_status-status-changed[2.40.0] 0.6426 (1.0) 0.6426 (1.0) 0.6426 (1.0) 0.0000 (1.0) 0.6426 (1.0) 0.0000 (1.0) 0;0 1.5561 (1.0) 1 1
test_status-status-changed[2.58.2] 0.7079 (1.10) 0.7079 (1.10) 0.7079 (1.10) 0.0000 (1.0) 0.7079 (1.10) 0.0000 (1.0) 0;0 1.4126 (0.91) 1 1
test_status-status-changed[3.0.0] 0.7146 (1.11) 0.7146 (1.11) 0.7146 (1.11) 0.0000 (1.0) 0.7146 (1.11) 0.0000 (1.0) 0;0 1.3995 (0.90) 1 1
test_status-status-changed[main] 0.7199 (1.12) 0.7199 (1.12) 0.7199 (1.12) 0.0000 (1.0) 0.7199 (1.12) 0.0000 (1.0) 0;0 1.3892 (0.89) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 795.7875 (1.24) 795.7875 (1.24) 795.7875 (1.24) 0.0000 (1.0) 795.7875 (1.24) 0.0000 (1.0) 0;0 1.2566 (0.81) 1 1
test_status-status-changed-noop[2.40.0] 642.2580 (1.0) 642.2580 (1.0) 642.2580 (1.0) 0.0000 (1.0) 642.2580 (1.0) 0.0000 (1.0) 0;0 1.5570 (1.0) 1 1
test_status-status-changed-noop[2.58.2] 721.5412 (1.12) 721.5412 (1.12) 721.5412 (1.12) 0.0000 (1.0) 721.5412 (1.12) 0.0000 (1.0) 0;0 1.3859 (0.89) 1 1
test_status-status-changed-noop[3.0.0] 713.5859 (1.11) 713.5859 (1.11) 713.5859 (1.11) 0.0000 (1.0) 713.5859 (1.11) 0.0000 (1.0) 0;0 1.4014 (0.90) 1 1
test_status-status-changed-noop[main] 719.9454 (1.12) 719.9454 (1.12) 719.9454 (1.12) 0.0000 (1.0) 719.9454 (1.12) 0.0000 (1.0) 0;0 1.3890 (0.89) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 509.3180 (1.0) 509.3180 (1.0) 509.3180 (1.0) 0.0000 (1.0) 509.3180 (1.0) 0.0000 (1.0) 0;0 1.9634 (1.0) 1 1
test_status-status-noop[2.40.0] 646.7838 (1.27) 646.7838 (1.27) 646.7838 (1.27) 0.0000 (1.0) 646.7838 (1.27) 0.0000 (1.0) 0;0 1.5461 (0.79) 1 1
test_status-status-noop[2.58.2] 717.6434 (1.41) 717.6434 (1.41) 717.6434 (1.41) 0.0000 (1.0) 717.6434 (1.41) 0.0000 (1.0) 0;0 1.3934 (0.71) 1 1
test_status-status-noop[3.0.0] 714.6631 (1.40) 714.6631 (1.40) 714.6631 (1.40) 0.0000 (1.0) 714.6631 (1.40) 0.0000 (1.0) 0;0 1.3993 (0.71) 1 1
test_status-status-noop[main] 715.7778 (1.41) 715.7778 (1.41) 715.7778 (1.41) 0.0000 (1.0) 715.7778 (1.41) 0.0000 (1.0) 0;0 1.3971 (0.71) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.11.0] 9.9635 (1.37) 9.9635 (1.37) 9.9635 (1.37) 0.0000 (1.0) 9.9635 (1.37) 0.0000 (1.0) 0;0 0.1004 (0.73) 1 1
test_update-import-url[2.40.0] 8.8254 (1.22) 8.8254 (1.22) 8.8254 (1.22) 0.0000 (1.0) 8.8254 (1.22) 0.0000 (1.0) 0;0 0.1133 (0.82) 1 1
test_update-import-url[2.58.2] 7.3476 (1.01) 7.3476 (1.01) 7.3476 (1.01) 0.0000 (1.0) 7.3476 (1.01) 0.0000 (1.0) 0;0 0.1361 (0.99) 1 1
test_update-import-url[3.0.0] 7.2590 (1.0) 7.2590 (1.0) 7.2590 (1.0) 0.0000 (1.0) 7.2590 (1.0) 0.0000 (1.0) 0;0 0.1378 (1.0) 1 1
test_update-import-url[main] 7.4098 (1.02) 7.4098 (1.02) 7.4098 (1.02) 0.0000 (1.0) 7.4098 (1.02) 0.0000 (1.0) 0;0 0.1350 (0.98) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 8.0878 (1.34) 8.0878 (1.34) 8.0878 (1.34) 0.0000 (1.0) 8.0878 (1.34) 0.0000 (1.0) 0;0 0.1236 (0.75) 1 1
test_update-update[2.40.0] 6.0403 (1.0) 6.0403 (1.0) 6.0403 (1.0) 0.0000 (1.0) 6.0403 (1.0) 0.0000 (1.0) 0;0 0.1656 (1.0) 1 1
test_update-update[2.58.2] 6.4498 (1.07) 6.4498 (1.07) 6.4498 (1.07) 0.0000 (1.0) 6.4498 (1.07) 0.0000 (1.0) 0;0 0.1550 (0.94) 1 1
test_update-update[3.0.0] 6.4868 (1.07) 6.4868 (1.07) 6.4868 (1.07) 0.0000 (1.0) 6.4868 (1.07) 0.0000 (1.0) 0;0 0.1542 (0.93) 1 1
test_update-update[main] 6.6353 (1.10) 6.6353 (1.10) 6.6353 (1.10) 0.0000 (1.0) 6.6353 (1.10) 0.0000 (1.0) 0;0 0.1507 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 485.0945 (1.0) 485.0945 (1.0) 485.0945 (1.0) 0.0000 (1.0) 485.0945 (1.0) 0.0000 (1.0) 0;0 2.0615 (1.0) 1 1
test_update-update-noop[2.40.0] 899.4692 (1.85) 899.4692 (1.85) 899.4692 (1.85) 0.0000 (1.0) 899.4692 (1.85) 0.0000 (1.0) 0;0 1.1118 (0.54) 1 1
test_update-update-noop[2.58.2] 1,039.8063 (2.14) 1,039.8063 (2.14) 1,039.8063 (2.14) 0.0000 (1.0) 1,039.8063 (2.14) 0.0000 (1.0) 0;0 0.9617 (0.47) 1 1
test_update-update-noop[3.0.0] 1,059.7072 (2.18) 1,059.7072 (2.18) 1,059.7072 (2.18) 0.0000 (1.0) 1,059.7072 (2.18) 0.0000 (1.0) 0;0 0.9437 (0.46) 1 1
test_update-update-noop[main] 1,063.0753 (2.19) 1,063.0753 (2.19) 1,063.0753 (2.19) 0.0000 (1.0) 1,063.0753 (2.19) 0.0000 (1.0) 0;0 0.9407 (0.46) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
Bumps actions/checkout from 3 to 4.
Release notes
Sourced from actions/checkout's releases.
... (truncated)
Changelog
Sourced from actions/checkout's changelog.
... (truncated)
Commits
3df4ab1Release 4.0.0 (#1447)8b5e8b7Support fetching without the --progress option (#1067)97a652bUpdate default runtime to node20 (#1436)You can trigger a rebase of this PR by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show