Closed dependabot[bot] closed 10 months ago
Mon Sep 4 10:17:05 UTC 2023
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 6.9446 (1.75) 6.9446 (1.75) 6.9446 (1.75) 0.0000 (1.0) 6.9446 (1.75) 0.0000 (1.0) 0;0 0.1440 (0.57) 1 1
test_add-add[2.40.0] 5.9114 (1.49) 5.9114 (1.49) 5.9114 (1.49) 0.0000 (1.0) 5.9114 (1.49) 0.0000 (1.0) 0;0 0.1692 (0.67) 1 1
test_add-add[2.58.2] 4.2976 (1.08) 4.2976 (1.08) 4.2976 (1.08) 0.0000 (1.0) 4.2976 (1.08) 0.0000 (1.0) 0;0 0.2327 (0.92) 1 1
test_add-add[3.0.0] 4.1100 (1.03) 4.1100 (1.03) 4.1100 (1.03) 0.0000 (1.0) 4.1100 (1.03) 0.0000 (1.0) 0;0 0.2433 (0.97) 1 1
test_add-add[main] 3.9718 (1.0) 3.9718 (1.0) 3.9718 (1.0) 0.0000 (1.0) 3.9718 (1.0) 0.0000 (1.0) 0;0 0.2518 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.40.0] 1.0182 (1.05) 1.0182 (1.05) 1.0182 (1.05) 0.0000 (1.0) 1.0182 (1.05) 0.0000 (1.0) 0;0 0.9821 (0.95) 1 1
test_data_status-data-changed[2.58.2] 1.0068 (1.04) 1.0068 (1.04) 1.0068 (1.04) 0.0000 (1.0) 1.0068 (1.04) 0.0000 (1.0) 0;0 0.9933 (0.96) 1 1
test_data_status-data-changed[3.0.0] 1.0301 (1.06) 1.0301 (1.06) 1.0301 (1.06) 0.0000 (1.0) 1.0301 (1.06) 0.0000 (1.0) 0;0 0.9708 (0.94) 1 1
test_data_status-data-changed[main] 0.9704 (1.0) 0.9704 (1.0) 0.9704 (1.0) 0.0000 (1.0) 0.9704 (1.0) 0.0000 (1.0) 0;0 1.0305 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.40.0] 1.0034 (1.03) 1.0034 (1.03) 1.0034 (1.03) 0.0000 (1.0) 1.0034 (1.03) 0.0000 (1.0) 0;0 0.9966 (0.97) 1 1
test_data_status-data-changed-noop[2.58.2] 1.0251 (1.05) 1.0251 (1.05) 1.0251 (1.05) 0.0000 (1.0) 1.0251 (1.05) 0.0000 (1.0) 0;0 0.9755 (0.95) 1 1
test_data_status-data-changed-noop[3.0.0] 1.0214 (1.05) 1.0214 (1.05) 1.0214 (1.05) 0.0000 (1.0) 1.0214 (1.05) 0.0000 (1.0) 0;0 0.9790 (0.95) 1 1
test_data_status-data-changed-noop[main] 0.9725 (1.0) 0.9725 (1.0) 0.9725 (1.0) 0.0000 (1.0) 0.9725 (1.0) 0.0000 (1.0) 0;0 1.0283 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.40.0] 2.2266 (1.06) 2.2266 (1.06) 2.2266 (1.06) 0.0000 (1.0) 2.2266 (1.06) 0.0000 (1.0) 0;0 0.4491 (0.94) 1 1
test_data_status-data-new[2.58.2] 2.1030 (1.00) 2.1030 (1.00) 2.1030 (1.00) 0.0000 (1.0) 2.1030 (1.00) 0.0000 (1.0) 0;0 0.4755 (1.00) 1 1
test_data_status-data-new[3.0.0] 2.1146 (1.01) 2.1146 (1.01) 2.1146 (1.01) 0.0000 (1.0) 2.1146 (1.01) 0.0000 (1.0) 0;0 0.4729 (0.99) 1 1
test_data_status-data-new[main] 2.0982 (1.0) 2.0982 (1.0) 2.0982 (1.0) 0.0000 (1.0) 2.0982 (1.0) 0.0000 (1.0) 0;0 0.4766 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.40.0] 1.0052 (1.01) 1.0052 (1.01) 1.0052 (1.01) 0.0000 (1.0) 1.0052 (1.01) 0.0000 (1.0) 0;0 0.9948 (0.99) 1 1
test_data_status-data-noop[2.58.2] 0.9993 (1.0) 0.9993 (1.0) 0.9993 (1.0) 0.0000 (1.0) 0.9993 (1.0) 0.0000 (1.0) 0;0 1.0007 (1.0) 1 1
test_data_status-data-noop[3.0.0] 1.0378 (1.04) 1.0378 (1.04) 1.0378 (1.04) 0.0000 (1.0) 1.0378 (1.04) 0.0000 (1.0) 0;0 0.9635 (0.96) 1 1
test_data_status-data-noop[main] 1.0024 (1.00) 1.0024 (1.00) 1.0024 (1.00) 0.0000 (1.0) 1.0024 (1.00) 0.0000 (1.0) 0;0 0.9976 (1.00) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 7.2919 (1.28) 7.2919 (1.28) 7.2919 (1.28) 0.0000 (1.0) 7.2919 (1.28) 0.0000 (1.0) 0;0 0.1371 (0.78) 1 1
test_get-get[2.40.0] 5.6814 (1.0) 5.6814 (1.0) 5.6814 (1.0) 0.0000 (1.0) 5.6814 (1.0) 0.0000 (1.0) 0;0 0.1760 (1.0) 1 1
test_get-get[2.58.2] 8.8458 (1.56) 8.8458 (1.56) 8.8458 (1.56) 0.0000 (1.0) 8.8458 (1.56) 0.0000 (1.0) 0;0 0.1130 (0.64) 1 1
test_get-get[3.0.0] 9.0072 (1.59) 9.0072 (1.59) 9.0072 (1.59) 0.0000 (1.0) 9.0072 (1.59) 0.0000 (1.0) 0;0 0.1110 (0.63) 1 1
test_get-get[main] 10.5035 (1.85) 10.5035 (1.85) 10.5035 (1.85) 0.0000 (1.0) 10.5035 (1.85) 0.0000 (1.0) 0;0 0.0952 (0.54) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 3.9349 (1.49) 3.9349 (1.49) 3.9349 (1.49) 0.0000 (1.0) 3.9349 (1.49) 0.0000 (1.0) 0;0 0.2541 (0.67) 1 1
test_checkout_copy-checkout[2.40.0] 3.6827 (1.40) 3.6827 (1.40) 3.6827 (1.40) 0.0000 (1.0) 3.6827 (1.40) 0.0000 (1.0) 0;0 0.2715 (0.72) 1 1
test_checkout_copy-checkout[2.58.2] 2.6349 (1.0) 2.6349 (1.0) 2.6349 (1.0) 0.0000 (1.0) 2.6349 (1.0) 0.0000 (1.0) 0;0 0.3795 (1.0) 1 1
test_checkout_copy-checkout[3.0.0] 4.7017 (1.78) 4.7017 (1.78) 4.7017 (1.78) 0.0000 (1.0) 4.7017 (1.78) 0.0000 (1.0) 0;0 0.2127 (0.56) 1 1
test_checkout_copy-checkout[main] 4.5683 (1.73) 4.5683 (1.73) 4.5683 (1.73) 0.0000 (1.0) 4.5683 (1.73) 0.0000 (1.0) 0;0 0.2189 (0.58) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 595.2930 (1.0) 595.2930 (1.0) 595.2930 (1.0) 0.0000 (1.0) 595.2930 (1.0) 0.0000 (1.0) 0;0 1.6798 (1.0) 1 1
test_checkout_copy-checkout-noop[2.40.0] 652.6892 (1.10) 652.6892 (1.10) 652.6892 (1.10) 0.0000 (1.0) 652.6892 (1.10) 0.0000 (1.0) 0;0 1.5321 (0.91) 1 1
test_checkout_copy-checkout-noop[2.58.2] 807.2512 (1.36) 807.2512 (1.36) 807.2512 (1.36) 0.0000 (1.0) 807.2512 (1.36) 0.0000 (1.0) 0;0 1.2388 (0.74) 1 1
test_checkout_copy-checkout-noop[3.0.0] 794.1892 (1.33) 794.1892 (1.33) 794.1892 (1.33) 0.0000 (1.0) 794.1892 (1.33) 0.0000 (1.0) 0;0 1.2591 (0.75) 1 1
test_checkout_copy-checkout-noop[main] 787.3110 (1.32) 787.3110 (1.32) 787.3110 (1.32) 0.0000 (1.0) 787.3110 (1.32) 0.0000 (1.0) 0;0 1.2701 (0.76) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.5505 (2.04) 1.5505 (2.04) 1.5505 (2.04) 0.0000 (1.0) 1.5505 (2.04) 0.0000 (1.0) 0;0 0.6450 (0.49) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.7594 (1.0) 0.7594 (1.0) 0.7594 (1.0) 0.0000 (1.0) 0.7594 (1.0) 0.0000 (1.0) 0;0 1.3168 (1.0) 1 1
test_checkout_copy-checkout-update[2.58.2] 1.0247 (1.35) 1.0247 (1.35) 1.0247 (1.35) 0.0000 (1.0) 1.0247 (1.35) 0.0000 (1.0) 0;0 0.9759 (0.74) 1 1
test_checkout_copy-checkout-update[3.0.0] 0.9232 (1.22) 0.9232 (1.22) 0.9232 (1.22) 0.0000 (1.0) 0.9232 (1.22) 0.0000 (1.0) 0;0 1.0832 (0.82) 1 1
test_checkout_copy-checkout-update[main] 0.8651 (1.14) 0.8651 (1.14) 0.8651 (1.14) 0.0000 (1.0) 0.8651 (1.14) 0.0000 (1.0) 0;0 1.1559 (0.88) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 613.0380 (1.0) 613.0380 (1.0) 613.0380 (1.0) 0.0000 (1.0) 613.0380 (1.0) 0.0000 (1.0) 0;0 1.6312 (1.0) 1 1
test_gc-gc[2.40.0] 658.1499 (1.07) 658.1499 (1.07) 658.1499 (1.07) 0.0000 (1.0) 658.1499 (1.07) 0.0000 (1.0) 0;0 1.5194 (0.93) 1 1
test_gc-gc[2.58.2] 791.0257 (1.29) 791.0257 (1.29) 791.0257 (1.29) 0.0000 (1.0) 791.0257 (1.29) 0.0000 (1.0) 0;0 1.2642 (0.77) 1 1
test_gc-gc[3.0.0] 727.6945 (1.19) 727.6945 (1.19) 727.6945 (1.19) 0.0000 (1.0) 727.6945 (1.19) 0.0000 (1.0) 0;0 1.3742 (0.84) 1 1
test_gc-gc[main] 716.6569 (1.17) 716.6569 (1.17) 716.6569 (1.17) 0.0000 (1.0) 716.6569 (1.17) 0.0000 (1.0) 0;0 1.3954 (0.86) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 1.7832 (1.23) 1.7832 (1.23) 1.7832 (1.23) 0.0000 (1.0) 1.7832 (1.23) 0.0000 (1.0) 0;0 0.5608 (0.81) 1 1
test_checkout_symlink-checkout[2.40.0] 1.5640 (1.08) 1.5640 (1.08) 1.5640 (1.08) 0.0000 (1.0) 1.5640 (1.08) 0.0000 (1.0) 0;0 0.6394 (0.93) 1 1
test_checkout_symlink-checkout[2.58.2] 1.6831 (1.16) 1.6831 (1.16) 1.6831 (1.16) 0.0000 (1.0) 1.6831 (1.16) 0.0000 (1.0) 0;0 0.5941 (0.86) 1 1
test_checkout_symlink-checkout[3.0.0] 1.8648 (1.29) 1.8648 (1.29) 1.8648 (1.29) 0.0000 (1.0) 1.8648 (1.29) 0.0000 (1.0) 0;0 0.5363 (0.78) 1 1
test_checkout_symlink-checkout[main] 1.4494 (1.0) 1.4494 (1.0) 1.4494 (1.0) 0.0000 (1.0) 1.4494 (1.0) 0.0000 (1.0) 0;0 0.6900 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 559.3640 (1.0) 559.3640 (1.0) 559.3640 (1.0) 0.0000 (1.0) 559.3640 (1.0) 0.0000 (1.0) 0;0 1.7877 (1.0) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 685.1610 (1.22) 685.1610 (1.22) 685.1610 (1.22) 0.0000 (1.0) 685.1610 (1.22) 0.0000 (1.0) 0;0 1.4595 (0.82) 1 1
test_checkout_symlink-checkout-noop[2.58.2] 836.1389 (1.49) 836.1389 (1.49) 836.1389 (1.49) 0.0000 (1.0) 836.1389 (1.49) 0.0000 (1.0) 0;0 1.1960 (0.67) 1 1
test_checkout_symlink-checkout-noop[3.0.0] 854.8814 (1.53) 854.8814 (1.53) 854.8814 (1.53) 0.0000 (1.0) 854.8814 (1.53) 0.0000 (1.0) 0;0 1.1698 (0.65) 1 1
test_checkout_symlink-checkout-noop[main] 800.9033 (1.43) 800.9033 (1.43) 800.9033 (1.43) 0.0000 (1.0) 800.9033 (1.43) 0.0000 (1.0) 0;0 1.2486 (0.70) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 1.5915 (2.05) 1.5915 (2.05) 1.5915 (2.05) 0.0000 (1.0) 1.5915 (2.05) 0.0000 (1.0) 0;0 0.6284 (0.49) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.7759 (1.0) 0.7759 (1.0) 0.7759 (1.0) 0.0000 (1.0) 0.7759 (1.0) 0.0000 (1.0) 0;0 1.2889 (1.0) 1 1
test_checkout_symlink-checkout-update[2.58.2] 1.0151 (1.31) 1.0151 (1.31) 1.0151 (1.31) 0.0000 (1.0) 1.0151 (1.31) 0.0000 (1.0) 0;0 0.9851 (0.76) 1 1
test_checkout_symlink-checkout-update[3.0.0] 0.9704 (1.25) 0.9704 (1.25) 0.9704 (1.25) 0.0000 (1.0) 0.9704 (1.25) 0.0000 (1.0) 0;0 1.0305 (0.80) 1 1
test_checkout_symlink-checkout-update[main] 0.8618 (1.11) 0.8618 (1.11) 0.8618 (1.11) 0.0000 (1.0) 0.8618 (1.11) 0.0000 (1.0) 0;0 1.1603 (0.90) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_pull-pull': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 10.3397 (1.29) 10.3397 (1.29) 10.3397 (1.29) 0.0000 (1.0) 10.3397 (1.29) 0.0000 (1.0) 0;0 0.0967 (0.77) 1 1
test_pull-pull[2.40.0] 12.2539 (1.53) 12.2539 (1.53) 12.2539 (1.53) 0.0000 (1.0) 12.2539 (1.53) 0.0000 (1.0) 0;0 0.0816 (0.65) 1 1
test_pull-pull[2.58.2] 8.0003 (1.0) 8.0003 (1.0) 8.0003 (1.0) 0.0000 (1.0) 8.0003 (1.0) 0.0000 (1.0) 0;0 0.1250 (1.0) 1 1
test_pull-pull[3.0.0] 11.7527 (1.47) 11.7527 (1.47) 11.7527 (1.47) 0.0000 (1.0) 11.7527 (1.47) 0.0000 (1.0) 0;0 0.0851 (0.68) 1 1
test_pull-pull[main] 11.1841 (1.40) 11.1841 (1.40) 11.1841 (1.40) 0.0000 (1.0) 11.1841 (1.40) 0.0000 (1.0) 0;0 0.0894 (0.72) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 6.6128 (1.82) 6.6128 (1.82) 6.6128 (1.82) 0.0000 (1.0) 6.6128 (1.82) 0.0000 (1.0) 0;0 0.1512 (0.55) 1 1
test_sharing-add[2.40.0] 5.4199 (1.49) 5.4199 (1.49) 5.4199 (1.49) 0.0000 (1.0) 5.4199 (1.49) 0.0000 (1.0) 0;0 0.1845 (0.67) 1 1
test_sharing-add[2.58.2] 3.8065 (1.05) 3.8065 (1.05) 3.8065 (1.05) 0.0000 (1.0) 3.8065 (1.05) 0.0000 (1.0) 0;0 0.2627 (0.96) 1 1
test_sharing-add[3.0.0] 3.9998 (1.10) 3.9998 (1.10) 3.9998 (1.10) 0.0000 (1.0) 3.9998 (1.10) 0.0000 (1.0) 0;0 0.2500 (0.91) 1 1
test_sharing-add[main] 3.6393 (1.0) 3.6393 (1.0) 3.6393 (1.0) 0.0000 (1.0) 3.6393 (1.0) 0.0000 (1.0) 0;0 0.2748 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 3.2510 (1.44) 3.2510 (1.44) 3.2510 (1.44) 0.0000 (1.0) 3.2510 (1.44) 0.0000 (1.0) 0;0 0.3076 (0.70) 1 1
test_sharing-add-noop[2.40.0] 2.2601 (1.0) 2.2601 (1.0) 2.2601 (1.0) 0.0000 (1.0) 2.2601 (1.0) 0.0000 (1.0) 0;0 0.4425 (1.0) 1 1
test_sharing-add-noop[2.58.2] 2.4405 (1.08) 2.4405 (1.08) 2.4405 (1.08) 0.0000 (1.0) 2.4405 (1.08) 0.0000 (1.0) 0;0 0.4098 (0.93) 1 1
test_sharing-add-noop[3.0.0] 2.4531 (1.09) 2.4531 (1.09) 2.4531 (1.09) 0.0000 (1.0) 2.4531 (1.09) 0.0000 (1.0) 0;0 0.4076 (0.92) 1 1
test_sharing-add-noop[main] 2.4556 (1.09) 2.4556 (1.09) 2.4556 (1.09) 0.0000 (1.0) 2.4556 (1.09) 0.0000 (1.0) 0;0 0.4072 (0.92) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 483.8601 (1.0) 483.8601 (1.0) 483.8601 (1.0) 0.0000 (1.0) 483.8601 (1.0) 0.0000 (1.0) 0;0 2.0667 (1.0) 1 1
test_sharing-checkout-noop[2.40.0] 566.2831 (1.17) 566.2831 (1.17) 566.2831 (1.17) 0.0000 (1.0) 566.2831 (1.17) 0.0000 (1.0) 0;0 1.7659 (0.85) 1 1
test_sharing-checkout-noop[2.58.2] 634.0162 (1.31) 634.0162 (1.31) 634.0162 (1.31) 0.0000 (1.0) 634.0162 (1.31) 0.0000 (1.0) 0;0 1.5772 (0.76) 1 1
test_sharing-checkout-noop[3.0.0] 653.5905 (1.35) 653.5905 (1.35) 653.5905 (1.35) 0.0000 (1.0) 653.5905 (1.35) 0.0000 (1.0) 0;0 1.5300 (0.74) 1 1
test_sharing-checkout-noop[main] 643.6926 (1.33) 643.6926 (1.33) 643.6926 (1.33) 0.0000 (1.0) 643.6926 (1.33) 0.0000 (1.0) 0;0 1.5535 (0.75) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-pull': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 6.6246 (1.32) 6.6246 (1.32) 6.6246 (1.32) 0.0000 (1.0) 6.6246 (1.32) 0.0000 (1.0) 0;0 0.1510 (0.76) 1 1
test_sharing-pull[2.40.0] 7.8145 (1.56) 7.8145 (1.56) 7.8145 (1.56) 0.0000 (1.0) 7.8145 (1.56) 0.0000 (1.0) 0;0 0.1280 (0.64) 1 1
test_sharing-pull[2.58.2] 5.0151 (1.0) 5.0151 (1.0) 5.0151 (1.0) 0.0000 (1.0) 5.0151 (1.0) 0.0000 (1.0) 0;0 0.1994 (1.0) 1 1
test_sharing-pull[3.0.0] 7.2059 (1.44) 7.2059 (1.44) 7.2059 (1.44) 0.0000 (1.0) 7.2059 (1.44) 0.0000 (1.0) 0;0 0.1388 (0.70) 1 1
test_sharing-pull[main] 7.1508 (1.43) 7.1508 (1.43) 7.1508 (1.43) 0.0000 (1.0) 7.1508 (1.43) 0.0000 (1.0) 0;0 0.1398 (0.70) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 517.1591 (1.0) 517.1591 (1.0) 517.1591 (1.0) 0.0000 (1.0) 517.1591 (1.0) 0.0000 (1.0) 0;0 1.9336 (1.0) 1 1
test_sharing-pull-noop[2.40.0] 605.1575 (1.17) 605.1575 (1.17) 605.1575 (1.17) 0.0000 (1.0) 605.1575 (1.17) 0.0000 (1.0) 0;0 1.6525 (0.85) 1 1
test_sharing-pull-noop[2.58.2] 679.1987 (1.31) 679.1987 (1.31) 679.1987 (1.31) 0.0000 (1.0) 679.1987 (1.31) 0.0000 (1.0) 0;0 1.4723 (0.76) 1 1
test_sharing-pull-noop[3.0.0] 788.7674 (1.53) 788.7674 (1.53) 788.7674 (1.53) 0.0000 (1.0) 788.7674 (1.53) 0.0000 (1.0) 0;0 1.2678 (0.66) 1 1
test_sharing-pull-noop[main] 784.0721 (1.52) 784.0721 (1.52) 784.0721 (1.52) 0.0000 (1.0) 784.0721 (1.52) 0.0000 (1.0) 0;0 1.2754 (0.66) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 3.7023 (2.21) 3.7023 (2.21) 3.7023 (2.21) 0.0000 (1.0) 3.7023 (2.21) 0.0000 (1.0) 0;0 0.2701 (0.45) 1 1
test_sharing-push[2.40.0] 4.7930 (2.86) 4.7930 (2.86) 4.7930 (2.86) 0.0000 (1.0) 4.7930 (2.86) 0.0000 (1.0) 0;0 0.2086 (0.35) 1 1
test_sharing-push[2.58.2] 3.2618 (1.95) 3.2618 (1.95) 3.2618 (1.95) 0.0000 (1.0) 3.2618 (1.95) 0.0000 (1.0) 0;0 0.3066 (0.51) 1 1
test_sharing-push[3.0.0] 1.6767 (1.0) 1.6767 (1.0) 1.6767 (1.0) 0.0000 (1.0) 1.6767 (1.0) 0.0000 (1.0) 0;0 0.5964 (1.0) 1 1
test_sharing-push[main] 3.2554 (1.94) 3.2554 (1.94) 3.2554 (1.94) 0.0000 (1.0) 3.2554 (1.94) 0.0000 (1.0) 0;0 0.3072 (0.52) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 430.5413 (1.0) 430.5413 (1.0) 430.5413 (1.0) 0.0000 (1.0) 430.5413 (1.0) 0.0000 (1.0) 0;0 2.3227 (1.0) 1 1
test_sharing-push-noop[2.40.0] 466.6364 (1.08) 466.6364 (1.08) 466.6364 (1.08) 0.0000 (1.0) 466.6364 (1.08) 0.0000 (1.0) 0;0 2.1430 (0.92) 1 1
test_sharing-push-noop[2.58.2] 520.4212 (1.21) 520.4212 (1.21) 520.4212 (1.21) 0.0000 (1.0) 520.4212 (1.21) 0.0000 (1.0) 0;0 1.9215 (0.83) 1 1
test_sharing-push-noop[3.0.0] 518.9170 (1.21) 518.9170 (1.21) 518.9170 (1.21) 0.0000 (1.0) 518.9170 (1.21) 0.0000 (1.0) 0;0 1.9271 (0.83) 1 1
test_sharing-push-noop[main] 518.5048 (1.20) 518.5048 (1.20) 518.5048 (1.20) 0.0000 (1.0) 518.5048 (1.20) 0.0000 (1.0) 0;0 1.9286 (0.83) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 2.4503 (1.23) 2.4503 (1.23) 2.4503 (1.23) 0.0000 (1.0) 2.4503 (1.23) 0.0000 (1.0) 0;0 0.4081 (0.82) 1 1
test_diff-diff[2.40.0] 1.9978 (1.0) 1.9978 (1.0) 1.9978 (1.0) 0.0000 (1.0) 1.9978 (1.0) 0.0000 (1.0) 0;0 0.5006 (1.0) 1 1
test_diff-diff[2.58.2] 2.1564 (1.08) 2.1564 (1.08) 2.1564 (1.08) 0.0000 (1.0) 2.1564 (1.08) 0.0000 (1.0) 0;0 0.4637 (0.93) 1 1
test_diff-diff[3.0.0] 2.0356 (1.02) 2.0356 (1.02) 2.0356 (1.02) 0.0000 (1.0) 2.0356 (1.02) 0.0000 (1.0) 0;0 0.4913 (0.98) 1 1
test_diff-diff[main] 2.1461 (1.07) 2.1461 (1.07) 2.1461 (1.07) 0.0000 (1.0) 2.1461 (1.07) 0.0000 (1.0) 0;0 0.4660 (0.93) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.5734 (1.68) 1.5734 (1.68) 1.5734 (1.68) 0.0000 (1.0) 1.5734 (1.68) 0.0000 (1.0) 0;0 0.6356 (0.60) 1 1
test_diff-diff-changed[2.40.0] 0.9386 (1.0) 0.9386 (1.0) 0.9386 (1.0) 0.0000 (1.0) 0.9386 (1.0) 0.0000 (1.0) 0;0 1.0654 (1.0) 1 1
test_diff-diff-changed[2.58.2] 1.0778 (1.15) 1.0778 (1.15) 1.0778 (1.15) 0.0000 (1.0) 1.0778 (1.15) 0.0000 (1.0) 0;0 0.9278 (0.87) 1 1
test_diff-diff-changed[3.0.0] 1.1315 (1.21) 1.1315 (1.21) 1.1315 (1.21) 0.0000 (1.0) 1.1315 (1.21) 0.0000 (1.0) 0;0 0.8838 (0.83) 1 1
test_diff-diff-changed[main] 1.0761 (1.15) 1.0761 (1.15) 1.0761 (1.15) 0.0000 (1.0) 1.0761 (1.15) 0.0000 (1.0) 0;0 0.9293 (0.87) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 646.5915 (1.0) 646.5915 (1.0) 646.5915 (1.0) 0.0000 (1.0) 646.5915 (1.0) 0.0000 (1.0) 0;0 1.5466 (1.0) 1 1
test_diff-diff-changed-noop[2.40.0] 921.1783 (1.42) 921.1783 (1.42) 921.1783 (1.42) 0.0000 (1.0) 921.1783 (1.42) 0.0000 (1.0) 0;0 1.0856 (0.70) 1 1
test_diff-diff-changed-noop[2.58.2] 1,025.5123 (1.59) 1,025.5123 (1.59) 1,025.5123 (1.59) 0.0000 (1.0) 1,025.5123 (1.59) 0.0000 (1.0) 0;0 0.9751 (0.63) 1 1
test_diff-diff-changed-noop[3.0.0] 1,037.5223 (1.60) 1,037.5223 (1.60) 1,037.5223 (1.60) 0.0000 (1.0) 1,037.5223 (1.60) 0.0000 (1.0) 0;0 0.9638 (0.62) 1 1
test_diff-diff-changed-noop[main] 1,004.8763 (1.55) 1,004.8763 (1.55) 1,004.8763 (1.55) 0.0000 (1.0) 1,004.8763 (1.55) 0.0000 (1.0) 0;0 0.9951 (0.64) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 603.6723 (1.0) 603.6723 (1.0) 603.6723 (1.0) 0.0000 (1.0) 603.6723 (1.0) 0.0000 (1.0) 0;0 1.6565 (1.0) 1 1
test_diff-diff-noop[2.40.0] 876.2140 (1.45) 876.2140 (1.45) 876.2140 (1.45) 0.0000 (1.0) 876.2140 (1.45) 0.0000 (1.0) 0;0 1.1413 (0.69) 1 1
test_diff-diff-noop[2.58.2] 955.7772 (1.58) 955.7772 (1.58) 955.7772 (1.58) 0.0000 (1.0) 955.7772 (1.58) 0.0000 (1.0) 0;0 1.0463 (0.63) 1 1
test_diff-diff-noop[3.0.0] 954.1528 (1.58) 954.1528 (1.58) 954.1528 (1.58) 0.0000 (1.0) 954.1528 (1.58) 0.0000 (1.0) 0;0 1.0481 (0.63) 1 1
test_diff-diff-noop[main] 985.6970 (1.63) 985.6970 (1.63) 985.6970 (1.63) 0.0000 (1.0) 985.6970 (1.63) 0.0000 (1.0) 0;0 1.0145 (0.61) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 17.1389 (1.41) 17.1389 (1.41) 17.1389 (1.41) 0.0000 (1.0) 17.1389 (1.41) 0.0000 (1.0) 0;0 0.0583 (0.71) 1 1
test_import_url-import-url[2.40.0] 14.7843 (1.22) 14.7843 (1.22) 14.7843 (1.22) 0.0000 (1.0) 14.7843 (1.22) 0.0000 (1.0) 0;0 0.0676 (0.82) 1 1
test_import_url-import-url[2.58.2] 12.5369 (1.03) 12.5369 (1.03) 12.5369 (1.03) 0.0000 (1.0) 12.5369 (1.03) 0.0000 (1.0) 0;0 0.0798 (0.97) 1 1
test_import_url-import-url[3.0.0] 12.7441 (1.05) 12.7441 (1.05) 12.7441 (1.05) 0.0000 (1.0) 12.7441 (1.05) 0.0000 (1.0) 0;0 0.0785 (0.95) 1 1
test_import_url-import-url[main] 12.1205 (1.0) 12.1205 (1.0) 12.1205 (1.0) 0.0000 (1.0) 12.1205 (1.0) 0.0000 (1.0) 0;0 0.0825 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.40.0] 730.2960 (1.03) 759.7020 (1.05) 742.6355 (1.03) 12.6448 (1.95) 738.2045 (1.02) 21.4370 (2.90) 1;0 1.3466 (0.97) 5 3
test_plots-plots-diff[2.58.2] 707.5056 (1.0) 723.9134 (1.0) 718.3465 (1.0) 6.4715 (1.0) 720.2924 (1.0) 7.4021 (1.0) 1;0 1.3921 (1.0) 5 3
test_plots-plots-diff[3.0.0] 1,276.8189 (1.80) 1,309.5881 (1.81) 1,300.9122 (1.81) 13.7615 (2.13) 1,307.8900 (1.82) 12.6231 (1.71) 1;1 0.7687 (0.55) 5 3
test_plots-plots-diff[main] 1,305.9770 (1.85) 1,336.4919 (1.85) 1,316.3703 (1.83) 13.6816 (2.11) 1,308.3239 (1.82) 21.4452 (2.90) 1;0 0.7597 (0.55) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.40.0] 766.5531 (1.06) 784.2727 (1.04) 780.3279 (1.05) 7.7112 (1.0) 783.4107 (1.04) 4.9891 (1.0) 1;1 1.2815 (0.95) 5 3
test_plots-plots-diff-json[2.58.2] 721.7444 (1.0) 756.9189 (1.0) 743.2614 (1.0) 14.2902 (1.85) 750.7106 (1.0) 20.0061 (4.01) 1;0 1.3454 (1.0) 5 3
test_plots-plots-diff-json[3.0.0] 1,723.5064 (2.39) 1,765.8205 (2.33) 1,748.0361 (2.35) 16.2547 (2.11) 1,751.7512 (2.33) 22.2203 (4.45) 2;0 0.5721 (0.43) 5 3
test_plots-plots-diff-json[main] 1,746.8104 (2.42) 1,798.7646 (2.38) 1,783.7565 (2.40) 21.3169 (2.76) 1,790.1672 (2.38) 21.5886 (4.33) 1;0 0.5606 (0.42) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.40.0] 556.0185 (1.0) 589.3094 (1.0) 569.4823 (1.0) 12.4668 (1.06) 569.2621 (1.0) 13.9729 (1.0) 2;0 1.7560 (1.0) 5 3
test_plots-plots-show[2.58.2] 640.2239 (1.15) 676.5284 (1.15) 658.0176 (1.16) 16.5008 (1.41) 661.7718 (1.16) 30.4413 (2.18) 2;0 1.5197 (0.87) 5 3
test_plots-plots-show[3.0.0] 1,058.3262 (1.90) 1,087.8659 (1.85) 1,076.7545 (1.89) 11.7374 (1.0) 1,079.3906 (1.90) 16.2654 (1.16) 1;0 0.9287 (0.53) 5 3
test_plots-plots-show[main] 1,055.8381 (1.90) 1,145.6797 (1.94) 1,083.9478 (1.90) 38.5521 (3.28) 1,060.4729 (1.86) 51.3435 (3.67) 1;0 0.9226 (0.53) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.40.0] 618.6312 (1.0) 628.7709 (1.0) 623.5950 (1.0) 4.2990 (1.0) 625.1098 (1.0) 7.1228 (1.0) 2;0 1.6036 (1.0) 5 3
test_plots-plots-show-json[2.58.2] 670.6314 (1.08) 710.0020 (1.13) 684.2068 (1.10) 15.3972 (3.58) 681.6994 (1.09) 16.9701 (2.38) 1;0 1.4615 (0.91) 5 3
test_plots-plots-show-json[3.0.0] 1,320.8931 (2.14) 1,356.0960 (2.16) 1,341.5098 (2.15) 13.6243 (3.17) 1,341.0933 (2.15) 18.5058 (2.60) 2;0 0.7454 (0.46) 5 3
test_plots-plots-show-json[main] 1,342.6247 (2.17) 1,398.4647 (2.22) 1,367.2730 (2.19) 23.5313 (5.47) 1,359.2236 (2.17) 39.2494 (5.51) 2;0 0.7314 (0.46) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.11.0] 7.3182 (1.80) 7.3182 (1.80) 7.3182 (1.80) 0.0000 (1.0) 7.3182 (1.80) 0.0000 (1.0) 0;0 0.1366 (0.55) 1 1
test_sharing_gs-add[2.11.0] 8.7474 (2.15) 8.7474 (2.15) 8.7474 (2.15) 0.0000 (1.0) 8.7474 (2.15) 0.0000 (1.0) 0;0 0.1143 (0.46) 1 1
test_sharing_gs-add[2.40.0] 5.9936 (1.48) 5.9936 (1.48) 5.9936 (1.48) 0.0000 (1.0) 5.9936 (1.48) 0.0000 (1.0) 0;0 0.1668 (0.68) 1 1
test_sharing_gs-add[2.40.0] 5.8931 (1.45) 5.8931 (1.45) 5.8931 (1.45) 0.0000 (1.0) 5.8931 (1.45) 0.0000 (1.0) 0;0 0.1697 (0.69) 1 1
test_sharing_gs-add[2.58.2] 4.1256 (1.02) 4.1256 (1.02) 4.1256 (1.02) 0.0000 (1.0) 4.1256 (1.02) 0.0000 (1.0) 0;0 0.2424 (0.98) 1 1
test_sharing_gs-add[2.58.2] 4.0808 (1.01) 4.0808 (1.01) 4.0808 (1.01) 0.0000 (1.0) 4.0808 (1.01) 0.0000 (1.0) 0;0 0.2450 (0.99) 1 1
test_sharing_gs-add[3.0.0] 4.0719 (1.00) 4.0719 (1.00) 4.0719 (1.00) 0.0000 (1.0) 4.0719 (1.00) 0.0000 (1.0) 0;0 0.2456 (1.00) 1 1
test_sharing_gs-add[3.0.0] 4.0729 (1.00) 4.0729 (1.00) 4.0729 (1.00) 0.0000 (1.0) 4.0729 (1.00) 0.0000 (1.0) 0;0 0.2455 (1.00) 1 1
test_sharing_gs-add[main] 4.0602 (1.0) 4.0602 (1.0) 4.0602 (1.0) 0.0000 (1.0) 4.0602 (1.0) 0.0000 (1.0) 0;0 0.2463 (1.0) 1 1
test_sharing_gs-add[main] 4.2184 (1.04) 4.2184 (1.04) 4.2184 (1.04) 0.0000 (1.0) 4.2184 (1.04) 0.0000 (1.0) 0;0 0.2371 (0.96) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.11.0] 3.5754 (1.42) 3.5754 (1.42) 3.5754 (1.42) 0.0000 (1.0) 3.5754 (1.42) 0.0000 (1.0) 0;0 0.2797 (0.70) 1 1
test_sharing_gs-add-noop[2.11.0] 3.5398 (1.41) 3.5398 (1.41) 3.5398 (1.41) 0.0000 (1.0) 3.5398 (1.41) 0.0000 (1.0) 0;0 0.2825 (0.71) 1 1
test_sharing_gs-add-noop[2.40.0] 2.5438 (1.01) 2.5438 (1.01) 2.5438 (1.01) 0.0000 (1.0) 2.5438 (1.01) 0.0000 (1.0) 0;0 0.3931 (0.99) 1 1
test_sharing_gs-add-noop[2.40.0] 2.5126 (1.0) 2.5126 (1.0) 2.5126 (1.0) 0.0000 (1.0) 2.5126 (1.0) 0.0000 (1.0) 0;0 0.3980 (1.0) 1 1
test_sharing_gs-add-noop[2.58.2] 2.7178 (1.08) 2.7178 (1.08) 2.7178 (1.08) 0.0000 (1.0) 2.7178 (1.08) 0.0000 (1.0) 0;0 0.3680 (0.92) 1 1
test_sharing_gs-add-noop[2.58.2] 3.6573 (1.46) 3.6573 (1.46) 3.6573 (1.46) 0.0000 (1.0) 3.6573 (1.46) 0.0000 (1.0) 0;0 0.2734 (0.69) 1 1
test_sharing_gs-add-noop[3.0.0] 2.7073 (1.08) 2.7073 (1.08) 2.7073 (1.08) 0.0000 (1.0) 2.7073 (1.08) 0.0000 (1.0) 0;0 0.3694 (0.93) 1 1
test_sharing_gs-add-noop[3.0.0] 2.7419 (1.09) 2.7419 (1.09) 2.7419 (1.09) 0.0000 (1.0) 2.7419 (1.09) 0.0000 (1.0) 0;0 0.3647 (0.92) 1 1
test_sharing_gs-add-noop[main] 2.7375 (1.09) 2.7375 (1.09) 2.7375 (1.09) 0.0000 (1.0) 2.7375 (1.09) 0.0000 (1.0) 0;0 0.3653 (0.92) 1 1
test_sharing_gs-add-noop[main] 2.7202 (1.08) 2.7202 (1.08) 2.7202 (1.08) 0.0000 (1.0) 2.7202 (1.08) 0.0000 (1.0) 0;0 0.3676 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.11.0] 516.0990 (1.00) 516.0990 (1.00) 516.0990 (1.00) 0.0000 (1.0) 516.0990 (1.00) 0.0000 (1.0) 0;0 1.9376 (1.00) 1 1
test_sharing_gs-checkout-noop[2.11.0] 515.5013 (1.0) 515.5013 (1.0) 515.5013 (1.0) 0.0000 (1.0) 515.5013 (1.0) 0.0000 (1.0) 0;0 1.9399 (1.0) 1 1
test_sharing_gs-checkout-noop[2.40.0] 586.8589 (1.14) 586.8589 (1.14) 586.8589 (1.14) 0.0000 (1.0) 586.8589 (1.14) 0.0000 (1.0) 0;0 1.7040 (0.88) 1 1
test_sharing_gs-checkout-noop[2.40.0] 598.7535 (1.16) 598.7535 (1.16) 598.7535 (1.16) 0.0000 (1.0) 598.7535 (1.16) 0.0000 (1.0) 0;0 1.6701 (0.86) 1 1
test_sharing_gs-checkout-noop[2.58.2] 661.6547 (1.28) 661.6547 (1.28) 661.6547 (1.28) 0.0000 (1.0) 661.6547 (1.28) 0.0000 (1.0) 0;0 1.5114 (0.78) 1 1
test_sharing_gs-checkout-noop[2.58.2] 653.8442 (1.27) 653.8442 (1.27) 653.8442 (1.27) 0.0000 (1.0) 653.8442 (1.27) 0.0000 (1.0) 0;0 1.5294 (0.79) 1 1
test_sharing_gs-checkout-noop[3.0.0] 685.6687 (1.33) 685.6687 (1.33) 685.6687 (1.33) 0.0000 (1.0) 685.6687 (1.33) 0.0000 (1.0) 0;0 1.4584 (0.75) 1 1
test_sharing_gs-checkout-noop[3.0.0] 680.5008 (1.32) 680.5008 (1.32) 680.5008 (1.32) 0.0000 (1.0) 680.5008 (1.32) 0.0000 (1.0) 0;0 1.4695 (0.76) 1 1
test_sharing_gs-checkout-noop[main] 674.2667 (1.31) 674.2667 (1.31) 674.2667 (1.31) 0.0000 (1.0) 674.2667 (1.31) 0.0000 (1.0) 0;0 1.4831 (0.76) 1 1
test_sharing_gs-checkout-noop[main] 678.4835 (1.32) 678.4835 (1.32) 678.4835 (1.32) 0.0000 (1.0) 678.4835 (1.32) 0.0000 (1.0) 0;0 1.4739 (0.76) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-pull': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull[2.11.0] 7.3401 (1.34) 7.3401 (1.34) 7.3401 (1.34) 0.0000 (1.0) 7.3401 (1.34) 0.0000 (1.0) 0;0 0.1362 (0.75) 1 1
test_sharing_gs-pull[2.11.0] 7.3001 (1.33) 7.3001 (1.33) 7.3001 (1.33) 0.0000 (1.0) 7.3001 (1.33) 0.0000 (1.0) 0;0 0.1370 (0.75) 1 1
test_sharing_gs-pull[2.40.0] 8.6278 (1.57) 8.6278 (1.57) 8.6278 (1.57) 0.0000 (1.0) 8.6278 (1.57) 0.0000 (1.0) 0;0 0.1159 (0.64) 1 1
test_sharing_gs-pull[2.40.0] 8.8896 (1.62) 8.8896 (1.62) 8.8896 (1.62) 0.0000 (1.0) 8.8896 (1.62) 0.0000 (1.0) 0;0 0.1125 (0.62) 1 1
test_sharing_gs-pull[2.58.2] 5.4940 (1.0) 5.4940 (1.0) 5.4940 (1.0) 0.0000 (1.0) 5.4940 (1.0) 0.0000 (1.0) 0;0 0.1820 (1.0) 1 1
test_sharing_gs-pull[2.58.2] 5.5352 (1.01) 5.5352 (1.01) 5.5352 (1.01) 0.0000 (1.0) 5.5352 (1.01) 0.0000 (1.0) 0;0 0.1807 (0.99) 1 1
test_sharing_gs-pull[3.0.0] 7.8380 (1.43) 7.8380 (1.43) 7.8380 (1.43) 0.0000 (1.0) 7.8380 (1.43) 0.0000 (1.0) 0;0 0.1276 (0.70) 1 1
test_sharing_gs-pull[3.0.0] 7.8274 (1.42) 7.8274 (1.42) 7.8274 (1.42) 0.0000 (1.0) 7.8274 (1.42) 0.0000 (1.0) 0;0 0.1278 (0.70) 1 1
test_sharing_gs-pull[main] 7.9673 (1.45) 7.9673 (1.45) 7.9673 (1.45) 0.0000 (1.0) 7.9673 (1.45) 0.0000 (1.0) 0;0 0.1255 (0.69) 1 1
test_sharing_gs-pull[main] 7.8685 (1.43) 7.8685 (1.43) 7.8685 (1.43) 0.0000 (1.0) 7.8685 (1.43) 0.0000 (1.0) 0;0 0.1271 (0.70) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull-noop[2.11.0] 549.0022 (1.0) 549.0022 (1.0) 549.0022 (1.0) 0.0000 (1.0) 549.0022 (1.0) 0.0000 (1.0) 0;0 1.8215 (1.0) 1 1
test_sharing_gs-pull-noop[2.11.0] 551.9477 (1.01) 551.9477 (1.01) 551.9477 (1.01) 0.0000 (1.0) 551.9477 (1.01) 0.0000 (1.0) 0;0 1.8118 (0.99) 1 1
test_sharing_gs-pull-noop[2.40.0] 630.3521 (1.15) 630.3521 (1.15) 630.3521 (1.15) 0.0000 (1.0) 630.3521 (1.15) 0.0000 (1.0) 0;0 1.5864 (0.87) 1 1
test_sharing_gs-pull-noop[2.40.0] 639.5980 (1.17) 639.5980 (1.17) 639.5980 (1.17) 0.0000 (1.0) 639.5980 (1.17) 0.0000 (1.0) 0;0 1.5635 (0.86) 1 1
test_sharing_gs-pull-noop[2.58.2] 704.2967 (1.28) 704.2967 (1.28) 704.2967 (1.28) 0.0000 (1.0) 704.2967 (1.28) 0.0000 (1.0) 0;0 1.4199 (0.78) 1 1
test_sharing_gs-pull-noop[2.58.2] 708.3237 (1.29) 708.3237 (1.29) 708.3237 (1.29) 0.0000 (1.0) 708.3237 (1.29) 0.0000 (1.0) 0;0 1.4118 (0.78) 1 1
test_sharing_gs-pull-noop[3.0.0] 824.3897 (1.50) 824.3897 (1.50) 824.3897 (1.50) 0.0000 (1.0) 824.3897 (1.50) 0.0000 (1.0) 0;0 1.2130 (0.67) 1 1
test_sharing_gs-pull-noop[3.0.0] 823.4987 (1.50) 823.4987 (1.50) 823.4987 (1.50) 0.0000 (1.0) 823.4987 (1.50) 0.0000 (1.0) 0;0 1.2143 (0.67) 1 1
test_sharing_gs-pull-noop[main] 809.8743 (1.48) 809.8743 (1.48) 809.8743 (1.48) 0.0000 (1.0) 809.8743 (1.48) 0.0000 (1.0) 0;0 1.2348 (0.68) 1 1
test_sharing_gs-pull-noop[main] 823.0290 (1.50) 823.0290 (1.50) 823.0290 (1.50) 0.0000 (1.0) 823.0290 (1.50) 0.0000 (1.0) 0;0 1.2150 (0.67) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.11.0] 4.1870 (2.43) 4.1870 (2.43) 4.1870 (2.43) 0.0000 (1.0) 4.1870 (2.43) 0.0000 (1.0) 0;0 0.2388 (0.41) 1 1
test_sharing_gs-push[2.11.0] 4.0291 (2.34) 4.0291 (2.34) 4.0291 (2.34) 0.0000 (1.0) 4.0291 (2.34) 0.0000 (1.0) 0;0 0.2482 (0.43) 1 1
test_sharing_gs-push[2.40.0] 5.1557 (3.00) 5.1557 (3.00) 5.1557 (3.00) 0.0000 (1.0) 5.1557 (3.00) 0.0000 (1.0) 0;0 0.1940 (0.33) 1 1
test_sharing_gs-push[2.40.0] 5.1237 (2.98) 5.1237 (2.98) 5.1237 (2.98) 0.0000 (1.0) 5.1237 (2.98) 0.0000 (1.0) 0;0 0.1952 (0.34) 1 1
test_sharing_gs-push[2.58.2] 3.5142 (2.04) 3.5142 (2.04) 3.5142 (2.04) 0.0000 (1.0) 3.5142 (2.04) 0.0000 (1.0) 0;0 0.2846 (0.49) 1 1
test_sharing_gs-push[2.58.2] 3.5269 (2.05) 3.5269 (2.05) 3.5269 (2.05) 0.0000 (1.0) 3.5269 (2.05) 0.0000 (1.0) 0;0 0.2835 (0.49) 1 1
test_sharing_gs-push[3.0.0] 1.7205 (1.0) 1.7205 (1.0) 1.7205 (1.0) 0.0000 (1.0) 1.7205 (1.0) 0.0000 (1.0) 0;0 0.5812 (1.0) 1 1
test_sharing_gs-push[3.0.0] 2.1033 (1.22) 2.1033 (1.22) 2.1033 (1.22) 0.0000 (1.0) 2.1033 (1.22) 0.0000 (1.0) 0;0 0.4755 (0.82) 1 1
test_sharing_gs-push[main] 3.5283 (2.05) 3.5283 (2.05) 3.5283 (2.05) 0.0000 (1.0) 3.5283 (2.05) 0.0000 (1.0) 0;0 0.2834 (0.49) 1 1
test_sharing_gs-push[main] 3.5375 (2.06) 3.5375 (2.06) 3.5375 (2.06) 0.0000 (1.0) 3.5375 (2.06) 0.0000 (1.0) 0;0 0.2827 (0.49) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.11.0] 461.4610 (1.01) 461.4610 (1.01) 461.4610 (1.01) 0.0000 (1.0) 461.4610 (1.01) 0.0000 (1.0) 0;0 2.1670 (0.99) 1 1
test_sharing_gs-push-noop[2.11.0] 456.7538 (1.0) 456.7538 (1.0) 456.7538 (1.0) 0.0000 (1.0) 456.7538 (1.0) 0.0000 (1.0) 0;0 2.1894 (1.0) 1 1
test_sharing_gs-push-noop[2.40.0] 483.0645 (1.06) 483.0645 (1.06) 483.0645 (1.06) 0.0000 (1.0) 483.0645 (1.06) 0.0000 (1.0) 0;0 2.0701 (0.95) 1 1
test_sharing_gs-push-noop[2.40.0] 494.8492 (1.08) 494.8492 (1.08) 494.8492 (1.08) 0.0000 (1.0) 494.8492 (1.08) 0.0000 (1.0) 0;0 2.0208 (0.92) 1 1
test_sharing_gs-push-noop[2.58.2] 540.7812 (1.18) 540.7812 (1.18) 540.7812 (1.18) 0.0000 (1.0) 540.7812 (1.18) 0.0000 (1.0) 0;0 1.8492 (0.84) 1 1
test_sharing_gs-push-noop[2.58.2] 539.4869 (1.18) 539.4869 (1.18) 539.4869 (1.18) 0.0000 (1.0) 539.4869 (1.18) 0.0000 (1.0) 0;0 1.8536 (0.85) 1 1
test_sharing_gs-push-noop[3.0.0] 533.4858 (1.17) 533.4858 (1.17) 533.4858 (1.17) 0.0000 (1.0) 533.4858 (1.17) 0.0000 (1.0) 0;0 1.8745 (0.86) 1 1
test_sharing_gs-push-noop[3.0.0] 817.4576 (1.79) 817.4576 (1.79) 817.4576 (1.79) 0.0000 (1.0) 817.4576 (1.79) 0.0000 (1.0) 0;0 1.2233 (0.56) 1 1
test_sharing_gs-push-noop[main] 527.3940 (1.15) 527.3940 (1.15) 527.3940 (1.15) 0.0000 (1.0) 527.3940 (1.15) 0.0000 (1.0) 0;0 1.8961 (0.87) 1 1
test_sharing_gs-push-noop[main] 528.8746 (1.16) 528.8746 (1.16) 528.8746 (1.16) 0.0000 (1.0) 528.8746 (1.16) 0.0000 (1.0) 0;0 1.8908 (0.86) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 472.3045 (1.0) 566.6803 (1.0) 499.9766 (1.0) 16.1992 (1.0) 495.9781 (1.0) 22.6892 (1.0) 31;1 2.0001 (1.0) 100 1
test_init-init[2.40.0] 549.8548 (1.16) 688.4126 (1.21) 594.7209 (1.19) 24.7453 (1.53) 592.3937 (1.19) 27.2661 (1.20) 31;4 1.6815 (0.84) 100 1
test_init-init[2.58.2] 614.0346 (1.30) 735.8366 (1.30) 657.1665 (1.31) 24.7340 (1.53) 653.5299 (1.32) 32.6078 (1.44) 30;2 1.5217 (0.76) 100 1
test_init-init[3.0.0] 577.8935 (1.22) 741.9577 (1.31) 637.4841 (1.28) 26.0578 (1.61) 638.0170 (1.29) 28.7319 (1.27) 26;4 1.5687 (0.78) 100 1
test_init-init[main] 623.5932 (1.32) 766.8164 (1.35) 659.6124 (1.32) 22.8799 (1.41) 656.4793 (1.32) 24.6545 (1.09) 21;4 1.5160 (0.76) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 420.3327 (1.04) 420.3327 (1.04) 420.3327 (1.04) 0.0000 (1.0) 420.3327 (1.04) 0.0000 (1.0) 0;0 2.3791 (0.96) 1 1
test_list-list[2.40.0] 404.7331 (1.0) 404.7331 (1.0) 404.7331 (1.0) 0.0000 (1.0) 404.7331 (1.0) 0.0000 (1.0) 0;0 2.4708 (1.0) 1 1
test_list-list[2.58.2] 483.9590 (1.20) 483.9590 (1.20) 483.9590 (1.20) 0.0000 (1.0) 483.9590 (1.20) 0.0000 (1.0) 0;0 2.0663 (0.84) 1 1
test_list-list[3.0.0] 482.9229 (1.19) 482.9229 (1.19) 482.9229 (1.19) 0.0000 (1.0) 482.9229 (1.19) 0.0000 (1.0) 0;0 2.0707 (0.84) 1 1
test_list-list[main] 471.9822 (1.17) 471.9822 (1.17) 471.9822 (1.17) 0.0000 (1.0) 471.9822 (1.17) 0.0000 (1.0) 0;0 2.1187 (0.86) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 404.3274 (1.01) 404.3274 (1.01) 404.3274 (1.01) 0.0000 (1.0) 404.3274 (1.01) 0.0000 (1.0) 0;0 2.4732 (0.99) 1 1
test_list-list-dvc-only[2.40.0] 400.5021 (1.0) 400.5021 (1.0) 400.5021 (1.0) 0.0000 (1.0) 400.5021 (1.0) 0.0000 (1.0) 0;0 2.4969 (1.0) 1 1
test_list-list-dvc-only[2.58.2] 465.7361 (1.16) 465.7361 (1.16) 465.7361 (1.16) 0.0000 (1.0) 465.7361 (1.16) 0.0000 (1.0) 0;0 2.1471 (0.86) 1 1
test_list-list-dvc-only[3.0.0] 457.0116 (1.14) 457.0116 (1.14) 457.0116 (1.14) 0.0000 (1.0) 457.0116 (1.14) 0.0000 (1.0) 0;0 2.1881 (0.88) 1 1
test_list-list-dvc-only[main] 468.4113 (1.17) 468.4113 (1.17) 468.4113 (1.17) 0.0000 (1.0) 468.4113 (1.17) 0.0000 (1.0) 0;0 2.1349 (0.86) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.6810 (3.59) 1.6810 (3.59) 1.6810 (3.59) 0.0000 (1.0) 1.6810 (3.59) 0.0000 (1.0) 0;0 0.5949 (0.28) 1 1
test_list-list-recursive[2.40.0] 0.4681 (1.0) 0.4681 (1.0) 0.4681 (1.0) 0.0000 (1.0) 0.4681 (1.0) 0.0000 (1.0) 0;0 2.1364 (1.0) 1 1
test_list-list-recursive[2.58.2] 0.5652 (1.21) 0.5652 (1.21) 0.5652 (1.21) 0.0000 (1.0) 0.5652 (1.21) 0.0000 (1.0) 0;0 1.7694 (0.83) 1 1
test_list-list-recursive[3.0.0] 0.5590 (1.19) 0.5590 (1.19) 0.5590 (1.19) 0.0000 (1.0) 0.5590 (1.19) 0.0000 (1.0) 0;0 1.7888 (0.84) 1 1
test_list-list-recursive[main] 0.5575 (1.19) 0.5575 (1.19) 0.5575 (1.19) 0.0000 (1.0) 0.5575 (1.19) 0.0000 (1.0) 0;0 1.7938 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 401.6731 (1.0) 401.6731 (1.0) 401.6731 (1.0) 0.0000 (1.0) 401.6731 (1.0) 0.0000 (1.0) 0;0 2.4896 (1.0) 1 1
test_list-list-shallow[2.40.0] 423.8455 (1.06) 423.8455 (1.06) 423.8455 (1.06) 0.0000 (1.0) 423.8455 (1.06) 0.0000 (1.0) 0;0 2.3594 (0.95) 1 1
test_list-list-shallow[2.58.2] 470.1048 (1.17) 470.1048 (1.17) 470.1048 (1.17) 0.0000 (1.0) 470.1048 (1.17) 0.0000 (1.0) 0;0 2.1272 (0.85) 1 1
test_list-list-shallow[3.0.0] 457.0322 (1.14) 457.0322 (1.14) 457.0322 (1.14) 0.0000 (1.0) 457.0322 (1.14) 0.0000 (1.0) 0;0 2.1880 (0.88) 1 1
test_list-list-shallow[main] 459.6019 (1.14) 459.6019 (1.14) 459.6019 (1.14) 0.0000 (1.0) 459.6019 (1.14) 0.0000 (1.0) 0;0 2.1758 (0.87) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 7.4650 (1.82) 7.4650 (1.82) 7.4650 (1.82) 0.0000 (1.0) 7.4650 (1.82) 0.0000 (1.0) 0;0 0.1340 (0.55) 1 1
test_partial_remove-add[2.40.0] 6.0868 (1.48) 6.0868 (1.48) 6.0868 (1.48) 0.0000 (1.0) 6.0868 (1.48) 0.0000 (1.0) 0;0 0.1643 (0.67) 1 1
test_partial_remove-add[2.58.2] 4.1083 (1.0) 4.1083 (1.0) 4.1083 (1.0) 0.0000 (1.0) 4.1083 (1.0) 0.0000 (1.0) 0;0 0.2434 (1.0) 1 1
test_partial_remove-add[3.0.0] 4.1242 (1.00) 4.1242 (1.00) 4.1242 (1.00) 0.0000 (1.0) 4.1242 (1.00) 0.0000 (1.0) 0;0 0.2425 (1.00) 1 1
test_partial_remove-add[main] 4.2476 (1.03) 4.2476 (1.03) 4.2476 (1.03) 0.0000 (1.0) 4.2476 (1.03) 0.0000 (1.0) 0;0 0.2354 (0.97) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.11.0] 2.7826 (1.77) 2.7826 (1.77) 2.7826 (1.77) 0.0000 (1.0) 2.7826 (1.77) 0.0000 (1.0) 0;0 0.3594 (0.56) 1 1
test_partial_remove-add-update[2.40.0] 1.5695 (1.0) 1.5695 (1.0) 1.5695 (1.0) 0.0000 (1.0) 1.5695 (1.0) 0.0000 (1.0) 0;0 0.6371 (1.0) 1 1
test_partial_remove-add-update[2.58.2] 1.6772 (1.07) 1.6772 (1.07) 1.6772 (1.07) 0.0000 (1.0) 1.6772 (1.07) 0.0000 (1.0) 0;0 0.5962 (0.94) 1 1
test_partial_remove-add-update[3.0.0] 1.6711 (1.06) 1.6711 (1.06) 1.6711 (1.06) 0.0000 (1.0) 1.6711 (1.06) 0.0000 (1.0) 0;0 0.5984 (0.94) 1 1
test_partial_remove-add-update[main] 1.6593 (1.06) 1.6593 (1.06) 1.6593 (1.06) 0.0000 (1.0) 1.6593 (1.06) 0.0000 (1.0) 0;0 0.6027 (0.95) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 453.3915 (1.0) 453.3915 (1.0) 453.3915 (1.0) 0.0000 (1.0) 453.3915 (1.0) 0.0000 (1.0) 0;0 2.2056 (1.0) 1 1
test_partial_remove-gc[2.40.0] 537.7173 (1.19) 537.7173 (1.19) 537.7173 (1.19) 0.0000 (1.0) 537.7173 (1.19) 0.0000 (1.0) 0;0 1.8597 (0.84) 1 1
test_partial_remove-gc[2.58.2] 602.8722 (1.33) 602.8722 (1.33) 602.8722 (1.33) 0.0000 (1.0) 602.8722 (1.33) 0.0000 (1.0) 0;0 1.6587 (0.75) 1 1
test_partial_remove-gc[3.0.0] 640.4099 (1.41) 640.4099 (1.41) 640.4099 (1.41) 0.0000 (1.0) 640.4099 (1.41) 0.0000 (1.0) 0;0 1.5615 (0.71) 1 1
test_partial_remove-gc[main] 642.7483 (1.42) 642.7483 (1.42) 642.7483 (1.42) 0.0000 (1.0) 642.7483 (1.42) 0.0000 (1.0) 0;0 1.5558 (0.71) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 514.5392 (1.0) 514.5392 (1.0) 514.5392 (1.0) 0.0000 (1.0) 514.5392 (1.0) 0.0000 (1.0) 0;0 1.9435 (1.0) 1 1
test_partial_remove-gc-cloud[2.40.0] 582.6760 (1.13) 582.6760 (1.13) 582.6760 (1.13) 0.0000 (1.0) 582.6760 (1.13) 0.0000 (1.0) 0;0 1.7162 (0.88) 1 1
test_partial_remove-gc-cloud[2.58.2] 689.1462 (1.34) 689.1462 (1.34) 689.1462 (1.34) 0.0000 (1.0) 689.1462 (1.34) 0.0000 (1.0) 0;0 1.4511 (0.75) 1 1
test_partial_remove-gc-cloud[3.0.0] 736.1501 (1.43) 736.1501 (1.43) 736.1501 (1.43) 0.0000 (1.0) 736.1501 (1.43) 0.0000 (1.0) 0;0 1.3584 (0.70) 1 1
test_partial_remove-gc-cloud[main] 705.4239 (1.37) 705.4239 (1.37) 705.4239 (1.37) 0.0000 (1.0) 705.4239 (1.37) 0.0000 (1.0) 0;0 1.4176 (0.73) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 4.0196 (2.33) 4.0196 (2.33) 4.0196 (2.33) 0.0000 (1.0) 4.0196 (2.33) 0.0000 (1.0) 0;0 0.2488 (0.43) 1 1
test_partial_remove-push[2.40.0] 5.1515 (2.99) 5.1515 (2.99) 5.1515 (2.99) 0.0000 (1.0) 5.1515 (2.99) 0.0000 (1.0) 0;0 0.1941 (0.33) 1 1
test_partial_remove-push[2.58.2] 3.6016 (2.09) 3.6016 (2.09) 3.6016 (2.09) 0.0000 (1.0) 3.6016 (2.09) 0.0000 (1.0) 0;0 0.2777 (0.48) 1 1
test_partial_remove-push[3.0.0] 1.7217 (1.0) 1.7217 (1.0) 1.7217 (1.0) 0.0000 (1.0) 1.7217 (1.0) 0.0000 (1.0) 0;0 0.5808 (1.0) 1 1
test_partial_remove-push[main] 3.4825 (2.02) 3.4825 (2.02) 3.4825 (2.02) 0.0000 (1.0) 3.4825 (2.02) 0.0000 (1.0) 0;0 0.2871 (0.49) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.11.0] 495.1204 (1.0) 495.1204 (1.0) 495.1204 (1.0) 0.0000 (1.0) 495.1204 (1.0) 0.0000 (1.0) 0;0 2.0197 (1.0) 1 1
test_partial_remove-push-update[2.40.0] 554.9198 (1.12) 554.9198 (1.12) 554.9198 (1.12) 0.0000 (1.0) 554.9198 (1.12) 0.0000 (1.0) 0;0 1.8021 (0.89) 1 1
test_partial_remove-push-update[2.58.2] 597.9849 (1.21) 597.9849 (1.21) 597.9849 (1.21) 0.0000 (1.0) 597.9849 (1.21) 0.0000 (1.0) 0;0 1.6723 (0.83) 1 1
test_partial_remove-push-update[3.0.0] 591.4336 (1.19) 591.4336 (1.19) 591.4336 (1.19) 0.0000 (1.0) 591.4336 (1.19) 0.0000 (1.0) 0;0 1.6908 (0.84) 1 1
test_partial_remove-push-update[main] 570.1566 (1.15) 570.1566 (1.15) 570.1566 (1.15) 0.0000 (1.0) 570.1566 (1.15) 0.0000 (1.0) 0;0 1.7539 (0.87) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 185.1172 (1.0) 213.2949 (1.10) 188.7464 (1.0) 3.7726 (2.93) 187.7926 (1.0) 1.7959 (1.34) 6;9 5.2981 (1.0) 100 1
test_help---help[2.40.0] 243.0532 (1.31) 261.9216 (1.36) 246.0622 (1.30) 2.8637 (2.23) 245.4809 (1.31) 2.1040 (1.57) 7;5 4.0640 (0.77) 100 1
test_help---help[2.58.2] 195.1960 (1.05) 228.3596 (1.18) 198.6972 (1.05) 4.2904 (3.34) 197.6972 (1.05) 2.3892 (1.78) 8;8 5.0328 (0.95) 100 1
test_help---help[3.0.0] 188.7782 (1.02) 200.3819 (1.04) 191.5413 (1.01) 2.5208 (1.96) 190.9262 (1.02) 2.2862 (1.70) 20;9 5.2208 (0.99) 100 1
test_help---help[main] 185.7181 (1.00) 193.2913 (1.0) 188.7920 (1.00) 1.2860 (1.0) 188.7047 (1.00) 1.3414 (1.0) 27;6 5.2968 (1.00) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 4.4325 (1.0) 4.4325 (1.0) 4.4325 (1.0) 0.0000 (1.0) 4.4325 (1.0) 0.0000 (1.0) 0;0 0.2256 (1.0) 1 1
test_get_url-get-url[2.40.0] 4.5748 (1.03) 4.5748 (1.03) 4.5748 (1.03) 0.0000 (1.0) 4.5748 (1.03) 0.0000 (1.0) 0;0 0.2186 (0.97) 1 1
test_get_url-get-url[2.58.2] 4.6679 (1.05) 4.6679 (1.05) 4.6679 (1.05) 0.0000 (1.0) 4.6679 (1.05) 0.0000 (1.0) 0;0 0.2142 (0.95) 1 1
test_get_url-get-url[3.0.0] 4.4821 (1.01) 4.4821 (1.01) 4.4821 (1.01) 0.0000 (1.0) 4.4821 (1.01) 0.0000 (1.0) 0;0 0.2231 (0.99) 1 1
test_get_url-get-url[main] 4.6951 (1.06) 4.6951 (1.06) 4.6951 (1.06) 0.0000 (1.0) 4.6951 (1.06) 0.0000 (1.0) 0;0 0.2130 (0.94) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.40.0] 907.8287 (1.0) 907.8287 (1.0) 907.8287 (1.0) 0.0000 (1.0) 907.8287 (1.0) 0.0000 (1.0) 0;0 1.1015 (1.0) 1 1
test_exp_show-exp[2.58.2] 1,061.8537 (1.17) 1,061.8537 (1.17) 1,061.8537 (1.17) 0.0000 (1.0) 1,061.8537 (1.17) 0.0000 (1.0) 0;0 0.9417 (0.85) 1 1
test_exp_show-exp[3.0.0] 1,478.3525 (1.63) 1,478.3525 (1.63) 1,478.3525 (1.63) 0.0000 (1.0) 1,478.3525 (1.63) 0.0000 (1.0) 0;0 0.6764 (0.61) 1 1
test_exp_show-exp[main] 1,531.4522 (1.69) 1,531.4522 (1.69) 1,531.4522 (1.69) 0.0000 (1.0) 1,531.4522 (1.69) 0.0000 (1.0) 0;0 0.6530 (0.59) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.2957 (1.05) 1.2957 (1.05) 1.2957 (1.05) 0.0000 (1.0) 1.2957 (1.05) 0.0000 (1.0) 0;0 0.7718 (0.95) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.2703 (1.03) 1.2703 (1.03) 1.2703 (1.03) 0.0000 (1.0) 1.2703 (1.03) 0.0000 (1.0) 0;0 0.7872 (0.97) 1 1
test_checkout_hardlink-checkout[2.58.2] 1.7030 (1.39) 1.7030 (1.39) 1.7030 (1.39) 0.0000 (1.0) 1.7030 (1.39) 0.0000 (1.0) 0;0 0.5872 (0.72) 1 1
test_checkout_hardlink-checkout[3.0.0] 1.7986 (1.46) 1.7986 (1.46) 1.7986 (1.46) 0.0000 (1.0) 1.7986 (1.46) 0.0000 (1.0) 0;0 0.5560 (0.68) 1 1
test_checkout_hardlink-checkout[main] 1.2286 (1.0) 1.2286 (1.0) 1.2286 (1.0) 0.0000 (1.0) 1.2286 (1.0) 0.0000 (1.0) 0;0 0.8139 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 514.4746 (1.0) 514.4746 (1.0) 514.4746 (1.0) 0.0000 (1.0) 514.4746 (1.0) 0.0000 (1.0) 0;0 1.9437 (1.0) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 603.9255 (1.17) 603.9255 (1.17) 603.9255 (1.17) 0.0000 (1.0) 603.9255 (1.17) 0.0000 (1.0) 0;0 1.6558 (0.85) 1 1
test_checkout_hardlink-checkout-noop[2.58.2] 672.5156 (1.31) 672.5156 (1.31) 672.5156 (1.31) 0.0000 (1.0) 672.5156 (1.31) 0.0000 (1.0) 0;0 1.4870 (0.77) 1 1
test_checkout_hardlink-checkout-noop[3.0.0] 692.6631 (1.35) 692.6631 (1.35) 692.6631 (1.35) 0.0000 (1.0) 692.6631 (1.35) 0.0000 (1.0) 0;0 1.4437 (0.74) 1 1
test_checkout_hardlink-checkout-noop[main] 686.3709 (1.33) 686.3709 (1.33) 686.3709 (1.33) 0.0000 (1.0) 686.3709 (1.33) 0.0000 (1.0) 0;0 1.4569 (0.75) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.3230 (1.94) 1.3230 (1.94) 1.3230 (1.94) 0.0000 (1.0) 1.3230 (1.94) 0.0000 (1.0) 0;0 0.7559 (0.51) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.6809 (1.0) 0.6809 (1.0) 0.6809 (1.0) 0.0000 (1.0) 0.6809 (1.0) 0.0000 (1.0) 0;0 1.4687 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.58.2] 0.8882 (1.30) 0.8882 (1.30) 0.8882 (1.30) 0.0000 (1.0) 0.8882 (1.30) 0.0000 (1.0) 0;0 1.1258 (0.77) 1 1
test_checkout_hardlink-checkout-update[3.0.0] 0.7777 (1.14) 0.7777 (1.14) 0.7777 (1.14) 0.0000 (1.0) 0.7777 (1.14) 0.0000 (1.0) 0;0 1.2859 (0.88) 1 1
test_checkout_hardlink-checkout-update[main] 0.7646 (1.12) 0.7646 (1.12) 0.7646 (1.12) 0.0000 (1.0) 0.7646 (1.12) 0.0000 (1.0) 0;0 1.3078 (0.89) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.11.0] 3.6168 (1.71) 3.6168 (1.71) 3.6168 (1.71) 0.0000 (1.0) 3.6168 (1.71) 0.0000 (1.0) 0;0 0.2765 (0.59) 1 1
test_partial_add-add[2.40.0] 3.0119 (1.42) 3.0119 (1.42) 3.0119 (1.42) 0.0000 (1.0) 3.0119 (1.42) 0.0000 (1.0) 0;0 0.3320 (0.70) 1 1
test_partial_add-add[2.58.2] 2.5478 (1.20) 2.5478 (1.20) 2.5478 (1.20) 0.0000 (1.0) 2.5478 (1.20) 0.0000 (1.0) 0;0 0.3925 (0.83) 1 1
test_partial_add-add[3.0.0] 2.2831 (1.08) 2.2831 (1.08) 2.2831 (1.08) 0.0000 (1.0) 2.2831 (1.08) 0.0000 (1.0) 0;0 0.4380 (0.93) 1 1
test_partial_add-add[main] 2.1207 (1.0) 2.1207 (1.0) 2.1207 (1.0) 0.0000 (1.0) 2.1207 (1.0) 0.0000 (1.0) 0;0 0.4716 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.11.0] 5.8688 (1.90) 5.8688 (1.90) 5.8688 (1.90) 0.0000 (1.0) 5.8688 (1.90) 0.0000 (1.0) 0;0 0.1704 (0.53) 1 1
test_partial_add-add-partial[2.40.0] 3.9693 (1.29) 3.9693 (1.29) 3.9693 (1.29) 0.0000 (1.0) 3.9693 (1.29) 0.0000 (1.0) 0;0 0.2519 (0.78) 1 1
test_partial_add-add-partial[2.58.2] 3.0942 (1.00) 3.0942 (1.00) 3.0942 (1.00) 0.0000 (1.0) 3.0942 (1.00) 0.0000 (1.0) 0;0 0.3232 (1.00) 1 1
test_partial_add-add-partial[3.0.0] 3.0833 (1.0) 3.0833 (1.0) 3.0833 (1.0) 0.0000 (1.0) 3.0833 (1.0) 0.0000 (1.0) 0;0 0.3243 (1.0) 1 1
test_partial_add-add-partial[main] 3.0899 (1.00) 3.0899 (1.00) 3.0899 (1.00) 0.0000 (1.0) 3.0899 (1.00) 0.0000 (1.0) 0;0 0.3236 (1.00) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 479.7919 (1.0) 479.7919 (1.0) 479.7919 (1.0) 0.0000 (1.0) 479.7919 (1.0) 0.0000 (1.0) 0;0 2.0842 (1.0) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 555.8343 (1.16) 555.8343 (1.16) 555.8343 (1.16) 0.0000 (1.0) 555.8343 (1.16) 0.0000 (1.0) 0;0 1.7991 (0.86) 1 1
test_partial_add-gc-cloud-noop[2.58.2] 669.7217 (1.40) 669.7217 (1.40) 669.7217 (1.40) 0.0000 (1.0) 669.7217 (1.40) 0.0000 (1.0) 0;0 1.4932 (0.72) 1 1
test_partial_add-gc-cloud-noop[3.0.0] 761.7355 (1.59) 761.7355 (1.59) 761.7355 (1.59) 0.0000 (1.0) 761.7355 (1.59) 0.0000 (1.0) 0;0 1.3128 (0.63) 1 1
test_partial_add-gc-cloud-noop[main] 757.7096 (1.58) 757.7096 (1.58) 757.7096 (1.58) 0.0000 (1.0) 757.7096 (1.58) 0.0000 (1.0) 0;0 1.3198 (0.63) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 419.3579 (1.0) 419.3579 (1.0) 419.3579 (1.0) 0.0000 (1.0) 419.3579 (1.0) 0.0000 (1.0) 0;0 2.3846 (1.0) 1 1
test_partial_add-gc-noop[2.40.0] 491.4720 (1.17) 491.4720 (1.17) 491.4720 (1.17) 0.0000 (1.0) 491.4720 (1.17) 0.0000 (1.0) 0;0 2.0347 (0.85) 1 1
test_partial_add-gc-noop[2.58.2] 577.8694 (1.38) 577.8694 (1.38) 577.8694 (1.38) 0.0000 (1.0) 577.8694 (1.38) 0.0000 (1.0) 0;0 1.7305 (0.73) 1 1
test_partial_add-gc-noop[3.0.0] 662.2147 (1.58) 662.2147 (1.58) 662.2147 (1.58) 0.0000 (1.0) 662.2147 (1.58) 0.0000 (1.0) 0;0 1.5101 (0.63) 1 1
test_partial_add-gc-noop[main] 669.4700 (1.60) 669.4700 (1.60) 669.4700 (1.60) 0.0000 (1.0) 669.4700 (1.60) 0.0000 (1.0) 0;0 1.4937 (0.63) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.11.0] 2.0430 (1.95) 2.0430 (1.95) 2.0430 (1.95) 0.0000 (1.0) 2.0430 (1.95) 0.0000 (1.0) 0;0 0.4895 (0.51) 1 1
test_partial_add-push[2.40.0] 2.5688 (2.45) 2.5688 (2.45) 2.5688 (2.45) 0.0000 (1.0) 2.5688 (2.45) 0.0000 (1.0) 0;0 0.3893 (0.41) 1 1
test_partial_add-push[2.58.2] 1.8671 (1.78) 1.8671 (1.78) 1.8671 (1.78) 0.0000 (1.0) 1.8671 (1.78) 0.0000 (1.0) 0;0 0.5356 (0.56) 1 1
test_partial_add-push[3.0.0] 1.0478 (1.0) 1.0478 (1.0) 1.0478 (1.0) 0.0000 (1.0) 1.0478 (1.0) 0.0000 (1.0) 0;0 0.9544 (1.0) 1 1
test_partial_add-push[main] 1.8571 (1.77) 1.8571 (1.77) 1.8571 (1.77) 0.0000 (1.0) 1.8571 (1.77) 0.0000 (1.0) 0;0 0.5385 (0.56) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.11.0] 2.1273 (1.92) 2.1273 (1.92) 2.1273 (1.92) 0.0000 (1.0) 2.1273 (1.92) 0.0000 (1.0) 0;0 0.4701 (0.52) 1 1
test_partial_add-push-partial[2.40.0] 2.6697 (2.41) 2.6697 (2.41) 2.6697 (2.41) 0.0000 (1.0) 2.6697 (2.41) 0.0000 (1.0) 0;0 0.3746 (0.42) 1 1
test_partial_add-push-partial[2.58.2] 1.9281 (1.74) 1.9281 (1.74) 1.9281 (1.74) 0.0000 (1.0) 1.9281 (1.74) 0.0000 (1.0) 0;0 0.5186 (0.58) 1 1
test_partial_add-push-partial[3.0.0] 1.1100 (1.0) 1.1100 (1.0) 1.1100 (1.0) 0.0000 (1.0) 1.1100 (1.0) 0.0000 (1.0) 0;0 0.9009 (1.0) 1 1
test_partial_add-push-partial[main] 1.9307 (1.74) 1.9307 (1.74) 1.9307 (1.74) 0.0000 (1.0) 1.9307 (1.74) 0.0000 (1.0) 0;0 0.5179 (0.57) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing_azure-add': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.11.0] 8.6629 (2.02) 8.6629 (2.02) 8.6629 (2.02) 0.0000 (1.0) 8.6629 (2.02) 0.0000 (1.0) 0;0 0.1154 (0.49) 1 1
test_sharing_azure-add[2.11.0] 8.5592 (2.00) 8.5592 (2.00) 8.5592 (2.00) 0.0000 (1.0) 8.5592 (2.00) 0.0000 (1.0) 0;0 0.1168 (0.50) 1 1
test_sharing_azure-add[2.40.0] 6.4750 (1.51) 6.4750 (1.51) 6.4750 (1.51) 0.0000 (1.0) 6.4750 (1.51) 0.0000 (1.0) 0;0 0.1544 (0.66) 1 1
test_sharing_azure-add[2.40.0] 6.2010 (1.45) 6.2010 (1.45) 6.2010 (1.45) 0.0000 (1.0) 6.2010 (1.45) 0.0000 (1.0) 0;0 0.1613 (0.69) 1 1
test_sharing_azure-add[2.58.2] 4.5463 (1.06) 4.5463 (1.06) 4.5463 (1.06) 0.0000 (1.0) 4.5463 (1.06) 0.0000 (1.0) 0;0 0.2200 (0.94) 1 1
test_sharing_azure-add[2.58.2] 4.3118 (1.01) 4.3118 (1.01) 4.3118 (1.01) 0.0000 (1.0) 4.3118 (1.01) 0.0000 (1.0) 0;0 0.2319 (0.99) 1 1
test_sharing_azure-add[3.0.0] 4.2782 (1.0) 4.2782 (1.0) 4.2782 (1.0) 0.0000 (1.0) 4.2782 (1.0) 0.0000 (1.0) 0;0 0.2337 (1.0) 1 1
test_sharing_azure-add[3.0.0] 4.4646 (1.04) 4.4646 (1.04) 4.4646 (1.04) 0.0000 (1.0) 4.4646 (1.04) 0.0000 (1.0) 0;0 0.2240 (0.96) 1 1
test_sharing_azure-add[main] 4.5062 (1.05) 4.5062 (1.05) 4.5062 (1.05) 0.0000 (1.0) 4.5062 (1.05) 0.0000 (1.0) 0;0 0.2219 (0.95) 1 1
test_sharing_azure-add[main] 4.5541 (1.06) 4.5541 (1.06) 4.5541 (1.06) 0.0000 (1.0) 4.5541 (1.06) 0.0000 (1.0) 0;0 0.2196 (0.94) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.11.0] 3.9487 (1.55) 3.9487 (1.55) 3.9487 (1.55) 0.0000 (1.0) 3.9487 (1.55) 0.0000 (1.0) 0;0 0.2532 (0.64) 1 1
test_sharing_azure-add-noop[2.11.0] 3.8530 (1.51) 3.8530 (1.51) 3.8530 (1.51) 0.0000 (1.0) 3.8530 (1.51) 0.0000 (1.0) 0;0 0.2595 (0.66) 1 1
test_sharing_azure-add-noop[2.40.0] 2.5789 (1.01) 2.5789 (1.01) 2.5789 (1.01) 0.0000 (1.0) 2.5789 (1.01) 0.0000 (1.0) 0;0 0.3878 (0.99) 1 1
test_sharing_azure-add-noop[2.40.0] 2.5468 (1.0) 2.5468 (1.0) 2.5468 (1.0) 0.0000 (1.0) 2.5468 (1.0) 0.0000 (1.0) 0;0 0.3926 (1.0) 1 1
test_sharing_azure-add-noop[2.58.2] 2.9996 (1.18) 2.9996 (1.18) 2.9996 (1.18) 0.0000 (1.0) 2.9996 (1.18) 0.0000 (1.0) 0;0 0.3334 (0.85) 1 1
test_sharing_azure-add-noop[2.58.2] 2.7926 (1.10) 2.7926 (1.10) 2.7926 (1.10) 0.0000 (1.0) 2.7926 (1.10) 0.0000 (1.0) 0;0 0.3581 (0.91) 1 1
test_sharing_azure-add-noop[3.0.0] 2.8422 (1.12) 2.8422 (1.12) 2.8422 (1.12) 0.0000 (1.0) 2.8422 (1.12) 0.0000 (1.0) 0;0 0.3518 (0.90) 1 1
test_sharing_azure-add-noop[3.0.0] 2.9781 (1.17) 2.9781 (1.17) 2.9781 (1.17) 0.0000 (1.0) 2.9781 (1.17) 0.0000 (1.0) 0;0 0.3358 (0.86) 1 1
test_sharing_azure-add-noop[main] 3.0536 (1.20) 3.0536 (1.20) 3.0536 (1.20) 0.0000 (1.0) 3.0536 (1.20) 0.0000 (1.0) 0;0 0.3275 (0.83) 1 1
test_sharing_azure-add-noop[main] 3.0029 (1.18) 3.0029 (1.18) 3.0029 (1.18) 0.0000 (1.0) 3.0029 (1.18) 0.0000 (1.0) 0;0 0.3330 (0.85) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.11.0] 565.2027 (1.0) 565.2027 (1.0) 565.2027 (1.0) 0.0000 (1.0) 565.2027 (1.0) 0.0000 (1.0) 0;0 1.7693 (1.0) 1 1
test_sharing_azure-checkout-noop[2.11.0] 572.8812 (1.01) 572.8812 (1.01) 572.8812 (1.01) 0.0000 (1.0) 572.8812 (1.01) 0.0000 (1.0) 0;0 1.7456 (0.99) 1 1
test_sharing_azure-checkout-noop[2.40.0] 617.2567 (1.09) 617.2567 (1.09) 617.2567 (1.09) 0.0000 (1.0) 617.2567 (1.09) 0.0000 (1.0) 0;0 1.6201 (0.92) 1 1
test_sharing_azure-checkout-noop[2.40.0] 662.2117 (1.17) 662.2117 (1.17) 662.2117 (1.17) 0.0000 (1.0) 662.2117 (1.17) 0.0000 (1.0) 0;0 1.5101 (0.85) 1 1
test_sharing_azure-checkout-noop[2.58.2] 683.0368 (1.21) 683.0368 (1.21) 683.0368 (1.21) 0.0000 (1.0) 683.0368 (1.21) 0.0000 (1.0) 0;0 1.4640 (0.83) 1 1
test_sharing_azure-checkout-noop[2.58.2] 639.9705 (1.13) 639.9705 (1.13) 639.9705 (1.13) 0.0000 (1.0) 639.9705 (1.13) 0.0000 (1.0) 0;0 1.5626 (0.88) 1 1
test_sharing_azure-checkout-noop[3.0.0] 687.4567 (1.22) 687.4567 (1.22) 687.4567 (1.22) 0.0000 (1.0) 687.4567 (1.22) 0.0000 (1.0) 0;0 1.4546 (0.82) 1 1
test_sharing_azure-checkout-noop[3.0.0] 724.8883 (1.28) 724.8883 (1.28) 724.8883 (1.28) 0.0000 (1.0) 724.8883 (1.28) 0.0000 (1.0) 0;0 1.3795 (0.78) 1 1
test_sharing_azure-checkout-noop[main] 726.6345 (1.29) 726.6345 (1.29) 726.6345 (1.29) 0.0000 (1.0) 726.6345 (1.29) 0.0000 (1.0) 0;0 1.3762 (0.78) 1 1
test_sharing_azure-checkout-noop[main] 703.2461 (1.24) 703.2461 (1.24) 703.2461 (1.24) 0.0000 (1.0) 703.2461 (1.24) 0.0000 (1.0) 0;0 1.4220 (0.80) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull[2.11.0] 8.0988 (1.40) 8.0988 (1.40) 8.0988 (1.40) 0.0000 (1.0) 8.0988 (1.40) 0.0000 (1.0) 0;0 0.1235 (0.72) 1 1
test_sharing_azure-pull[2.11.0] 8.3156 (1.43) 8.3156 (1.43) 8.3156 (1.43) 0.0000 (1.0) 8.3156 (1.43) 0.0000 (1.0) 0;0 0.1203 (0.70) 1 1
test_sharing_azure-pull[2.40.0] 8.9579 (1.55) 8.9579 (1.55) 8.9579 (1.55) 0.0000 (1.0) 8.9579 (1.55) 0.0000 (1.0) 0;0 0.1116 (0.65) 1 1
test_sharing_azure-pull[2.40.0] 9.5863 (1.65) 9.5863 (1.65) 9.5863 (1.65) 0.0000 (1.0) 9.5863 (1.65) 0.0000 (1.0) 0;0 0.1043 (0.60) 1 1
test_sharing_azure-pull[2.58.2] 5.8799 (1.01) 5.8799 (1.01) 5.8799 (1.01) 0.0000 (1.0) 5.8799 (1.01) 0.0000 (1.0) 0;0 0.1701 (0.99) 1 1
test_sharing_azure-pull[2.58.2] 5.7967 (1.0) 5.7967 (1.0) 5.7967 (1.0) 0.0000 (1.0) 5.7967 (1.0) 0.0000 (1.0) 0;0 0.1725 (1.0) 1 1
test_sharing_azure-pull[3.0.0] 8.4337 (1.45) 8.4337 (1.45) 8.4337 (1.45) 0.0000 (1.0) 8.4337 (1.45) 0.0000 (1.0) 0;0 0.1186 (0.69) 1 1
test_sharing_azure-pull[3.0.0] 8.7037 (1.50) 8.7037 (1.50) 8.7037 (1.50) 0.0000 (1.0) 8.7037 (1.50) 0.0000 (1.0) 0;0 0.1149 (0.67) 1 1
test_sharing_azure-pull[main] 8.5975 (1.48) 8.5975 (1.48) 8.5975 (1.48) 0.0000 (1.0) 8.5975 (1.48) 0.0000 (1.0) 0;0 0.1163 (0.67) 1 1
test_sharing_azure-pull[main] 8.6736 (1.50) 8.6736 (1.50) 8.6736 (1.50) 0.0000 (1.0) 8.6736 (1.50) 0.0000 (1.0) 0;0 0.1153 (0.67) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull-noop[2.11.0] 599.4453 (1.00) 599.4453 (1.00) 599.4453 (1.00) 0.0000 (1.0) 599.4453 (1.00) 0.0000 (1.0) 0;0 1.6682 (1.00) 1 1
test_sharing_azure-pull-noop[2.11.0] 599.1758 (1.0) 599.1758 (1.0) 599.1758 (1.0) 0.0000 (1.0) 599.1758 (1.0) 0.0000 (1.0) 0;0 1.6690 (1.0) 1 1
test_sharing_azure-pull-noop[2.40.0] 650.5838 (1.09) 650.5838 (1.09) 650.5838 (1.09) 0.0000 (1.0) 650.5838 (1.09) 0.0000 (1.0) 0;0 1.5371 (0.92) 1 1
test_sharing_azure-pull-noop[2.40.0] 696.0546 (1.16) 696.0546 (1.16) 696.0546 (1.16) 0.0000 (1.0) 696.0546 (1.16) 0.0000 (1.0) 0;0 1.4367 (0.86) 1 1
test_sharing_azure-pull-noop[2.58.2] 766.2879 (1.28) 766.2879 (1.28) 766.2879 (1.28) 0.0000 (1.0) 766.2879 (1.28) 0.0000 (1.0) 0;0 1.3050 (0.78) 1 1
test_sharing_azure-pull-noop[2.58.2] 722.5501 (1.21) 722.5501 (1.21) 722.5501 (1.21) 0.0000 (1.0) 722.5501 (1.21) 0.0000 (1.0) 0;0 1.3840 (0.83) 1 1
test_sharing_azure-pull-noop[3.0.0] 845.4666 (1.41) 845.4666 (1.41) 845.4666 (1.41) 0.0000 (1.0) 845.4666 (1.41) 0.0000 (1.0) 0;0 1.1828 (0.71) 1 1
test_sharing_azure-pull-noop[3.0.0] 887.1377 (1.48) 887.1377 (1.48) 887.1377 (1.48) 0.0000 (1.0) 887.1377 (1.48) 0.0000 (1.0) 0;0 1.1272 (0.68) 1 1
test_sharing_azure-pull-noop[main] 879.8259 (1.47) 879.8259 (1.47) 879.8259 (1.47) 0.0000 (1.0) 879.8259 (1.47) 0.0000 (1.0) 0;0 1.1366 (0.68) 1 1
test_sharing_azure-pull-noop[main] 888.3583 (1.48) 888.3583 (1.48) 888.3583 (1.48) 0.0000 (1.0) 888.3583 (1.48) 0.0000 (1.0) 0;0 1.1257 (0.67) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.11.0] 4.6965 (2.63) 4.6965 (2.63) 4.6965 (2.63) 0.0000 (1.0) 4.6965 (2.63) 0.0000 (1.0) 0;0 0.2129 (0.38) 1 1
test_sharing_azure-push[2.11.0] 4.4892 (2.52) 4.4892 (2.52) 4.4892 (2.52) 0.0000 (1.0) 4.4892 (2.52) 0.0000 (1.0) 0;0 0.2228 (0.40) 1 1
test_sharing_azure-push[2.40.0] 5.2543 (2.95) 5.2543 (2.95) 5.2543 (2.95) 0.0000 (1.0) 5.2543 (2.95) 0.0000 (1.0) 0;0 0.1903 (0.34) 1 1
test_sharing_azure-push[2.40.0] 5.3288 (2.99) 5.3288 (2.99) 5.3288 (2.99) 0.0000 (1.0) 5.3288 (2.99) 0.0000 (1.0) 0;0 0.1877 (0.33) 1 1
test_sharing_azure-push[2.58.2] 3.6726 (2.06) 3.6726 (2.06) 3.6726 (2.06) 0.0000 (1.0) 3.6726 (2.06) 0.0000 (1.0) 0;0 0.2723 (0.49) 1 1
test_sharing_azure-push[2.58.2] 3.8071 (2.13) 3.8071 (2.13) 3.8071 (2.13) 0.0000 (1.0) 3.8071 (2.13) 0.0000 (1.0) 0;0 0.2627 (0.47) 1 1
test_sharing_azure-push[3.0.0] 1.7841 (1.0) 1.7841 (1.0) 1.7841 (1.0) 0.0000 (1.0) 1.7841 (1.0) 0.0000 (1.0) 0;0 0.5605 (1.0) 1 1
test_sharing_azure-push[3.0.0] 2.1856 (1.23) 2.1856 (1.23) 2.1856 (1.23) 0.0000 (1.0) 2.1856 (1.23) 0.0000 (1.0) 0;0 0.4575 (0.82) 1 1
test_sharing_azure-push[main] 3.9754 (2.23) 3.9754 (2.23) 3.9754 (2.23) 0.0000 (1.0) 3.9754 (2.23) 0.0000 (1.0) 0;0 0.2515 (0.45) 1 1
test_sharing_azure-push[main] 3.8756 (2.17) 3.8756 (2.17) 3.8756 (2.17) 0.0000 (1.0) 3.8756 (2.17) 0.0000 (1.0) 0;0 0.2580 (0.46) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.11.0] 504.0240 (1.01) 504.0240 (1.01) 504.0240 (1.01) 0.0000 (1.0) 504.0240 (1.01) 0.0000 (1.0) 0;0 1.9840 (0.99) 1 1
test_sharing_azure-push-noop[2.11.0] 503.1814 (1.01) 503.1814 (1.01) 503.1814 (1.01) 0.0000 (1.0) 503.1814 (1.01) 0.0000 (1.0) 0;0 1.9874 (0.99) 1 1
test_sharing_azure-push-noop[2.40.0] 500.2701 (1.0) 500.2701 (1.0) 500.2701 (1.0) 0.0000 (1.0) 500.2701 (1.0) 0.0000 (1.0) 0;0 1.9989 (1.0) 1 1
test_sharing_azure-push-noop[2.40.0] 504.5855 (1.01) 504.5855 (1.01) 504.5855 (1.01) 0.0000 (1.0) 504.5855 (1.01) 0.0000 (1.0) 0;0 1.9818 (0.99) 1 1
test_sharing_azure-push-noop[2.58.2] 588.0257 (1.18) 588.0257 (1.18) 588.0257 (1.18) 0.0000 (1.0) 588.0257 (1.18) 0.0000 (1.0) 0;0 1.7006 (0.85) 1 1
test_sharing_azure-push-noop[2.58.2] 592.8144 (1.18) 592.8144 (1.18) 592.8144 (1.18) 0.0000 (1.0) 592.8144 (1.18) 0.0000 (1.0) 0;0 1.6869 (0.84) 1 1
test_sharing_azure-push-noop[3.0.0] 541.0424 (1.08) 541.0424 (1.08) 541.0424 (1.08) 0.0000 (1.0) 541.0424 (1.08) 0.0000 (1.0) 0;0 1.8483 (0.92) 1 1
test_sharing_azure-push-noop[3.0.0] 823.7803 (1.65) 823.7803 (1.65) 823.7803 (1.65) 0.0000 (1.0) 823.7803 (1.65) 0.0000 (1.0) 0;0 1.2139 (0.61) 1 1
test_sharing_azure-push-noop[main] 548.4156 (1.10) 548.4156 (1.10) 548.4156 (1.10) 0.0000 (1.0) 548.4156 (1.10) 0.0000 (1.0) 0;0 1.8234 (0.91) 1 1
test_sharing_azure-push-noop[main] 559.8834 (1.12) 559.8834 (1.12) 559.8834 (1.12) 0.0000 (1.0) 559.8834 (1.12) 0.0000 (1.0) 0;0 1.7861 (0.89) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.40.0] 1.7313 (1.01) 1.7313 (1.01) 1.7313 (1.01) 0.0000 (1.0) 1.7313 (1.01) 0.0000 (1.0) 0;0 0.5776 (0.99) 1 1
test_data_status_all_flags-data-changed[2.58.2] 1.7270 (1.01) 1.7270 (1.01) 1.7270 (1.01) 0.0000 (1.0) 1.7270 (1.01) 0.0000 (1.0) 0;0 0.5791 (0.99) 1 1
test_data_status_all_flags-data-changed[3.0.0] 1.8314 (1.07) 1.8314 (1.07) 1.8314 (1.07) 0.0000 (1.0) 1.8314 (1.07) 0.0000 (1.0) 0;0 0.5460 (0.93) 1 1
test_data_status_all_flags-data-changed[main] 1.7088 (1.0) 1.7088 (1.0) 1.7088 (1.0) 0.0000 (1.0) 1.7088 (1.0) 0.0000 (1.0) 0;0 0.5852 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.40.0] 1.7552 (1.03) 1.7552 (1.03) 1.7552 (1.03) 0.0000 (1.0) 1.7552 (1.03) 0.0000 (1.0) 0;0 0.5697 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[2.58.2] 1.7555 (1.03) 1.7555 (1.03) 1.7555 (1.03) 0.0000 (1.0) 1.7555 (1.03) 0.0000 (1.0) 0;0 0.5696 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[3.0.0] 1.8020 (1.06) 1.8020 (1.06) 1.8020 (1.06) 0.0000 (1.0) 1.8020 (1.06) 0.0000 (1.0) 0;0 0.5550 (0.94) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.7027 (1.0) 1.7027 (1.0) 1.7027 (1.0) 0.0000 (1.0) 1.7027 (1.0) 0.0000 (1.0) 0;0 0.5873 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.40.0] 3.0491 (1.11) 3.0491 (1.11) 3.0491 (1.11) 0.0000 (1.0) 3.0491 (1.11) 0.0000 (1.0) 0;0 0.3280 (0.90) 1 1
test_data_status_all_flags-data-new[2.58.2] 2.8242 (1.03) 2.8242 (1.03) 2.8242 (1.03) 0.0000 (1.0) 2.8242 (1.03) 0.0000 (1.0) 0;0 0.3541 (0.98) 1 1
test_data_status_all_flags-data-new[3.0.0] 2.9334 (1.06) 2.9334 (1.06) 2.9334 (1.06) 0.0000 (1.0) 2.9334 (1.06) 0.0000 (1.0) 0;0 0.3409 (0.94) 1 1
test_data_status_all_flags-data-new[main] 2.7547 (1.0) 2.7547 (1.0) 2.7547 (1.0) 0.0000 (1.0) 2.7547 (1.0) 0.0000 (1.0) 0;0 0.3630 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.40.0] 1.6573 (1.0) 1.6573 (1.0) 1.6573 (1.0) 0.0000 (1.0) 1.6573 (1.0) 0.0000 (1.0) 0;0 0.6034 (1.0) 1 1
test_data_status_all_flags-data-noop[2.58.2] 1.6894 (1.02) 1.6894 (1.02) 1.6894 (1.02) 0.0000 (1.0) 1.6894 (1.02) 0.0000 (1.0) 0;0 0.5919 (0.98) 1 1
test_data_status_all_flags-data-noop[3.0.0] 1.7338 (1.05) 1.7338 (1.05) 1.7338 (1.05) 0.0000 (1.0) 1.7338 (1.05) 0.0000 (1.0) 0;0 0.5768 (0.96) 1 1
test_data_status_all_flags-data-noop[main] 1.6747 (1.01) 1.6747 (1.01) 1.6747 (1.01) 0.0000 (1.0) 1.6747 (1.01) 0.0000 (1.0) 0;0 0.5971 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 12.2951 (1.18) 12.2951 (1.18) 12.2951 (1.18) 0.0000 (1.0) 12.2951 (1.18) 0.0000 (1.0) 0;0 0.0813 (0.85) 1 1
test_import-import[2.40.0] 10.3928 (1.0) 10.3928 (1.0) 10.3928 (1.0) 0.0000 (1.0) 10.3928 (1.0) 0.0000 (1.0) 0;0 0.0962 (1.0) 1 1
test_import-import[2.58.2] 10.5539 (1.02) 10.5539 (1.02) 10.5539 (1.02) 0.0000 (1.0) 10.5539 (1.02) 0.0000 (1.0) 0;0 0.0948 (0.98) 1 1
test_import-import[3.0.0] 10.6006 (1.02) 10.6006 (1.02) 10.6006 (1.02) 0.0000 (1.0) 10.6006 (1.02) 0.0000 (1.0) 0;0 0.0943 (0.98) 1 1
test_import-import[main] 11.4075 (1.10) 11.4075 (1.10) 11.4075 (1.10) 0.0000 (1.0) 11.4075 (1.10) 0.0000 (1.0) 0;0 0.0877 (0.91) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 5.8592 (2.36) 5.8592 (2.36) 5.8592 (2.36) 0.0000 (1.0) 5.8592 (2.36) 0.0000 (1.0) 0;0 0.1707 (0.42) 1 1
test_push-push[2.40.0] 6.9914 (2.82) 6.9914 (2.82) 6.9914 (2.82) 0.0000 (1.0) 6.9914 (2.82) 0.0000 (1.0) 0;0 0.1430 (0.36) 1 1
test_push-push[2.58.2] 4.9928 (2.01) 4.9928 (2.01) 4.9928 (2.01) 0.0000 (1.0) 4.9928 (2.01) 0.0000 (1.0) 0;0 0.2003 (0.50) 1 1
test_push-push[3.0.0] 2.4821 (1.0) 2.4821 (1.0) 2.4821 (1.0) 0.0000 (1.0) 2.4821 (1.0) 0.0000 (1.0) 0;0 0.4029 (1.0) 1 1
test_push-push[main] 4.8449 (1.95) 4.8449 (1.95) 4.8449 (1.95) 0.0000 (1.0) 4.8449 (1.95) 0.0000 (1.0) 0;0 0.2064 (0.51) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0] 6.5070 (1.77) 6.5070 (1.77) 6.5070 (1.77) 0.0000 (1.0) 6.5070 (1.77) 0.0000 (1.0) 0;0 0.1537 (0.56) 1 1
test_sharing_s3-add[2.11.0] 6.4029 (1.75) 6.4029 (1.75) 6.4029 (1.75) 0.0000 (1.0) 6.4029 (1.75) 0.0000 (1.0) 0;0 0.1562 (0.57) 1 1
test_sharing_s3-add[2.40.0] 5.4653 (1.49) 5.4653 (1.49) 5.4653 (1.49) 0.0000 (1.0) 5.4653 (1.49) 0.0000 (1.0) 0;0 0.1830 (0.67) 1 1
test_sharing_s3-add[2.40.0] 6.4653 (1.76) 6.4653 (1.76) 6.4653 (1.76) 0.0000 (1.0) 6.4653 (1.76) 0.0000 (1.0) 0;0 0.1547 (0.57) 1 1
test_sharing_s3-add[2.58.2] 3.7144 (1.01) 3.7144 (1.01) 3.7144 (1.01) 0.0000 (1.0) 3.7144 (1.01) 0.0000 (1.0) 0;0 0.2692 (0.99) 1 1
test_sharing_s3-add[2.58.2] 3.6731 (1.00) 3.6731 (1.00) 3.6731 (1.00) 0.0000 (1.0) 3.6731 (1.00) 0.0000 (1.0) 0;0 0.2722 (1.00) 1 1
test_sharing_s3-add[3.0.0] 3.6775 (1.00) 3.6775 (1.00) 3.6775 (1.00) 0.0000 (1.0) 3.6775 (1.00) 0.0000 (1.0) 0;0 0.2719 (1.00) 1 1
test_sharing_s3-add[3.0.0] 3.6660 (1.0) 3.6660 (1.0) 3.6660 (1.0) 0.0000 (1.0) 3.6660 (1.0) 0.0000 (1.0) 0;0 0.2728 (1.0) 1 1
test_sharing_s3-add[main] 3.6956 (1.01) 3.6956 (1.01) 3.6956 (1.01) 0.0000 (1.0) 3.6956 (1.01) 0.0000 (1.0) 0;0 0.2706 (0.99) 1 1
test_sharing_s3-add[main] 3.6696 (1.00) 3.6696 (1.00) 3.6696 (1.00) 0.0000 (1.0) 3.6696 (1.00) 0.0000 (1.0) 0;0 0.2725 (1.00) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0] 3.2343 (1.44) 3.2343 (1.44) 3.2343 (1.44) 0.0000 (1.0) 3.2343 (1.44) 0.0000 (1.0) 0;0 0.3092 (0.69) 1 1
test_sharing_s3-add-noop[2.11.0] 3.2483 (1.45) 3.2483 (1.45) 3.2483 (1.45) 0.0000 (1.0) 3.2483 (1.45) 0.0000 (1.0) 0;0 0.3079 (0.69) 1 1
test_sharing_s3-add-noop[2.40.0] 2.2417 (1.0) 2.2417 (1.0) 2.2417 (1.0) 0.0000 (1.0) 2.2417 (1.0) 0.0000 (1.0) 0;0 0.4461 (1.0) 1 1
test_sharing_s3-add-noop[2.40.0] 2.2806 (1.02) 2.2806 (1.02) 2.2806 (1.02) 0.0000 (1.0) 2.2806 (1.02) 0.0000 (1.0) 0;0 0.4385 (0.98) 1 1
test_sharing_s3-add-noop[2.58.2] 2.4729 (1.10) 2.4729 (1.10) 2.4729 (1.10) 0.0000 (1.0) 2.4729 (1.10) 0.0000 (1.0) 0;0 0.4044 (0.91) 1 1
test_sharing_s3-add-noop[2.58.2] 2.4624 (1.10) 2.4624 (1.10) 2.4624 (1.10) 0.0000 (1.0) 2.4624 (1.10) 0.0000 (1.0) 0;0 0.4061 (0.91) 1 1
test_sharing_s3-add-noop[3.0.0] 2.4790 (1.11) 2.4790 (1.11) 2.4790 (1.11) 0.0000 (1.0) 2.4790 (1.11) 0.0000 (1.0) 0;0 0.4034 (0.90) 1 1
test_sharing_s3-add-noop[3.0.0] 2.4712 (1.10) 2.4712 (1.10) 2.4712 (1.10) 0.0000 (1.0) 2.4712 (1.10) 0.0000 (1.0) 0;0 0.4047 (0.91) 1 1
test_sharing_s3-add-noop[main] 2.4738 (1.10) 2.4738 (1.10) 2.4738 (1.10) 0.0000 (1.0) 2.4738 (1.10) 0.0000 (1.0) 0;0 0.4042 (0.91) 1 1
test_sharing_s3-add-noop[main] 2.4751 (1.10) 2.4751 (1.10) 2.4751 (1.10) 0.0000 (1.0) 2.4751 (1.10) 0.0000 (1.0) 0;0 0.4040 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0] 496.8978 (1.02) 496.8978 (1.02) 496.8978 (1.02) 0.0000 (1.0) 496.8978 (1.02) 0.0000 (1.0) 0;0 2.0125 (0.98) 1 1
test_sharing_s3-checkout-noop[2.11.0] 486.2704 (1.0) 486.2704 (1.0) 486.2704 (1.0) 0.0000 (1.0) 486.2704 (1.0) 0.0000 (1.0) 0;0 2.0565 (1.0) 1 1
test_sharing_s3-checkout-noop[2.40.0] 584.2326 (1.20) 584.2326 (1.20) 584.2326 (1.20) 0.0000 (1.0) 584.2326 (1.20) 0.0000 (1.0) 0;0 1.7116 (0.83) 1 1
test_sharing_s3-checkout-noop[2.40.0] 576.2182 (1.18) 576.2182 (1.18) 576.2182 (1.18) 0.0000 (1.0) 576.2182 (1.18) 0.0000 (1.0) 0;0 1.7355 (0.84) 1 1
test_sharing_s3-checkout-noop[2.58.2] 642.6477 (1.32) 642.6477 (1.32) 642.6477 (1.32) 0.0000 (1.0) 642.6477 (1.32) 0.0000 (1.0) 0;0 1.5561 (0.76) 1 1
test_sharing_s3-checkout-noop[2.58.2] 634.1697 (1.30) 634.1697 (1.30) 634.1697 (1.30) 0.0000 (1.0) 634.1697 (1.30) 0.0000 (1.0) 0;0 1.5769 (0.77) 1 1
test_sharing_s3-checkout-noop[3.0.0] 823.5179 (1.69) 823.5179 (1.69) 823.5179 (1.69) 0.0000 (1.0) 823.5179 (1.69) 0.0000 (1.0) 0;0 1.2143 (0.59) 1 1
test_sharing_s3-checkout-noop[3.0.0] 832.5161 (1.71) 832.5161 (1.71) 832.5161 (1.71) 0.0000 (1.0) 832.5161 (1.71) 0.0000 (1.0) 0;0 1.2012 (0.58) 1 1
test_sharing_s3-checkout-noop[main] 667.5207 (1.37) 667.5207 (1.37) 667.5207 (1.37) 0.0000 (1.0) 667.5207 (1.37) 0.0000 (1.0) 0;0 1.4981 (0.73) 1 1
test_sharing_s3-checkout-noop[main] 663.1213 (1.36) 663.1213 (1.36) 663.1213 (1.36) 0.0000 (1.0) 663.1213 (1.36) 0.0000 (1.0) 0;0 1.5080 (0.73) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0] 13.9044 (1.34) 13.9044 (1.34) 13.9044 (1.34) 0.0000 (1.0) 13.9044 (1.34) 0.0000 (1.0) 0;0 0.0719 (0.75) 1 1
test_sharing_s3-pull[2.11.0] 13.8156 (1.33) 13.8156 (1.33) 13.8156 (1.33) 0.0000 (1.0) 13.8156 (1.33) 0.0000 (1.0) 0;0 0.0724 (0.75) 1 1
test_sharing_s3-pull[2.40.0] 15.5673 (1.50) 15.5673 (1.50) 15.5673 (1.50) 0.0000 (1.0) 15.5673 (1.50) 0.0000 (1.0) 0;0 0.0642 (0.67) 1 1
test_sharing_s3-pull[2.40.0] 15.4678 (1.49) 15.4678 (1.49) 15.4678 (1.49) 0.0000 (1.0) 15.4678 (1.49) 0.0000 (1.0) 0;0 0.0647 (0.67) 1 1
test_sharing_s3-pull[2.58.2] 10.5112 (1.01) 10.5112 (1.01) 10.5112 (1.01) 0.0000 (1.0) 10.5112 (1.01) 0.0000 (1.0) 0;0 0.0951 (0.99) 1 1
test_sharing_s3-pull[2.58.2] 10.4054 (1.0) 10.4054 (1.0) 10.4054 (1.0) 0.0000 (1.0) 10.4054 (1.0) 0.0000 (1.0) 0;0 0.0961 (1.0) 1 1
test_sharing_s3-pull[3.0.0] 12.3759 (1.19) 12.3759 (1.19) 12.3759 (1.19) 0.0000 (1.0) 12.3759 (1.19) 0.0000 (1.0) 0;0 0.0808 (0.84) 1 1
test_sharing_s3-pull[3.0.0] 12.4407 (1.20) 12.4407 (1.20) 12.4407 (1.20) 0.0000 (1.0) 12.4407 (1.20) 0.0000 (1.0) 0;0 0.0804 (0.84) 1 1
test_sharing_s3-pull[main] 12.3401 (1.19) 12.3401 (1.19) 12.3401 (1.19) 0.0000 (1.0) 12.3401 (1.19) 0.0000 (1.0) 0;0 0.0810 (0.84) 1 1
test_sharing_s3-pull[main] 12.3928 (1.19) 12.3928 (1.19) 12.3928 (1.19) 0.0000 (1.0) 12.3928 (1.19) 0.0000 (1.0) 0;0 0.0807 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0] 724.0317 (1.01) 724.0317 (1.01) 724.0317 (1.01) 0.0000 (1.0) 724.0317 (1.01) 0.0000 (1.0) 0;0 1.3812 (0.99) 1 1
test_sharing_s3-pull-noop[2.11.0] 717.7882 (1.0) 717.7882 (1.0) 717.7882 (1.0) 0.0000 (1.0) 717.7882 (1.0) 0.0000 (1.0) 0;0 1.3932 (1.0) 1 1
test_sharing_s3-pull-noop[2.40.0] 807.0634 (1.12) 807.0634 (1.12) 807.0634 (1.12) 0.0000 (1.0) 807.0634 (1.12) 0.0000 (1.0) 0;0 1.2391 (0.89) 1 1
test_sharing_s3-pull-noop[2.40.0] 798.7959 (1.11) 798.7959 (1.11) 798.7959 (1.11) 0.0000 (1.0) 798.7959 (1.11) 0.0000 (1.0) 0;0 1.2519 (0.90) 1 1
test_sharing_s3-pull-noop[2.58.2] 867.4406 (1.21) 867.4406 (1.21) 867.4406 (1.21) 0.0000 (1.0) 867.4406 (1.21) 0.0000 (1.0) 0;0 1.1528 (0.83) 1 1
test_sharing_s3-pull-noop[2.58.2] 859.2342 (1.20) 859.2342 (1.20) 859.2342 (1.20) 0.0000 (1.0) 859.2342 (1.20) 0.0000 (1.0) 0;0 1.1638 (0.84) 1 1
test_sharing_s3-pull-noop[3.0.0] 997.9839 (1.39) 997.9839 (1.39) 997.9839 (1.39) 0.0000 (1.0) 997.9839 (1.39) 0.0000 (1.0) 0;0 1.0020 (0.72) 1 1
test_sharing_s3-pull-noop[3.0.0] 1,004.7361 (1.40) 1,004.7361 (1.40) 1,004.7361 (1.40) 0.0000 (1.0) 1,004.7361 (1.40) 0.0000 (1.0) 0;0 0.9953 (0.71) 1 1
test_sharing_s3-pull-noop[main] 1,366.2021 (1.90) 1,366.2021 (1.90) 1,366.2021 (1.90) 0.0000 (1.0) 1,366.2021 (1.90) 0.0000 (1.0) 0;0 0.7320 (0.53) 1 1
test_sharing_s3-pull-noop[main] 1,355.5635 (1.89) 1,355.5635 (1.89) 1,355.5635 (1.89) 0.0000 (1.0) 1,355.5635 (1.89) 0.0000 (1.0) 0;0 0.7377 (0.53) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0] 22.6164 (2.66) 22.6164 (2.66) 22.6164 (2.66) 0.0000 (1.0) 22.6164 (2.66) 0.0000 (1.0) 0;0 0.0442 (0.38) 1 1
test_sharing_s3-push[2.11.0] 22.3683 (2.63) 22.3683 (2.63) 22.3683 (2.63) 0.0000 (1.0) 22.3683 (2.63) 0.0000 (1.0) 0;0 0.0447 (0.38) 1 1
test_sharing_s3-push[2.40.0] 23.7977 (2.79) 23.7977 (2.79) 23.7977 (2.79) 0.0000 (1.0) 23.7977 (2.79) 0.0000 (1.0) 0;0 0.0420 (0.36) 1 1
test_sharing_s3-push[2.40.0] 24.4524 (2.87) 24.4524 (2.87) 24.4524 (2.87) 0.0000 (1.0) 24.4524 (2.87) 0.0000 (1.0) 0;0 0.0409 (0.35) 1 1
test_sharing_s3-push[2.58.2] 9.6294 (1.13) 9.6294 (1.13) 9.6294 (1.13) 0.0000 (1.0) 9.6294 (1.13) 0.0000 (1.0) 0;0 0.1038 (0.88) 1 1
test_sharing_s3-push[2.58.2] 9.6378 (1.13) 9.6378 (1.13) 9.6378 (1.13) 0.0000 (1.0) 9.6378 (1.13) 0.0000 (1.0) 0;0 0.1038 (0.88) 1 1
test_sharing_s3-push[3.0.0] 8.5270 (1.00) 8.5270 (1.00) 8.5270 (1.00) 0.0000 (1.0) 8.5270 (1.00) 0.0000 (1.0) 0;0 0.1173 (1.00) 1 1
test_sharing_s3-push[3.0.0] 8.5163 (1.0) 8.5163 (1.0) 8.5163 (1.0) 0.0000 (1.0) 8.5163 (1.0) 0.0000 (1.0) 0;0 0.1174 (1.0) 1 1
test_sharing_s3-push[main] 9.4426 (1.11) 9.4426 (1.11) 9.4426 (1.11) 0.0000 (1.0) 9.4426 (1.11) 0.0000 (1.0) 0;0 0.1059 (0.90) 1 1
test_sharing_s3-push[main] 9.6361 (1.13) 9.6361 (1.13) 9.6361 (1.13) 0.0000 (1.0) 9.6361 (1.13) 0.0000 (1.0) 0;0 0.1038 (0.88) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0] 982.3757 (1.0) 982.3757 (1.0) 982.3757 (1.0) 0.0000 (1.0) 982.3757 (1.0) 0.0000 (1.0) 0;0 1.0179 (1.0) 1 1
test_sharing_s3-push-noop[2.11.0] 989.9110 (1.01) 989.9110 (1.01) 989.9110 (1.01) 0.0000 (1.0) 989.9110 (1.01) 0.0000 (1.0) 0;0 1.0102 (0.99) 1 1
test_sharing_s3-push-noop[2.40.0] 999.5086 (1.02) 999.5086 (1.02) 999.5086 (1.02) 0.0000 (1.0) 999.5086 (1.02) 0.0000 (1.0) 0;0 1.0005 (0.98) 1 1
test_sharing_s3-push-noop[2.40.0] 1,023.4540 (1.04) 1,023.4540 (1.04) 1,023.4540 (1.04) 0.0000 (1.0) 1,023.4540 (1.04) 0.0000 (1.0) 0;0 0.9771 (0.96) 1 1
test_sharing_s3-push-noop[2.58.2] 1,061.4693 (1.08) 1,061.4693 (1.08) 1,061.4693 (1.08) 0.0000 (1.0) 1,061.4693 (1.08) 0.0000 (1.0) 0;0 0.9421 (0.93) 1 1
test_sharing_s3-push-noop[2.58.2] 1,057.2623 (1.08) 1,057.2623 (1.08) 1,057.2623 (1.08) 0.0000 (1.0) 1,057.2623 (1.08) 0.0000 (1.0) 0;0 0.9458 (0.93) 1 1
test_sharing_s3-push-noop[3.0.0] 1,057.5415 (1.08) 1,057.5415 (1.08) 1,057.5415 (1.08) 0.0000 (1.0) 1,057.5415 (1.08) 0.0000 (1.0) 0;0 0.9456 (0.93) 1 1
test_sharing_s3-push-noop[3.0.0] 1,039.7560 (1.06) 1,039.7560 (1.06) 1,039.7560 (1.06) 0.0000 (1.0) 1,039.7560 (1.06) 0.0000 (1.0) 0;0 0.9618 (0.94) 1 1
test_sharing_s3-push-noop[main] 1,034.9605 (1.05) 1,034.9605 (1.05) 1,034.9605 (1.05) 0.0000 (1.0) 1,034.9605 (1.05) 0.0000 (1.0) 0;0 0.9662 (0.95) 1 1
test_sharing_s3-push-noop[main] 1,059.9013 (1.08) 1,059.9013 (1.08) 1,059.9013 (1.08) 0.0000 (1.0) 1,059.9013 (1.08) 0.0000 (1.0) 0;0 0.9435 (0.93) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 2.2995 (1.59) 2.2995 (1.59) 2.2995 (1.59) 0.0000 (1.0) 2.2995 (1.59) 0.0000 (1.0) 0;0 0.4349 (0.63) 1 1
test_status-status[2.40.0] 1.4482 (1.0) 1.4482 (1.0) 1.4482 (1.0) 0.0000 (1.0) 1.4482 (1.0) 0.0000 (1.0) 0;0 0.6905 (1.0) 1 1
test_status-status[2.58.2] 1.4672 (1.01) 1.4672 (1.01) 1.4672 (1.01) 0.0000 (1.0) 1.4672 (1.01) 0.0000 (1.0) 0;0 0.6816 (0.99) 1 1
test_status-status[3.0.0] 1.4628 (1.01) 1.4628 (1.01) 1.4628 (1.01) 0.0000 (1.0) 1.4628 (1.01) 0.0000 (1.0) 0;0 0.6836 (0.99) 1 1
test_status-status[main] 1.4661 (1.01) 1.4661 (1.01) 1.4661 (1.01) 0.0000 (1.0) 1.4661 (1.01) 0.0000 (1.0) 0;0 0.6821 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 1.6534 (2.79) 1.6534 (2.79) 1.6534 (2.79) 0.0000 (1.0) 1.6534 (2.79) 0.0000 (1.0) 0;0 0.6048 (0.36) 1 1
test_status-status-changed[2.40.0] 0.5916 (1.0) 0.5916 (1.0) 0.5916 (1.0) 0.0000 (1.0) 0.5916 (1.0) 0.0000 (1.0) 0;0 1.6902 (1.0) 1 1
test_status-status-changed[2.58.2] 0.6532 (1.10) 0.6532 (1.10) 0.6532 (1.10) 0.0000 (1.0) 0.6532 (1.10) 0.0000 (1.0) 0;0 1.5308 (0.91) 1 1
test_status-status-changed[3.0.0] 0.6404 (1.08) 0.6404 (1.08) 0.6404 (1.08) 0.0000 (1.0) 0.6404 (1.08) 0.0000 (1.0) 0;0 1.5614 (0.92) 1 1
test_status-status-changed[main] 0.6647 (1.12) 0.6647 (1.12) 0.6647 (1.12) 0.0000 (1.0) 0.6647 (1.12) 0.0000 (1.0) 0;0 1.5045 (0.89) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 716.5676 (1.22) 716.5676 (1.22) 716.5676 (1.22) 0.0000 (1.0) 716.5676 (1.22) 0.0000 (1.0) 0;0 1.3955 (0.82) 1 1
test_status-status-changed-noop[2.40.0] 587.3640 (1.0) 587.3640 (1.0) 587.3640 (1.0) 0.0000 (1.0) 587.3640 (1.0) 0.0000 (1.0) 0;0 1.7025 (1.0) 1 1
test_status-status-changed-noop[2.58.2] 654.5556 (1.11) 654.5556 (1.11) 654.5556 (1.11) 0.0000 (1.0) 654.5556 (1.11) 0.0000 (1.0) 0;0 1.5278 (0.90) 1 1
test_status-status-changed-noop[3.0.0] 638.3178 (1.09) 638.3178 (1.09) 638.3178 (1.09) 0.0000 (1.0) 638.3178 (1.09) 0.0000 (1.0) 0;0 1.5666 (0.92) 1 1
test_status-status-changed-noop[main] 652.1536 (1.11) 652.1536 (1.11) 652.1536 (1.11) 0.0000 (1.0) 652.1536 (1.11) 0.0000 (1.0) 0;0 1.5334 (0.90) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 470.2405 (1.0) 470.2405 (1.0) 470.2405 (1.0) 0.0000 (1.0) 470.2405 (1.0) 0.0000 (1.0) 0;0 2.1266 (1.0) 1 1
test_status-status-noop[2.40.0] 587.5145 (1.25) 587.5145 (1.25) 587.5145 (1.25) 0.0000 (1.0) 587.5145 (1.25) 0.0000 (1.0) 0;0 1.7021 (0.80) 1 1
test_status-status-noop[2.58.2] 646.5073 (1.37) 646.5073 (1.37) 646.5073 (1.37) 0.0000 (1.0) 646.5073 (1.37) 0.0000 (1.0) 0;0 1.5468 (0.73) 1 1
test_status-status-noop[3.0.0] 642.8318 (1.37) 642.8318 (1.37) 642.8318 (1.37) 0.0000 (1.0) 642.8318 (1.37) 0.0000 (1.0) 0;0 1.5556 (0.73) 1 1
test_status-status-noop[main] 650.3275 (1.38) 650.3275 (1.38) 650.3275 (1.38) 0.0000 (1.0) 650.3275 (1.38) 0.0000 (1.0) 0;0 1.5377 (0.72) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.11.0] 14.6386 (1.42) 14.6386 (1.42) 14.6386 (1.42) 0.0000 (1.0) 14.6386 (1.42) 0.0000 (1.0) 0;0 0.0683 (0.71) 1 1
test_update-import-url[2.40.0] 13.2743 (1.28) 13.2743 (1.28) 13.2743 (1.28) 0.0000 (1.0) 13.2743 (1.28) 0.0000 (1.0) 0;0 0.0753 (0.78) 1 1
test_update-import-url[2.58.2] 10.7205 (1.04) 10.7205 (1.04) 10.7205 (1.04) 0.0000 (1.0) 10.7205 (1.04) 0.0000 (1.0) 0;0 0.0933 (0.96) 1 1
test_update-import-url[3.0.0] 10.3441 (1.0) 10.3441 (1.0) 10.3441 (1.0) 0.0000 (1.0) 10.3441 (1.0) 0.0000 (1.0) 0;0 0.0967 (1.0) 1 1
test_update-import-url[main] 10.8634 (1.05) 10.8634 (1.05) 10.8634 (1.05) 0.0000 (1.0) 10.8634 (1.05) 0.0000 (1.0) 0;0 0.0921 (0.95) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_update-update': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 11.5041 (1.31) 11.5041 (1.31) 11.5041 (1.31) 0.0000 (1.0) 11.5041 (1.31) 0.0000 (1.0) 0;0 0.0869 (0.76) 1 1
test_update-update[2.40.0] 8.7498 (1.0) 8.7498 (1.0) 8.7498 (1.0) 0.0000 (1.0) 8.7498 (1.0) 0.0000 (1.0) 0;0 0.1143 (1.0) 1 1
test_update-update[2.58.2] 9.3434 (1.07) 9.3434 (1.07) 9.3434 (1.07) 0.0000 (1.0) 9.3434 (1.07) 0.0000 (1.0) 0;0 0.1070 (0.94) 1 1
test_update-update[3.0.0] 9.2878 (1.06) 9.2878 (1.06) 9.2878 (1.06) 0.0000 (1.0) 9.2878 (1.06) 0.0000 (1.0) 0;0 0.1077 (0.94) 1 1
test_update-update[main] 9.8147 (1.12) 9.8147 (1.12) 9.8147 (1.12) 0.0000 (1.0) 9.8147 (1.12) 0.0000 (1.0) 0;0 0.1019 (0.89) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 658.3180 (1.0) 658.3180 (1.0) 658.3180 (1.0) 0.0000 (1.0) 658.3180 (1.0) 0.0000 (1.0) 0;0 1.5190 (1.0) 1 1
test_update-update-noop[2.40.0] 1,229.9933 (1.87) 1,229.9933 (1.87) 1,229.9933 (1.87) 0.0000 (1.0) 1,229.9933 (1.87) 0.0000 (1.0) 0;0 0.8130 (0.54) 1 1
test_update-update-noop[2.58.2] 1,370.0306 (2.08) 1,370.0306 (2.08) 1,370.0306 (2.08) 0.0000 (1.0) 1,370.0306 (2.08) 0.0000 (1.0) 0;0 0.7299 (0.48) 1 1
test_update-update-noop[3.0.0] 1,427.0312 (2.17) 1,427.0312 (2.17) 1,427.0312 (2.17) 0.0000 (1.0) 1,427.0312 (2.17) 0.0000 (1.0) 0;0 0.7008 (0.46) 1 1
test_update-update-noop[main] 1,422.3797 (2.16) 1,422.3797 (2.16) 1,422.3797 (2.16) 0.0000 (1.0) 1,422.3797 (2.16) 0.0000 (1.0) 0;0 0.7030 (0.46) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
Superseded by #473.
Bumps pre-commit from 2.21.0 to 3.4.0.
Release notes
Sourced from pre-commit's releases.
... (truncated)
Changelog
Sourced from pre-commit's changelog.
... (truncated)
Commits
fe9ba6b
v3.4.0ac42dc5
Merge pull request #2979 from jdb8/cpu-sched-getaffinityea8244b
Use os.sched_getaffinity for cpu counts when available9ebda91
Merge pull request #2980 from pre-commit/pre-commit-ci-update-config3dd1875
[pre-commit.ci] pre-commit autoupdatebde292b
Merge pull request #2972 from pre-commit/pre-commit-ci-update-configa4ae868
[pre-commit.ci] pre-commit autoupdate0c3d605
Merge pull request #2971 from chriskuehl/fix-signal-death5a4b5b1
Fix exit code for commands terminated by signalsa1f1d19
Merge pull request #2961 from pre-commit/pre-commit-ci-update-configDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show