Closed dependabot[bot] closed 11 months ago
Thu Aug 24 10:23:25 UTC 2023
dataset: small
project: example-get-started
-------------------------------------------------------------------------- benchmark 'test_add-add': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.11.0] 10.7932 (1.85) 10.7932 (1.85) 10.7932 (1.85) 0.0000 (1.0) 10.7932 (1.85) 0.0000 (1.0) 0;0 0.0927 (0.54) 1 1
test_add-add[2.40.0] 9.5448 (1.64) 9.5448 (1.64) 9.5448 (1.64) 0.0000 (1.0) 9.5448 (1.64) 0.0000 (1.0) 0;0 0.1048 (0.61) 1 1
test_add-add[2.58.2] 6.0748 (1.04) 6.0748 (1.04) 6.0748 (1.04) 0.0000 (1.0) 6.0748 (1.04) 0.0000 (1.0) 0;0 0.1646 (0.96) 1 1
test_add-add[3.0.0] 6.0979 (1.05) 6.0979 (1.05) 6.0979 (1.05) 0.0000 (1.0) 6.0979 (1.05) 0.0000 (1.0) 0;0 0.1640 (0.95) 1 1
test_add-add[main] 5.8189 (1.0) 5.8189 (1.0) 5.8189 (1.0) 0.0000 (1.0) 5.8189 (1.0) 0.0000 (1.0) 0;0 0.1719 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.40.0] 846.8761 (1.14) 846.8761 (1.14) 846.8761 (1.14) 0.0000 (1.0) 846.8761 (1.14) 0.0000 (1.0) 0;0 1.1808 (0.88) 1 1
test_data_status-data-changed[2.58.2] 817.4003 (1.10) 817.4003 (1.10) 817.4003 (1.10) 0.0000 (1.0) 817.4003 (1.10) 0.0000 (1.0) 0;0 1.2234 (0.91) 1 1
test_data_status-data-changed[3.0.0] 820.4428 (1.11) 820.4428 (1.11) 820.4428 (1.11) 0.0000 (1.0) 820.4428 (1.11) 0.0000 (1.0) 0;0 1.2189 (0.90) 1 1
test_data_status-data-changed[main] 741.4095 (1.0) 741.4095 (1.0) 741.4095 (1.0) 0.0000 (1.0) 741.4095 (1.0) 0.0000 (1.0) 0;0 1.3488 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.40.0] 855.9999 (1.13) 855.9999 (1.13) 855.9999 (1.13) 0.0000 (1.0) 855.9999 (1.13) 0.0000 (1.0) 0;0 1.1682 (0.89) 1 1
test_data_status-data-changed-noop[2.58.2] 819.2674 (1.08) 819.2674 (1.08) 819.2674 (1.08) 0.0000 (1.0) 819.2674 (1.08) 0.0000 (1.0) 0;0 1.2206 (0.93) 1 1
test_data_status-data-changed-noop[3.0.0] 844.1177 (1.11) 844.1177 (1.11) 844.1177 (1.11) 0.0000 (1.0) 844.1177 (1.11) 0.0000 (1.0) 0;0 1.1847 (0.90) 1 1
test_data_status-data-changed-noop[main] 759.4681 (1.0) 759.4681 (1.0) 759.4681 (1.0) 0.0000 (1.0) 759.4681 (1.0) 0.0000 (1.0) 0;0 1.3167 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.40.0] 1.8939 (1.10) 1.8939 (1.10) 1.8939 (1.10) 0.0000 (1.0) 1.8939 (1.10) 0.0000 (1.0) 0;0 0.5280 (0.91) 1 1
test_data_status-data-new[2.58.2] 1.8058 (1.05) 1.8058 (1.05) 1.8058 (1.05) 0.0000 (1.0) 1.8058 (1.05) 0.0000 (1.0) 0;0 0.5538 (0.95) 1 1
test_data_status-data-new[3.0.0] 1.8038 (1.05) 1.8038 (1.05) 1.8038 (1.05) 0.0000 (1.0) 1.8038 (1.05) 0.0000 (1.0) 0;0 0.5544 (0.95) 1 1
test_data_status-data-new[main] 1.7181 (1.0) 1.7181 (1.0) 1.7181 (1.0) 0.0000 (1.0) 1.7181 (1.0) 0.0000 (1.0) 0;0 0.5820 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.40.0] 836.4891 (1.12) 836.4891 (1.12) 836.4891 (1.12) 0.0000 (1.0) 836.4891 (1.12) 0.0000 (1.0) 0;0 1.1955 (0.89) 1 1
test_data_status-data-noop[2.58.2] 811.0137 (1.09) 811.0137 (1.09) 811.0137 (1.09) 0.0000 (1.0) 811.0137 (1.09) 0.0000 (1.0) 0;0 1.2330 (0.92) 1 1
test_data_status-data-noop[3.0.0] 820.7099 (1.10) 820.7099 (1.10) 820.7099 (1.10) 0.0000 (1.0) 820.7099 (1.10) 0.0000 (1.0) 0;0 1.2185 (0.91) 1 1
test_data_status-data-noop[main] 745.2168 (1.0) 745.2168 (1.0) 745.2168 (1.0) 0.0000 (1.0) 745.2168 (1.0) 0.0000 (1.0) 0;0 1.3419 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.11.0] 5.2590 (1.09) 5.2590 (1.09) 5.2590 (1.09) 0.0000 (1.0) 5.2590 (1.09) 0.0000 (1.0) 0;0 0.1902 (0.91) 1 1
test_get-get[2.40.0] 4.8103 (1.0) 4.8103 (1.0) 4.8103 (1.0) 0.0000 (1.0) 4.8103 (1.0) 0.0000 (1.0) 0;0 0.2079 (1.0) 1 1
test_get-get[2.58.2] 7.1864 (1.49) 7.1864 (1.49) 7.1864 (1.49) 0.0000 (1.0) 7.1864 (1.49) 0.0000 (1.0) 0;0 0.1392 (0.67) 1 1
test_get-get[3.0.0] 6.4144 (1.33) 6.4144 (1.33) 6.4144 (1.33) 0.0000 (1.0) 6.4144 (1.33) 0.0000 (1.0) 0;0 0.1559 (0.75) 1 1
test_get-get[main] 7.2197 (1.50) 7.2197 (1.50) 7.2197 (1.50) 0.0000 (1.0) 7.2197 (1.50) 0.0000 (1.0) 0;0 0.1385 (0.67) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.11.0] 2.9489 (1.56) 2.9489 (1.56) 2.9489 (1.56) 0.0000 (1.0) 2.9489 (1.56) 0.0000 (1.0) 0;0 0.3391 (0.64) 1 1
test_checkout_copy-checkout[2.40.0] 3.3693 (1.78) 3.3693 (1.78) 3.3693 (1.78) 0.0000 (1.0) 3.3693 (1.78) 0.0000 (1.0) 0;0 0.2968 (0.56) 1 1
test_checkout_copy-checkout[2.58.2] 1.8888 (1.0) 1.8888 (1.0) 1.8888 (1.0) 0.0000 (1.0) 1.8888 (1.0) 0.0000 (1.0) 0;0 0.5294 (1.0) 1 1
test_checkout_copy-checkout[3.0.0] 4.2444 (2.25) 4.2444 (2.25) 4.2444 (2.25) 0.0000 (1.0) 4.2444 (2.25) 0.0000 (1.0) 0;0 0.2356 (0.45) 1 1
test_checkout_copy-checkout[main] 3.6383 (1.93) 3.6383 (1.93) 3.6383 (1.93) 0.0000 (1.0) 3.6383 (1.93) 0.0000 (1.0) 0;0 0.2749 (0.52) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.11.0] 493.7928 (1.0) 493.7928 (1.0) 493.7928 (1.0) 0.0000 (1.0) 493.7928 (1.0) 0.0000 (1.0) 0;0 2.0251 (1.0) 1 1
test_checkout_copy-checkout-noop[2.40.0] 570.4146 (1.16) 570.4146 (1.16) 570.4146 (1.16) 0.0000 (1.0) 570.4146 (1.16) 0.0000 (1.0) 0;0 1.7531 (0.87) 1 1
test_checkout_copy-checkout-noop[2.58.2] 628.3583 (1.27) 628.3583 (1.27) 628.3583 (1.27) 0.0000 (1.0) 628.3583 (1.27) 0.0000 (1.0) 0;0 1.5914 (0.79) 1 1
test_checkout_copy-checkout-noop[3.0.0] 652.7109 (1.32) 652.7109 (1.32) 652.7109 (1.32) 0.0000 (1.0) 652.7109 (1.32) 0.0000 (1.0) 0;0 1.5321 (0.76) 1 1
test_checkout_copy-checkout-noop[main] 649.1852 (1.31) 649.1852 (1.31) 649.1852 (1.31) 0.0000 (1.0) 649.1852 (1.31) 0.0000 (1.0) 0;0 1.5404 (0.76) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.11.0] 1.2077 (1.89) 1.2077 (1.89) 1.2077 (1.89) 0.0000 (1.0) 1.2077 (1.89) 0.0000 (1.0) 0;0 0.8280 (0.53) 1 1
test_checkout_copy-checkout-update[2.40.0] 0.6401 (1.0) 0.6401 (1.0) 0.6401 (1.0) 0.0000 (1.0) 0.6401 (1.0) 0.0000 (1.0) 0;0 1.5622 (1.0) 1 1
test_checkout_copy-checkout-update[2.58.2] 1.1357 (1.77) 1.1357 (1.77) 1.1357 (1.77) 0.0000 (1.0) 1.1357 (1.77) 0.0000 (1.0) 0;0 0.8805 (0.56) 1 1
test_checkout_copy-checkout-update[3.0.0] 0.7215 (1.13) 0.7215 (1.13) 0.7215 (1.13) 0.0000 (1.0) 0.7215 (1.13) 0.0000 (1.0) 0;0 1.3860 (0.89) 1 1
test_checkout_copy-checkout-update[main] 0.7145 (1.12) 0.7145 (1.12) 0.7145 (1.12) 0.0000 (1.0) 0.7145 (1.12) 0.0000 (1.0) 0;0 1.3996 (0.90) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.11.0] 435.5304 (1.0) 435.5304 (1.0) 435.5304 (1.0) 0.0000 (1.0) 435.5304 (1.0) 0.0000 (1.0) 0;0 2.2961 (1.0) 1 1
test_gc-gc[2.40.0] 491.4267 (1.13) 491.4267 (1.13) 491.4267 (1.13) 0.0000 (1.0) 491.4267 (1.13) 0.0000 (1.0) 0;0 2.0349 (0.89) 1 1
test_gc-gc[2.58.2] 541.2145 (1.24) 541.2145 (1.24) 541.2145 (1.24) 0.0000 (1.0) 541.2145 (1.24) 0.0000 (1.0) 0;0 1.8477 (0.80) 1 1
test_gc-gc[3.0.0] 532.0553 (1.22) 532.0553 (1.22) 532.0553 (1.22) 0.0000 (1.0) 532.0553 (1.22) 0.0000 (1.0) 0;0 1.8795 (0.82) 1 1
test_gc-gc[main] 530.8987 (1.22) 530.8987 (1.22) 530.8987 (1.22) 0.0000 (1.0) 530.8987 (1.22) 0.0000 (1.0) 0;0 1.8836 (0.82) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.11.0] 1.4290 (1.11) 1.4290 (1.11) 1.4290 (1.11) 0.0000 (1.0) 1.4290 (1.11) 0.0000 (1.0) 0;0 0.6998 (0.90) 1 1
test_checkout_symlink-checkout[2.40.0] 1.3835 (1.08) 1.3835 (1.08) 1.3835 (1.08) 0.0000 (1.0) 1.3835 (1.08) 0.0000 (1.0) 0;0 0.7228 (0.93) 1 1
test_checkout_symlink-checkout[2.58.2] 1.9791 (1.54) 1.9791 (1.54) 1.9791 (1.54) 0.0000 (1.0) 1.9791 (1.54) 0.0000 (1.0) 0;0 0.5053 (0.65) 1 1
test_checkout_symlink-checkout[3.0.0] 1.4730 (1.15) 1.4730 (1.15) 1.4730 (1.15) 0.0000 (1.0) 1.4730 (1.15) 0.0000 (1.0) 0;0 0.6789 (0.87) 1 1
test_checkout_symlink-checkout[main] 1.2855 (1.0) 1.2855 (1.0) 1.2855 (1.0) 0.0000 (1.0) 1.2855 (1.0) 0.0000 (1.0) 0;0 0.7779 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.11.0] 533.7826 (1.0) 533.7826 (1.0) 533.7826 (1.0) 0.0000 (1.0) 533.7826 (1.0) 0.0000 (1.0) 0;0 1.8734 (1.0) 1 1
test_checkout_symlink-checkout-noop[2.40.0] 608.3173 (1.14) 608.3173 (1.14) 608.3173 (1.14) 0.0000 (1.0) 608.3173 (1.14) 0.0000 (1.0) 0;0 1.6439 (0.88) 1 1
test_checkout_symlink-checkout-noop[2.58.2] 694.0199 (1.30) 694.0199 (1.30) 694.0199 (1.30) 0.0000 (1.0) 694.0199 (1.30) 0.0000 (1.0) 0;0 1.4409 (0.77) 1 1
test_checkout_symlink-checkout-noop[3.0.0] 708.5403 (1.33) 708.5403 (1.33) 708.5403 (1.33) 0.0000 (1.0) 708.5403 (1.33) 0.0000 (1.0) 0;0 1.4114 (0.75) 1 1
test_checkout_symlink-checkout-noop[main] 701.3585 (1.31) 701.3585 (1.31) 701.3585 (1.31) 0.0000 (1.0) 701.3585 (1.31) 0.0000 (1.0) 0;0 1.4258 (0.76) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.11.0] 1.4990 (2.12) 1.4990 (2.12) 1.4990 (2.12) 0.0000 (1.0) 1.4990 (2.12) 0.0000 (1.0) 0;0 0.6671 (0.47) 1 1
test_checkout_symlink-checkout-update[2.40.0] 0.7054 (1.0) 0.7054 (1.0) 0.7054 (1.0) 0.0000 (1.0) 0.7054 (1.0) 0.0000 (1.0) 0;0 1.4176 (1.0) 1 1
test_checkout_symlink-checkout-update[2.58.2] 0.9119 (1.29) 0.9119 (1.29) 0.9119 (1.29) 0.0000 (1.0) 0.9119 (1.29) 0.0000 (1.0) 0;0 1.0966 (0.77) 1 1
test_checkout_symlink-checkout-update[3.0.0] 0.8140 (1.15) 0.8140 (1.15) 0.8140 (1.15) 0.0000 (1.0) 0.8140 (1.15) 0.0000 (1.0) 0;0 1.2286 (0.87) 1 1
test_checkout_symlink-checkout-update[main] 0.8068 (1.14) 0.8068 (1.14) 0.8068 (1.14) 0.0000 (1.0) 0.8068 (1.14) 0.0000 (1.0) 0;0 1.2395 (0.87) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_pull-pull': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull[2.11.0] 6.6091 (1.29) 6.6091 (1.29) 6.6091 (1.29) 0.0000 (1.0) 6.6091 (1.29) 0.0000 (1.0) 0;0 0.1513 (0.78) 1 1
test_pull-pull[2.40.0] 7.8119 (1.53) 7.8119 (1.53) 7.8119 (1.53) 0.0000 (1.0) 7.8119 (1.53) 0.0000 (1.0) 0;0 0.1280 (0.66) 1 1
test_pull-pull[2.58.2] 5.1222 (1.0) 5.1222 (1.0) 5.1222 (1.0) 0.0000 (1.0) 5.1222 (1.0) 0.0000 (1.0) 0;0 0.1952 (1.0) 1 1
test_pull-pull[3.0.0] 7.1740 (1.40) 7.1740 (1.40) 7.1740 (1.40) 0.0000 (1.0) 7.1740 (1.40) 0.0000 (1.0) 0;0 0.1394 (0.71) 1 1
test_pull-pull[main] 7.1440 (1.39) 7.1440 (1.39) 7.1440 (1.39) 0.0000 (1.0) 7.1440 (1.39) 0.0000 (1.0) 0;0 0.1400 (0.72) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.11.0] 7.5067 (1.77) 7.5067 (1.77) 7.5067 (1.77) 0.0000 (1.0) 7.5067 (1.77) 0.0000 (1.0) 0;0 0.1332 (0.57) 1 1
test_sharing-add[2.40.0] 6.2506 (1.47) 6.2506 (1.47) 6.2506 (1.47) 0.0000 (1.0) 6.2506 (1.47) 0.0000 (1.0) 0;0 0.1600 (0.68) 1 1
test_sharing-add[2.58.2] 4.3140 (1.02) 4.3140 (1.02) 4.3140 (1.02) 0.0000 (1.0) 4.3140 (1.02) 0.0000 (1.0) 0;0 0.2318 (0.98) 1 1
test_sharing-add[3.0.0] 4.2453 (1.0) 4.2453 (1.0) 4.2453 (1.0) 0.0000 (1.0) 4.2453 (1.0) 0.0000 (1.0) 0;0 0.2356 (1.0) 1 1
test_sharing-add[main] 4.2469 (1.00) 4.2469 (1.00) 4.2469 (1.00) 0.0000 (1.0) 4.2469 (1.00) 0.0000 (1.0) 0;0 0.2355 (1.00) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.11.0] 3.6012 (1.39) 3.6012 (1.39) 3.6012 (1.39) 0.0000 (1.0) 3.6012 (1.39) 0.0000 (1.0) 0;0 0.2777 (0.72) 1 1
test_sharing-add-noop[2.40.0] 2.5851 (1.0) 2.5851 (1.0) 2.5851 (1.0) 0.0000 (1.0) 2.5851 (1.0) 0.0000 (1.0) 0;0 0.3868 (1.0) 1 1
test_sharing-add-noop[2.58.2] 2.8480 (1.10) 2.8480 (1.10) 2.8480 (1.10) 0.0000 (1.0) 2.8480 (1.10) 0.0000 (1.0) 0;0 0.3511 (0.91) 1 1
test_sharing-add-noop[3.0.0] 2.9140 (1.13) 2.9140 (1.13) 2.9140 (1.13) 0.0000 (1.0) 2.9140 (1.13) 0.0000 (1.0) 0;0 0.3432 (0.89) 1 1
test_sharing-add-noop[main] 2.7947 (1.08) 2.7947 (1.08) 2.7947 (1.08) 0.0000 (1.0) 2.7947 (1.08) 0.0000 (1.0) 0;0 0.3578 (0.93) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.11.0] 521.9734 (1.0) 521.9734 (1.0) 521.9734 (1.0) 0.0000 (1.0) 521.9734 (1.0) 0.0000 (1.0) 0;0 1.9158 (1.0) 1 1
test_sharing-checkout-noop[2.40.0] 662.7618 (1.27) 662.7618 (1.27) 662.7618 (1.27) 0.0000 (1.0) 662.7618 (1.27) 0.0000 (1.0) 0;0 1.5088 (0.79) 1 1
test_sharing-checkout-noop[2.58.2] 672.6718 (1.29) 672.6718 (1.29) 672.6718 (1.29) 0.0000 (1.0) 672.6718 (1.29) 0.0000 (1.0) 0;0 1.4866 (0.78) 1 1
test_sharing-checkout-noop[3.0.0] 723.9182 (1.39) 723.9182 (1.39) 723.9182 (1.39) 0.0000 (1.0) 723.9182 (1.39) 0.0000 (1.0) 0;0 1.3814 (0.72) 1 1
test_sharing-checkout-noop[main] 722.7288 (1.38) 722.7288 (1.38) 722.7288 (1.38) 0.0000 (1.0) 722.7288 (1.38) 0.0000 (1.0) 0;0 1.3836 (0.72) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-pull': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull[2.11.0] 7.3768 (1.31) 7.3768 (1.31) 7.3768 (1.31) 0.0000 (1.0) 7.3768 (1.31) 0.0000 (1.0) 0;0 0.1356 (0.76) 1 1
test_sharing-pull[2.40.0] 8.8846 (1.58) 8.8846 (1.58) 8.8846 (1.58) 0.0000 (1.0) 8.8846 (1.58) 0.0000 (1.0) 0;0 0.1126 (0.63) 1 1
test_sharing-pull[2.58.2] 5.6112 (1.0) 5.6112 (1.0) 5.6112 (1.0) 0.0000 (1.0) 5.6112 (1.0) 0.0000 (1.0) 0;0 0.1782 (1.0) 1 1
test_sharing-pull[3.0.0] 8.0564 (1.44) 8.0564 (1.44) 8.0564 (1.44) 0.0000 (1.0) 8.0564 (1.44) 0.0000 (1.0) 0;0 0.1241 (0.70) 1 1
test_sharing-pull[main] 7.9952 (1.42) 7.9952 (1.42) 7.9952 (1.42) 0.0000 (1.0) 7.9952 (1.42) 0.0000 (1.0) 0;0 0.1251 (0.70) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop[2.11.0] 553.4498 (1.0) 553.4498 (1.0) 553.4498 (1.0) 0.0000 (1.0) 553.4498 (1.0) 0.0000 (1.0) 0;0 1.8068 (1.0) 1 1
test_sharing-pull-noop[2.40.0] 673.9690 (1.22) 673.9690 (1.22) 673.9690 (1.22) 0.0000 (1.0) 673.9690 (1.22) 0.0000 (1.0) 0;0 1.4837 (0.82) 1 1
test_sharing-pull-noop[2.58.2] 743.9709 (1.34) 743.9709 (1.34) 743.9709 (1.34) 0.0000 (1.0) 743.9709 (1.34) 0.0000 (1.0) 0;0 1.3441 (0.74) 1 1
test_sharing-pull-noop[3.0.0] 852.0280 (1.54) 852.0280 (1.54) 852.0280 (1.54) 0.0000 (1.0) 852.0280 (1.54) 0.0000 (1.0) 0;0 1.1737 (0.65) 1 1
test_sharing-pull-noop[main] 845.4470 (1.53) 845.4470 (1.53) 845.4470 (1.53) 0.0000 (1.0) 845.4470 (1.53) 0.0000 (1.0) 0;0 1.1828 (0.65) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.11.0] 4.1422 (2.23) 4.1422 (2.23) 4.1422 (2.23) 0.0000 (1.0) 4.1422 (2.23) 0.0000 (1.0) 0;0 0.2414 (0.45) 1 1
test_sharing-push[2.40.0] 5.2663 (2.83) 5.2663 (2.83) 5.2663 (2.83) 0.0000 (1.0) 5.2663 (2.83) 0.0000 (1.0) 0;0 0.1899 (0.35) 1 1
test_sharing-push[2.58.2] 3.5918 (1.93) 3.5918 (1.93) 3.5918 (1.93) 0.0000 (1.0) 3.5918 (1.93) 0.0000 (1.0) 0;0 0.2784 (0.52) 1 1
test_sharing-push[3.0.0] 1.8606 (1.0) 1.8606 (1.0) 1.8606 (1.0) 0.0000 (1.0) 1.8606 (1.0) 0.0000 (1.0) 0;0 0.5375 (1.0) 1 1
test_sharing-push[main] 3.6143 (1.94) 3.6143 (1.94) 3.6143 (1.94) 0.0000 (1.0) 3.6143 (1.94) 0.0000 (1.0) 0;0 0.2767 (0.51) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.11.0] 482.7621 (1.0) 482.7621 (1.0) 482.7621 (1.0) 0.0000 (1.0) 482.7621 (1.0) 0.0000 (1.0) 0;0 2.0714 (1.0) 1 1
test_sharing-push-noop[2.40.0] 501.4975 (1.04) 501.4975 (1.04) 501.4975 (1.04) 0.0000 (1.0) 501.4975 (1.04) 0.0000 (1.0) 0;0 1.9940 (0.96) 1 1
test_sharing-push-noop[2.58.2] 557.8932 (1.16) 557.8932 (1.16) 557.8932 (1.16) 0.0000 (1.0) 557.8932 (1.16) 0.0000 (1.0) 0;0 1.7925 (0.87) 1 1
test_sharing-push-noop[3.0.0] 563.6883 (1.17) 563.6883 (1.17) 563.6883 (1.17) 0.0000 (1.0) 563.6883 (1.17) 0.0000 (1.0) 0;0 1.7740 (0.86) 1 1
test_sharing-push-noop[main] 573.4004 (1.19) 573.4004 (1.19) 573.4004 (1.19) 0.0000 (1.0) 573.4004 (1.19) 0.0000 (1.0) 0;0 1.7440 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.11.0] 2.1150 (1.23) 2.1150 (1.23) 2.1150 (1.23) 0.0000 (1.0) 2.1150 (1.23) 0.0000 (1.0) 0;0 0.4728 (0.81) 1 1
test_diff-diff[2.40.0] 1.7907 (1.05) 1.7907 (1.05) 1.7907 (1.05) 0.0000 (1.0) 1.7907 (1.05) 0.0000 (1.0) 0;0 0.5584 (0.96) 1 1
test_diff-diff[2.58.2] 1.7209 (1.00) 1.7209 (1.00) 1.7209 (1.00) 0.0000 (1.0) 1.7209 (1.00) 0.0000 (1.0) 0;0 0.5811 (1.00) 1 1
test_diff-diff[3.0.0] 1.7384 (1.01) 1.7384 (1.01) 1.7384 (1.01) 0.0000 (1.0) 1.7384 (1.01) 0.0000 (1.0) 0;0 0.5752 (0.99) 1 1
test_diff-diff[main] 1.7132 (1.0) 1.7132 (1.0) 1.7132 (1.0) 0.0000 (1.0) 1.7132 (1.0) 0.0000 (1.0) 0;0 0.5837 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_diff-diff-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.11.0] 1.3687 (1.65) 1.3687 (1.65) 1.3687 (1.65) 0.0000 (1.0) 1.3687 (1.65) 0.0000 (1.0) 0;0 0.7306 (0.61) 1 1
test_diff-diff-changed[2.40.0] 0.8310 (1.0) 0.8310 (1.0) 0.8310 (1.0) 0.0000 (1.0) 0.8310 (1.0) 0.0000 (1.0) 0;0 1.2034 (1.0) 1 1
test_diff-diff-changed[2.58.2] 0.9145 (1.10) 0.9145 (1.10) 0.9145 (1.10) 0.0000 (1.0) 0.9145 (1.10) 0.0000 (1.0) 0;0 1.0935 (0.91) 1 1
test_diff-diff-changed[3.0.0] 0.9266 (1.12) 0.9266 (1.12) 0.9266 (1.12) 0.0000 (1.0) 0.9266 (1.12) 0.0000 (1.0) 0;0 1.0792 (0.90) 1 1
test_diff-diff-changed[main] 0.8947 (1.08) 0.8947 (1.08) 0.8947 (1.08) 0.0000 (1.0) 0.8947 (1.08) 0.0000 (1.0) 0;0 1.1177 (0.93) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.11.0] 597.0482 (1.0) 597.0482 (1.0) 597.0482 (1.0) 0.0000 (1.0) 597.0482 (1.0) 0.0000 (1.0) 0;0 1.6749 (1.0) 1 1
test_diff-diff-changed-noop[2.40.0] 793.5227 (1.33) 793.5227 (1.33) 793.5227 (1.33) 0.0000 (1.0) 793.5227 (1.33) 0.0000 (1.0) 0;0 1.2602 (0.75) 1 1
test_diff-diff-changed-noop[2.58.2] 867.6990 (1.45) 867.6990 (1.45) 867.6990 (1.45) 0.0000 (1.0) 867.6990 (1.45) 0.0000 (1.0) 0;0 1.1525 (0.69) 1 1
test_diff-diff-changed-noop[3.0.0] 858.3063 (1.44) 858.3063 (1.44) 858.3063 (1.44) 0.0000 (1.0) 858.3063 (1.44) 0.0000 (1.0) 0;0 1.1651 (0.70) 1 1
test_diff-diff-changed-noop[main] 863.2023 (1.45) 863.2023 (1.45) 863.2023 (1.45) 0.0000 (1.0) 863.2023 (1.45) 0.0000 (1.0) 0;0 1.1585 (0.69) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.11.0] 543.4513 (1.0) 543.4513 (1.0) 543.4513 (1.0) 0.0000 (1.0) 543.4513 (1.0) 0.0000 (1.0) 0;0 1.8401 (1.0) 1 1
test_diff-diff-noop[2.40.0] 813.9803 (1.50) 813.9803 (1.50) 813.9803 (1.50) 0.0000 (1.0) 813.9803 (1.50) 0.0000 (1.0) 0;0 1.2285 (0.67) 1 1
test_diff-diff-noop[2.58.2] 796.1273 (1.46) 796.1273 (1.46) 796.1273 (1.46) 0.0000 (1.0) 796.1273 (1.46) 0.0000 (1.0) 0;0 1.2561 (0.68) 1 1
test_diff-diff-noop[3.0.0] 791.8182 (1.46) 791.8182 (1.46) 791.8182 (1.46) 0.0000 (1.0) 791.8182 (1.46) 0.0000 (1.0) 0;0 1.2629 (0.69) 1 1
test_diff-diff-noop[main] 769.5609 (1.42) 769.5609 (1.42) 769.5609 (1.42) 0.0000 (1.0) 769.5609 (1.42) 0.0000 (1.0) 0;0 1.2994 (0.71) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import_url-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.11.0] 13.2535 (1.44) 13.2535 (1.44) 13.2535 (1.44) 0.0000 (1.0) 13.2535 (1.44) 0.0000 (1.0) 0;0 0.0755 (0.70) 1 1
test_import_url-import-url[2.40.0] 11.4830 (1.24) 11.4830 (1.24) 11.4830 (1.24) 0.0000 (1.0) 11.4830 (1.24) 0.0000 (1.0) 0;0 0.0871 (0.80) 1 1
test_import_url-import-url[2.58.2] 9.2256 (1.0) 9.2256 (1.0) 9.2256 (1.0) 0.0000 (1.0) 9.2256 (1.0) 0.0000 (1.0) 0;0 0.1084 (1.0) 1 1
test_import_url-import-url[3.0.0] 9.2401 (1.00) 9.2401 (1.00) 9.2401 (1.00) 0.0000 (1.0) 9.2401 (1.00) 0.0000 (1.0) 0;0 0.1082 (1.00) 1 1
test_import_url-import-url[main] 9.2591 (1.00) 9.2591 (1.00) 9.2591 (1.00) 0.0000 (1.0) 9.2591 (1.00) 0.0000 (1.0) 0;0 0.1080 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.40.0] 557.6279 (1.05) 584.5378 (1.05) 567.2210 (1.05) 10.2827 (2.27) 565.5947 (1.06) 10.0480 (1.71) 1;0 1.7630 (0.95) 5 3
test_plots-plots-diff[2.58.2] 532.2737 (1.0) 556.0268 (1.0) 538.0200 (1.0) 10.1283 (2.23) 533.4398 (1.0) 7.6469 (1.30) 1;1 1.8587 (1.0) 5 3
test_plots-plots-diff[3.0.0] 977.1269 (1.84) 989.1560 (1.78) 982.9098 (1.83) 4.5324 (1.0) 983.9804 (1.84) 5.8906 (1.0) 2;0 1.0174 (0.55) 5 3
test_plots-plots-diff[main] 978.9379 (1.84) 992.0776 (1.78) 985.1775 (1.83) 5.3030 (1.17) 983.7985 (1.84) 8.4576 (1.44) 2;0 1.0150 (0.55) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.40.0] 589.6656 (1.08) 600.0283 (1.08) 594.5909 (1.08) 4.5580 (2.19) 595.5099 (1.08) 8.1437 (2.28) 2;0 1.6818 (0.93) 5 3
test_plots-plots-diff-json[2.58.2] 548.1884 (1.0) 553.1378 (1.0) 550.3718 (1.0) 2.0839 (1.0) 550.2496 (1.0) 3.5690 (1.0) 2;0 1.8170 (1.0) 5 3
test_plots-plots-diff-json[3.0.0] 1,362.8752 (2.49) 1,388.7140 (2.51) 1,376.9046 (2.50) 9.5855 (4.60) 1,378.7073 (2.51) 12.0627 (3.38) 2;0 0.7263 (0.40) 5 3
test_plots-plots-diff-json[main] 1,364.2194 (2.49) 1,381.0087 (2.50) 1,371.6972 (2.49) 6.8056 (3.27) 1,370.6788 (2.49) 11.0114 (3.09) 2;0 0.7290 (0.40) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.40.0] 428.0779 (1.0) 435.7996 (1.0) 431.1192 (1.0) 2.9101 (1.75) 430.8631 (1.0) 3.3123 (1.58) 2;0 2.3195 (1.0) 5 3
test_plots-plots-show[2.58.2] 494.8642 (1.16) 499.2930 (1.15) 497.3411 (1.15) 1.6606 (1.0) 497.4058 (1.15) 2.1543 (1.02) 2;0 2.0107 (0.87) 5 3
test_plots-plots-show[3.0.0] 793.5950 (1.85) 798.1447 (1.83) 795.5501 (1.85) 1.7116 (1.03) 795.7021 (1.85) 2.1023 (1.0) 2;0 1.2570 (0.54) 5 3
test_plots-plots-show[main] 800.9741 (1.87) 806.4699 (1.85) 804.1549 (1.87) 2.1112 (1.27) 804.6488 (1.87) 2.8884 (1.37) 2;0 1.2435 (0.54) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.40.0] 465.0346 (1.0) 468.9822 (1.0) 467.0219 (1.0) 1.4451 (1.0) 467.1560 (1.0) 1.7642 (1.0) 2;0 2.1412 (1.0) 5 3
test_plots-plots-show-json[2.58.2] 512.2642 (1.10) 518.7883 (1.11) 516.0282 (1.10) 2.8685 (1.99) 517.5263 (1.11) 4.7703 (2.70) 1;0 1.9379 (0.91) 5 3
test_plots-plots-show-json[3.0.0] 1,008.9209 (2.17) 1,022.4908 (2.18) 1,012.9818 (2.17) 5.5271 (3.82) 1,011.5951 (2.17) 5.7905 (3.28) 1;0 0.9872 (0.46) 5 3
test_plots-plots-show-json[main] 1,007.0424 (2.17) 1,014.4599 (2.16) 1,010.8696 (2.16) 3.0111 (2.08) 1,010.4736 (2.16) 4.9232 (2.79) 2;0 0.9892 (0.46) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------- benchmark 'test_sharing_gs-add': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add[2.11.0] 7.7184 (1.85) 7.7184 (1.85) 7.7184 (1.85) 0.0000 (1.0) 7.7184 (1.85) 0.0000 (1.0) 0;0 0.1296 (0.54) 1 1
test_sharing_gs-add[2.11.0] 7.9733 (1.91) 7.9733 (1.91) 7.9733 (1.91) 0.0000 (1.0) 7.9733 (1.91) 0.0000 (1.0) 0;0 0.1254 (0.52) 1 1
test_sharing_gs-add[2.40.0] 6.6068 (1.59) 6.6068 (1.59) 6.6068 (1.59) 0.0000 (1.0) 6.6068 (1.59) 0.0000 (1.0) 0;0 0.1514 (0.63) 1 1
test_sharing_gs-add[2.40.0] 6.1698 (1.48) 6.1698 (1.48) 6.1698 (1.48) 0.0000 (1.0) 6.1698 (1.48) 0.0000 (1.0) 0;0 0.1621 (0.68) 1 1
test_sharing_gs-add[2.58.2] 4.6068 (1.11) 4.6068 (1.11) 4.6068 (1.11) 0.0000 (1.0) 4.6068 (1.11) 0.0000 (1.0) 0;0 0.2171 (0.90) 1 1
test_sharing_gs-add[2.58.2] 4.6752 (1.12) 4.6752 (1.12) 4.6752 (1.12) 0.0000 (1.0) 4.6752 (1.12) 0.0000 (1.0) 0;0 0.2139 (0.89) 1 1
test_sharing_gs-add[3.0.0] 4.4795 (1.07) 4.4795 (1.07) 4.4795 (1.07) 0.0000 (1.0) 4.4795 (1.07) 0.0000 (1.0) 0;0 0.2232 (0.93) 1 1
test_sharing_gs-add[3.0.0] 4.5852 (1.10) 4.5852 (1.10) 4.5852 (1.10) 0.0000 (1.0) 4.5852 (1.10) 0.0000 (1.0) 0;0 0.2181 (0.91) 1 1
test_sharing_gs-add[main] 4.5258 (1.09) 4.5258 (1.09) 4.5258 (1.09) 0.0000 (1.0) 4.5258 (1.09) 0.0000 (1.0) 0;0 0.2210 (0.92) 1 1
test_sharing_gs-add[main] 4.1675 (1.0) 4.1675 (1.0) 4.1675 (1.0) 0.0000 (1.0) 4.1675 (1.0) 0.0000 (1.0) 0;0 0.2400 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-add-noop[2.11.0] 3.4122 (1.41) 3.4122 (1.41) 3.4122 (1.41) 0.0000 (1.0) 3.4122 (1.41) 0.0000 (1.0) 0;0 0.2931 (0.71) 1 1
test_sharing_gs-add-noop[2.11.0] 3.8596 (1.60) 3.8596 (1.60) 3.8596 (1.60) 0.0000 (1.0) 3.8596 (1.60) 0.0000 (1.0) 0;0 0.2591 (0.63) 1 1
test_sharing_gs-add-noop[2.40.0] 2.8321 (1.17) 2.8321 (1.17) 2.8321 (1.17) 0.0000 (1.0) 2.8321 (1.17) 0.0000 (1.0) 0;0 0.3531 (0.85) 1 1
test_sharing_gs-add-noop[2.40.0] 2.4190 (1.0) 2.4190 (1.0) 2.4190 (1.0) 0.0000 (1.0) 2.4190 (1.0) 0.0000 (1.0) 0;0 0.4134 (1.0) 1 1
test_sharing_gs-add-noop[2.58.2] 2.9272 (1.21) 2.9272 (1.21) 2.9272 (1.21) 0.0000 (1.0) 2.9272 (1.21) 0.0000 (1.0) 0;0 0.3416 (0.83) 1 1
test_sharing_gs-add-noop[2.58.2] 2.9586 (1.22) 2.9586 (1.22) 2.9586 (1.22) 0.0000 (1.0) 2.9586 (1.22) 0.0000 (1.0) 0;0 0.3380 (0.82) 1 1
test_sharing_gs-add-noop[3.0.0] 2.9802 (1.23) 2.9802 (1.23) 2.9802 (1.23) 0.0000 (1.0) 2.9802 (1.23) 0.0000 (1.0) 0;0 0.3356 (0.81) 1 1
test_sharing_gs-add-noop[3.0.0] 3.1708 (1.31) 3.1708 (1.31) 3.1708 (1.31) 0.0000 (1.0) 3.1708 (1.31) 0.0000 (1.0) 0;0 0.3154 (0.76) 1 1
test_sharing_gs-add-noop[main] 2.9148 (1.20) 2.9148 (1.20) 2.9148 (1.20) 0.0000 (1.0) 2.9148 (1.20) 0.0000 (1.0) 0;0 0.3431 (0.83) 1 1
test_sharing_gs-add-noop[main] 2.6650 (1.10) 2.6650 (1.10) 2.6650 (1.10) 0.0000 (1.0) 2.6650 (1.10) 0.0000 (1.0) 0;0 0.3752 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-checkout-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-checkout-noop[2.11.0] 473.8033 (1.0) 473.8033 (1.0) 473.8033 (1.0) 0.0000 (1.0) 473.8033 (1.0) 0.0000 (1.0) 0;0 2.1106 (1.0) 1 1
test_sharing_gs-checkout-noop[2.11.0] 492.8199 (1.04) 492.8199 (1.04) 492.8199 (1.04) 0.0000 (1.0) 492.8199 (1.04) 0.0000 (1.0) 0;0 2.0291 (0.96) 1 1
test_sharing_gs-checkout-noop[2.40.0] 652.2839 (1.38) 652.2839 (1.38) 652.2839 (1.38) 0.0000 (1.0) 652.2839 (1.38) 0.0000 (1.0) 0;0 1.5331 (0.73) 1 1
test_sharing_gs-checkout-noop[2.40.0] 567.4488 (1.20) 567.4488 (1.20) 567.4488 (1.20) 0.0000 (1.0) 567.4488 (1.20) 0.0000 (1.0) 0;0 1.7623 (0.83) 1 1
test_sharing_gs-checkout-noop[2.58.2] 706.7379 (1.49) 706.7379 (1.49) 706.7379 (1.49) 0.0000 (1.0) 706.7379 (1.49) 0.0000 (1.0) 0;0 1.4150 (0.67) 1 1
test_sharing_gs-checkout-noop[2.58.2] 690.9108 (1.46) 690.9108 (1.46) 690.9108 (1.46) 0.0000 (1.0) 690.9108 (1.46) 0.0000 (1.0) 0;0 1.4474 (0.69) 1 1
test_sharing_gs-checkout-noop[3.0.0] 876.1809 (1.85) 876.1809 (1.85) 876.1809 (1.85) 0.0000 (1.0) 876.1809 (1.85) 0.0000 (1.0) 0;0 1.1413 (0.54) 1 1
test_sharing_gs-checkout-noop[3.0.0] 817.2661 (1.72) 817.2661 (1.72) 817.2661 (1.72) 0.0000 (1.0) 817.2661 (1.72) 0.0000 (1.0) 0;0 1.2236 (0.58) 1 1
test_sharing_gs-checkout-noop[main] 704.2567 (1.49) 704.2567 (1.49) 704.2567 (1.49) 0.0000 (1.0) 704.2567 (1.49) 0.0000 (1.0) 0;0 1.4199 (0.67) 1 1
test_sharing_gs-checkout-noop[main] 699.3867 (1.48) 699.3867 (1.48) 699.3867 (1.48) 0.0000 (1.0) 699.3867 (1.48) 0.0000 (1.0) 0;0 1.4298 (0.68) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-pull': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull[2.11.0] 7.2230 (1.18) 7.2230 (1.18) 7.2230 (1.18) 0.0000 (1.0) 7.2230 (1.18) 0.0000 (1.0) 0;0 0.1384 (0.85) 1 1
test_sharing_gs-pull[2.11.0] 8.5963 (1.40) 8.5963 (1.40) 8.5963 (1.40) 0.0000 (1.0) 8.5963 (1.40) 0.0000 (1.0) 0;0 0.1163 (0.71) 1 1
test_sharing_gs-pull[2.40.0] 9.4141 (1.54) 9.4141 (1.54) 9.4141 (1.54) 0.0000 (1.0) 9.4141 (1.54) 0.0000 (1.0) 0;0 0.1062 (0.65) 1 1
test_sharing_gs-pull[2.40.0] 8.9043 (1.45) 8.9043 (1.45) 8.9043 (1.45) 0.0000 (1.0) 8.9043 (1.45) 0.0000 (1.0) 0;0 0.1123 (0.69) 1 1
test_sharing_gs-pull[2.58.2] 6.1388 (1.00) 6.1388 (1.00) 6.1388 (1.00) 0.0000 (1.0) 6.1388 (1.00) 0.0000 (1.0) 0;0 0.1629 (1.00) 1 1
test_sharing_gs-pull[2.58.2] 6.1301 (1.0) 6.1301 (1.0) 6.1301 (1.0) 0.0000 (1.0) 6.1301 (1.0) 0.0000 (1.0) 0;0 0.1631 (1.0) 1 1
test_sharing_gs-pull[3.0.0] 8.8837 (1.45) 8.8837 (1.45) 8.8837 (1.45) 0.0000 (1.0) 8.8837 (1.45) 0.0000 (1.0) 0;0 0.1126 (0.69) 1 1
test_sharing_gs-pull[3.0.0] 9.6626 (1.58) 9.6626 (1.58) 9.6626 (1.58) 0.0000 (1.0) 9.6626 (1.58) 0.0000 (1.0) 0;0 0.1035 (0.63) 1 1
test_sharing_gs-pull[main] 8.4268 (1.37) 8.4268 (1.37) 8.4268 (1.37) 0.0000 (1.0) 8.4268 (1.37) 0.0000 (1.0) 0;0 0.1187 (0.73) 1 1
test_sharing_gs-pull[main] 8.5861 (1.40) 8.5861 (1.40) 8.5861 (1.40) 0.0000 (1.0) 8.5861 (1.40) 0.0000 (1.0) 0;0 0.1165 (0.71) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-pull-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-pull-noop[2.11.0] 510.3085 (1.0) 510.3085 (1.0) 510.3085 (1.0) 0.0000 (1.0) 510.3085 (1.0) 0.0000 (1.0) 0;0 1.9596 (1.0) 1 1
test_sharing_gs-pull-noop[2.11.0] 537.7614 (1.05) 537.7614 (1.05) 537.7614 (1.05) 0.0000 (1.0) 537.7614 (1.05) 0.0000 (1.0) 0;0 1.8596 (0.95) 1 1
test_sharing_gs-pull-noop[2.40.0] 616.3564 (1.21) 616.3564 (1.21) 616.3564 (1.21) 0.0000 (1.0) 616.3564 (1.21) 0.0000 (1.0) 0;0 1.6224 (0.83) 1 1
test_sharing_gs-pull-noop[2.40.0] 606.2671 (1.19) 606.2671 (1.19) 606.2671 (1.19) 0.0000 (1.0) 606.2671 (1.19) 0.0000 (1.0) 0;0 1.6494 (0.84) 1 1
test_sharing_gs-pull-noop[2.58.2] 761.5320 (1.49) 761.5320 (1.49) 761.5320 (1.49) 0.0000 (1.0) 761.5320 (1.49) 0.0000 (1.0) 0;0 1.3131 (0.67) 1 1
test_sharing_gs-pull-noop[2.58.2] 739.7993 (1.45) 739.7993 (1.45) 739.7993 (1.45) 0.0000 (1.0) 739.7993 (1.45) 0.0000 (1.0) 0;0 1.3517 (0.69) 1 1
test_sharing_gs-pull-noop[3.0.0] 938.6403 (1.84) 938.6403 (1.84) 938.6403 (1.84) 0.0000 (1.0) 938.6403 (1.84) 0.0000 (1.0) 0;0 1.0654 (0.54) 1 1
test_sharing_gs-pull-noop[3.0.0] 930.7138 (1.82) 930.7138 (1.82) 930.7138 (1.82) 0.0000 (1.0) 930.7138 (1.82) 0.0000 (1.0) 0;0 1.0744 (0.55) 1 1
test_sharing_gs-pull-noop[main] 863.0037 (1.69) 863.0037 (1.69) 863.0037 (1.69) 0.0000 (1.0) 863.0037 (1.69) 0.0000 (1.0) 0;0 1.1587 (0.59) 1 1
test_sharing_gs-pull-noop[main] 906.2731 (1.78) 906.2731 (1.78) 906.2731 (1.78) 0.0000 (1.0) 906.2731 (1.78) 0.0000 (1.0) 0;0 1.1034 (0.56) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_gs-push': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push[2.11.0] 4.0730 (2.11) 4.0730 (2.11) 4.0730 (2.11) 0.0000 (1.0) 4.0730 (2.11) 0.0000 (1.0) 0;0 0.2455 (0.47) 1 1
test_sharing_gs-push[2.11.0] 4.6205 (2.40) 4.6205 (2.40) 4.6205 (2.40) 0.0000 (1.0) 4.6205 (2.40) 0.0000 (1.0) 0;0 0.2164 (0.42) 1 1
test_sharing_gs-push[2.40.0] 5.6305 (2.92) 5.6305 (2.92) 5.6305 (2.92) 0.0000 (1.0) 5.6305 (2.92) 0.0000 (1.0) 0;0 0.1776 (0.34) 1 1
test_sharing_gs-push[2.40.0] 5.0911 (2.64) 5.0911 (2.64) 5.0911 (2.64) 0.0000 (1.0) 5.0911 (2.64) 0.0000 (1.0) 0;0 0.1964 (0.38) 1 1
test_sharing_gs-push[2.58.2] 3.8971 (2.02) 3.8971 (2.02) 3.8971 (2.02) 0.0000 (1.0) 3.8971 (2.02) 0.0000 (1.0) 0;0 0.2566 (0.49) 1 1
test_sharing_gs-push[2.58.2] 4.0141 (2.08) 4.0141 (2.08) 4.0141 (2.08) 0.0000 (1.0) 4.0141 (2.08) 0.0000 (1.0) 0;0 0.2491 (0.48) 1 1
test_sharing_gs-push[3.0.0] 2.0273 (1.05) 2.0273 (1.05) 2.0273 (1.05) 0.0000 (1.0) 2.0273 (1.05) 0.0000 (1.0) 0;0 0.4933 (0.95) 1 1
test_sharing_gs-push[3.0.0] 1.9267 (1.0) 1.9267 (1.0) 1.9267 (1.0) 0.0000 (1.0) 1.9267 (1.0) 0.0000 (1.0) 0;0 0.5190 (1.0) 1 1
test_sharing_gs-push[main] 3.7645 (1.95) 3.7645 (1.95) 3.7645 (1.95) 0.0000 (1.0) 3.7645 (1.95) 0.0000 (1.0) 0;0 0.2656 (0.51) 1 1
test_sharing_gs-push[main] 3.9068 (2.03) 3.9068 (2.03) 3.9068 (2.03) 0.0000 (1.0) 3.9068 (2.03) 0.0000 (1.0) 0;0 0.2560 (0.49) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------- benchmark 'test_sharing_gs-push-noop': 10 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_gs-push-noop[2.11.0] 431.7638 (1.0) 431.7638 (1.0) 431.7638 (1.0) 0.0000 (1.0) 431.7638 (1.0) 0.0000 (1.0) 0;0 2.3161 (1.0) 1 1
test_sharing_gs-push-noop[2.11.0] 515.4555 (1.19) 515.4555 (1.19) 515.4555 (1.19) 0.0000 (1.0) 515.4555 (1.19) 0.0000 (1.0) 0;0 1.9400 (0.84) 1 1
test_sharing_gs-push-noop[2.40.0] 544.1101 (1.26) 544.1101 (1.26) 544.1101 (1.26) 0.0000 (1.0) 544.1101 (1.26) 0.0000 (1.0) 0;0 1.8379 (0.79) 1 1
test_sharing_gs-push-noop[2.40.0] 462.5914 (1.07) 462.5914 (1.07) 462.5914 (1.07) 0.0000 (1.0) 462.5914 (1.07) 0.0000 (1.0) 0;0 2.1617 (0.93) 1 1
test_sharing_gs-push-noop[2.58.2] 547.1209 (1.27) 547.1209 (1.27) 547.1209 (1.27) 0.0000 (1.0) 547.1209 (1.27) 0.0000 (1.0) 0;0 1.8277 (0.79) 1 1
test_sharing_gs-push-noop[2.58.2] 542.7538 (1.26) 542.7538 (1.26) 542.7538 (1.26) 0.0000 (1.0) 542.7538 (1.26) 0.0000 (1.0) 0;0 1.8425 (0.80) 1 1
test_sharing_gs-push-noop[3.0.0] 583.7794 (1.35) 583.7794 (1.35) 583.7794 (1.35) 0.0000 (1.0) 583.7794 (1.35) 0.0000 (1.0) 0;0 1.7130 (0.74) 1 1
test_sharing_gs-push-noop[3.0.0] 622.5560 (1.44) 622.5560 (1.44) 622.5560 (1.44) 0.0000 (1.0) 622.5560 (1.44) 0.0000 (1.0) 0;0 1.6063 (0.69) 1 1
test_sharing_gs-push-noop[main] 502.7355 (1.16) 502.7355 (1.16) 502.7355 (1.16) 0.0000 (1.0) 502.7355 (1.16) 0.0000 (1.0) 0;0 1.9891 (0.86) 1 1
test_sharing_gs-push-noop[main] 545.4755 (1.26) 545.4755 (1.26) 545.4755 (1.26) 0.0000 (1.0) 545.4755 (1.26) 0.0000 (1.0) 0;0 1.8333 (0.79) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.11.0] 395.2031 (1.0) 499.6638 (1.0) 416.3663 (1.0) 16.1437 (1.46) 411.5546 (1.0) 17.3149 (1.15) 22;5 2.4017 (1.0) 100 1
test_init-init[2.40.0] 471.9729 (1.19) 590.2595 (1.18) 492.6571 (1.18) 16.5491 (1.50) 489.3263 (1.19) 17.3069 (1.15) 17;2 2.0298 (0.85) 100 1
test_init-init[2.58.2] 535.8171 (1.36) 648.6300 (1.30) 561.1000 (1.35) 19.7887 (1.79) 556.1531 (1.35) 19.6488 (1.31) 14;6 1.7822 (0.74) 100 1
test_init-init[3.0.0] 519.2279 (1.31) 569.1568 (1.14) 536.1950 (1.29) 11.0389 (1.0) 533.6150 (1.30) 15.0353 (1.0) 30;2 1.8650 (0.78) 100 1
test_init-init[main] 535.0856 (1.35) 631.7058 (1.26) 562.2901 (1.35) 17.5249 (1.59) 558.0512 (1.36) 19.3349 (1.29) 27;4 1.7784 (0.74) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 440.3917 (1.06) 440.3917 (1.06) 440.3917 (1.06) 0.0000 (1.0) 440.3917 (1.06) 0.0000 (1.0) 0;0 2.2707 (0.94) 1 1
test_list-list[2.40.0] 414.0710 (1.0) 414.0710 (1.0) 414.0710 (1.0) 0.0000 (1.0) 414.0710 (1.0) 0.0000 (1.0) 0;0 2.4150 (1.0) 1 1
test_list-list[2.58.2] 500.8857 (1.21) 500.8857 (1.21) 500.8857 (1.21) 0.0000 (1.0) 500.8857 (1.21) 0.0000 (1.0) 0;0 1.9965 (0.83) 1 1
test_list-list[3.0.0] 508.8592 (1.23) 508.8592 (1.23) 508.8592 (1.23) 0.0000 (1.0) 508.8592 (1.23) 0.0000 (1.0) 0;0 1.9652 (0.81) 1 1
test_list-list[main] 498.7502 (1.20) 498.7502 (1.20) 498.7502 (1.20) 0.0000 (1.0) 498.7502 (1.20) 0.0000 (1.0) 0;0 2.0050 (0.83) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 406.0649 (1.0) 406.0649 (1.0) 406.0649 (1.0) 0.0000 (1.0) 406.0649 (1.0) 0.0000 (1.0) 0;0 2.4627 (1.0) 1 1
test_list-list-dvc-only[2.40.0] 409.7980 (1.01) 409.7980 (1.01) 409.7980 (1.01) 0.0000 (1.0) 409.7980 (1.01) 0.0000 (1.0) 0;0 2.4402 (0.99) 1 1
test_list-list-dvc-only[2.58.2] 528.9503 (1.30) 528.9503 (1.30) 528.9503 (1.30) 0.0000 (1.0) 528.9503 (1.30) 0.0000 (1.0) 0;0 1.8905 (0.77) 1 1
test_list-list-dvc-only[3.0.0] 475.5994 (1.17) 475.5994 (1.17) 475.5994 (1.17) 0.0000 (1.0) 475.5994 (1.17) 0.0000 (1.0) 0;0 2.1026 (0.85) 1 1
test_list-list-dvc-only[main] 474.2287 (1.17) 474.2287 (1.17) 474.2287 (1.17) 0.0000 (1.0) 474.2287 (1.17) 0.0000 (1.0) 0;0 2.1087 (0.86) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.7799 (3.57) 1.7799 (3.57) 1.7799 (3.57) 0.0000 (1.0) 1.7799 (3.57) 0.0000 (1.0) 0;0 0.5618 (0.28) 1 1
test_list-list-recursive[2.40.0] 0.4981 (1.0) 0.4981 (1.0) 0.4981 (1.0) 0.0000 (1.0) 0.4981 (1.0) 0.0000 (1.0) 0;0 2.0077 (1.0) 1 1
test_list-list-recursive[2.58.2] 0.6511 (1.31) 0.6511 (1.31) 0.6511 (1.31) 0.0000 (1.0) 0.6511 (1.31) 0.0000 (1.0) 0;0 1.5359 (0.76) 1 1
test_list-list-recursive[3.0.0] 0.6076 (1.22) 0.6076 (1.22) 0.6076 (1.22) 0.0000 (1.0) 0.6076 (1.22) 0.0000 (1.0) 0;0 1.6459 (0.82) 1 1
test_list-list-recursive[main] 0.5920 (1.19) 0.5920 (1.19) 0.5920 (1.19) 0.0000 (1.0) 0.5920 (1.19) 0.0000 (1.0) 0;0 1.6892 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.11.0] 420.5399 (1.0) 420.5399 (1.0) 420.5399 (1.0) 0.0000 (1.0) 420.5399 (1.0) 0.0000 (1.0) 0;0 2.3779 (1.0) 1 1
test_list-list-shallow[2.40.0] 435.1965 (1.03) 435.1965 (1.03) 435.1965 (1.03) 0.0000 (1.0) 435.1965 (1.03) 0.0000 (1.0) 0;0 2.2978 (0.97) 1 1
test_list-list-shallow[2.58.2] 472.5550 (1.12) 472.5550 (1.12) 472.5550 (1.12) 0.0000 (1.0) 472.5550 (1.12) 0.0000 (1.0) 0;0 2.1162 (0.89) 1 1
test_list-list-shallow[3.0.0] 487.3841 (1.16) 487.3841 (1.16) 487.3841 (1.16) 0.0000 (1.0) 487.3841 (1.16) 0.0000 (1.0) 0;0 2.0518 (0.86) 1 1
test_list-list-shallow[main] 462.6668 (1.10) 462.6668 (1.10) 462.6668 (1.10) 0.0000 (1.0) 462.6668 (1.10) 0.0000 (1.0) 0;0 2.1614 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.11.0] 9.0883 (1.84) 9.0883 (1.84) 9.0883 (1.84) 0.0000 (1.0) 9.0883 (1.84) 0.0000 (1.0) 0;0 0.1100 (0.54) 1 1
test_partial_remove-add[2.40.0] 7.6587 (1.55) 7.6587 (1.55) 7.6587 (1.55) 0.0000 (1.0) 7.6587 (1.55) 0.0000 (1.0) 0;0 0.1306 (0.64) 1 1
test_partial_remove-add[2.58.2] 5.0453 (1.02) 5.0453 (1.02) 5.0453 (1.02) 0.0000 (1.0) 5.0453 (1.02) 0.0000 (1.0) 0;0 0.1982 (0.98) 1 1
test_partial_remove-add[3.0.0] 4.9341 (1.0) 4.9341 (1.0) 4.9341 (1.0) 0.0000 (1.0) 4.9341 (1.0) 0.0000 (1.0) 0;0 0.2027 (1.0) 1 1
test_partial_remove-add[main] 4.9700 (1.01) 4.9700 (1.01) 4.9700 (1.01) 0.0000 (1.0) 4.9700 (1.01) 0.0000 (1.0) 0;0 0.2012 (0.99) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.11.0] 3.4386 (1.86) 3.4386 (1.86) 3.4386 (1.86) 0.0000 (1.0) 3.4386 (1.86) 0.0000 (1.0) 0;0 0.2908 (0.54) 1 1
test_partial_remove-add-update[2.40.0] 1.8438 (1.0) 1.8438 (1.0) 1.8438 (1.0) 0.0000 (1.0) 1.8438 (1.0) 0.0000 (1.0) 0;0 0.5424 (1.0) 1 1
test_partial_remove-add-update[2.58.2] 1.9541 (1.06) 1.9541 (1.06) 1.9541 (1.06) 0.0000 (1.0) 1.9541 (1.06) 0.0000 (1.0) 0;0 0.5117 (0.94) 1 1
test_partial_remove-add-update[3.0.0] 2.0112 (1.09) 2.0112 (1.09) 2.0112 (1.09) 0.0000 (1.0) 2.0112 (1.09) 0.0000 (1.0) 0;0 0.4972 (0.92) 1 1
test_partial_remove-add-update[main] 1.9266 (1.04) 1.9266 (1.04) 1.9266 (1.04) 0.0000 (1.0) 1.9266 (1.04) 0.0000 (1.0) 0;0 0.5190 (0.96) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.11.0] 493.3277 (1.0) 493.3277 (1.0) 493.3277 (1.0) 0.0000 (1.0) 493.3277 (1.0) 0.0000 (1.0) 0;0 2.0271 (1.0) 1 1
test_partial_remove-gc[2.40.0] 568.2447 (1.15) 568.2447 (1.15) 568.2447 (1.15) 0.0000 (1.0) 568.2447 (1.15) 0.0000 (1.0) 0;0 1.7598 (0.87) 1 1
test_partial_remove-gc[2.58.2] 656.2307 (1.33) 656.2307 (1.33) 656.2307 (1.33) 0.0000 (1.0) 656.2307 (1.33) 0.0000 (1.0) 0;0 1.5239 (0.75) 1 1
test_partial_remove-gc[3.0.0] 694.2307 (1.41) 694.2307 (1.41) 694.2307 (1.41) 0.0000 (1.0) 694.2307 (1.41) 0.0000 (1.0) 0;0 1.4404 (0.71) 1 1
test_partial_remove-gc[main] 684.3653 (1.39) 684.3653 (1.39) 684.3653 (1.39) 0.0000 (1.0) 684.3653 (1.39) 0.0000 (1.0) 0;0 1.4612 (0.72) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.11.0] 556.7836 (1.0) 556.7836 (1.0) 556.7836 (1.0) 0.0000 (1.0) 556.7836 (1.0) 0.0000 (1.0) 0;0 1.7960 (1.0) 1 1
test_partial_remove-gc-cloud[2.40.0] 589.3836 (1.06) 589.3836 (1.06) 589.3836 (1.06) 0.0000 (1.0) 589.3836 (1.06) 0.0000 (1.0) 0;0 1.6967 (0.94) 1 1
test_partial_remove-gc-cloud[2.58.2] 732.6117 (1.32) 732.6117 (1.32) 732.6117 (1.32) 0.0000 (1.0) 732.6117 (1.32) 0.0000 (1.0) 0;0 1.3650 (0.76) 1 1
test_partial_remove-gc-cloud[3.0.0] 764.9156 (1.37) 764.9156 (1.37) 764.9156 (1.37) 0.0000 (1.0) 764.9156 (1.37) 0.0000 (1.0) 0;0 1.3073 (0.73) 1 1
test_partial_remove-gc-cloud[main] 765.6528 (1.38) 765.6528 (1.38) 765.6528 (1.38) 0.0000 (1.0) 765.6528 (1.38) 0.0000 (1.0) 0;0 1.3061 (0.73) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.11.0] 5.0193 (2.32) 5.0193 (2.32) 5.0193 (2.32) 0.0000 (1.0) 5.0193 (2.32) 0.0000 (1.0) 0;0 0.1992 (0.43) 1 1
test_partial_remove-push[2.40.0] 6.4198 (2.97) 6.4198 (2.97) 6.4198 (2.97) 0.0000 (1.0) 6.4198 (2.97) 0.0000 (1.0) 0;0 0.1558 (0.34) 1 1
test_partial_remove-push[2.58.2] 4.3263 (2.00) 4.3263 (2.00) 4.3263 (2.00) 0.0000 (1.0) 4.3263 (2.00) 0.0000 (1.0) 0;0 0.2311 (0.50) 1 1
test_partial_remove-push[3.0.0] 2.1623 (1.0) 2.1623 (1.0) 2.1623 (1.0) 0.0000 (1.0) 2.1623 (1.0) 0.0000 (1.0) 0;0 0.4625 (1.0) 1 1
test_partial_remove-push[main] 4.4126 (2.04) 4.4126 (2.04) 4.4126 (2.04) 0.0000 (1.0) 4.4126 (2.04) 0.0000 (1.0) 0;0 0.2266 (0.49) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.11.0] 559.0392 (1.0) 559.0392 (1.0) 559.0392 (1.0) 0.0000 (1.0) 559.0392 (1.0) 0.0000 (1.0) 0;0 1.7888 (1.0) 1 1
test_partial_remove-push-update[2.40.0] 592.7086 (1.06) 592.7086 (1.06) 592.7086 (1.06) 0.0000 (1.0) 592.7086 (1.06) 0.0000 (1.0) 0;0 1.6872 (0.94) 1 1
test_partial_remove-push-update[2.58.2] 655.4719 (1.17) 655.4719 (1.17) 655.4719 (1.17) 0.0000 (1.0) 655.4719 (1.17) 0.0000 (1.0) 0;0 1.5256 (0.85) 1 1
test_partial_remove-push-update[3.0.0] 623.7487 (1.12) 623.7487 (1.12) 623.7487 (1.12) 0.0000 (1.0) 623.7487 (1.12) 0.0000 (1.0) 0;0 1.6032 (0.90) 1 1
test_partial_remove-push-update[main] 636.5258 (1.14) 636.5258 (1.14) 636.5258 (1.14) 0.0000 (1.0) 636.5258 (1.14) 0.0000 (1.0) 0;0 1.5710 (0.88) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.11.0] 162.9786 (1.0) 181.8771 (1.0) 174.9106 (1.0) 3.6453 (1.59) 174.9160 (1.0) 4.9028 (1.62) 29;3 5.7172 (1.0) 100 1
test_help---help[2.40.0] 219.9474 (1.35) 302.7010 (1.66) 227.9093 (1.30) 9.0642 (3.95) 226.7043 (1.30) 5.9036 (1.95) 3;3 4.3877 (0.77) 100 1
test_help---help[2.58.2] 175.4159 (1.08) 191.4598 (1.05) 182.5989 (1.04) 3.4680 (1.51) 181.9426 (1.04) 3.9657 (1.31) 34;2 5.4765 (0.96) 100 1
test_help---help[3.0.0] 170.7083 (1.05) 182.5912 (1.00) 177.5309 (1.01) 2.2955 (1.0) 177.4114 (1.01) 3.0246 (1.0) 32;1 5.6328 (0.99) 100 1
test_help---help[main] 169.8352 (1.04) 186.9784 (1.03) 175.1539 (1.00) 2.5996 (1.13) 175.1109 (1.00) 3.4810 (1.15) 28;1 5.7093 (1.00) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.11.0] 3.0815 (1.0) 3.0815 (1.0) 3.0815 (1.0) 0.0000 (1.0) 3.0815 (1.0) 0.0000 (1.0) 0;0 0.3245 (1.0) 1 1
test_get_url-get-url[2.40.0] 3.1193 (1.01) 3.1193 (1.01) 3.1193 (1.01) 0.0000 (1.0) 3.1193 (1.01) 0.0000 (1.0) 0;0 0.3206 (0.99) 1 1
test_get_url-get-url[2.58.2] 3.1717 (1.03) 3.1717 (1.03) 3.1717 (1.03) 0.0000 (1.0) 3.1717 (1.03) 0.0000 (1.0) 0;0 0.3153 (0.97) 1 1
test_get_url-get-url[3.0.0] 3.2370 (1.05) 3.2370 (1.05) 3.2370 (1.05) 0.0000 (1.0) 3.2370 (1.05) 0.0000 (1.0) 0;0 0.3089 (0.95) 1 1
test_get_url-get-url[main] 3.3414 (1.08) 3.3414 (1.08) 3.3414 (1.08) 0.0000 (1.0) 3.3414 (1.08) 0.0000 (1.0) 0;0 0.2993 (0.92) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.40.0] 876.0984 (1.0) 876.0984 (1.0) 876.0984 (1.0) 0.0000 (1.0) 876.0984 (1.0) 0.0000 (1.0) 0;0 1.1414 (1.0) 1 1
test_exp_show-exp[2.58.2] 1,039.2144 (1.19) 1,039.2144 (1.19) 1,039.2144 (1.19) 0.0000 (1.0) 1,039.2144 (1.19) 0.0000 (1.0) 0;0 0.9623 (0.84) 1 1
test_exp_show-exp[3.0.0] 1,432.5369 (1.64) 1,432.5369 (1.64) 1,432.5369 (1.64) 0.0000 (1.0) 1,432.5369 (1.64) 0.0000 (1.0) 0;0 0.6981 (0.61) 1 1
test_exp_show-exp[main] 1,525.0609 (1.74) 1,525.0609 (1.74) 1,525.0609 (1.74) 0.0000 (1.0) 1,525.0609 (1.74) 0.0000 (1.0) 0;0 0.6557 (0.57) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.11.0] 1.3381 (1.07) 1.3381 (1.07) 1.3381 (1.07) 0.0000 (1.0) 1.3381 (1.07) 0.0000 (1.0) 0;0 0.7473 (0.93) 1 1
test_checkout_hardlink-checkout[2.40.0] 1.3014 (1.04) 1.3014 (1.04) 1.3014 (1.04) 0.0000 (1.0) 1.3014 (1.04) 0.0000 (1.0) 0;0 0.7684 (0.96) 1 1
test_checkout_hardlink-checkout[2.58.2] 1.4500 (1.16) 1.4500 (1.16) 1.4500 (1.16) 0.0000 (1.0) 1.4500 (1.16) 0.0000 (1.0) 0;0 0.6897 (0.86) 1 1
test_checkout_hardlink-checkout[3.0.0] 1.2463 (1.0) 1.2463 (1.0) 1.2463 (1.0) 0.0000 (1.0) 1.2463 (1.0) 0.0000 (1.0) 0;0 0.8024 (1.0) 1 1
test_checkout_hardlink-checkout[main] 1.2486 (1.00) 1.2486 (1.00) 1.2486 (1.00) 0.0000 (1.0) 1.2486 (1.00) 0.0000 (1.0) 0;0 0.8009 (1.00) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.11.0] 553.7872 (1.0) 553.7872 (1.0) 553.7872 (1.0) 0.0000 (1.0) 553.7872 (1.0) 0.0000 (1.0) 0;0 1.8057 (1.0) 1 1
test_checkout_hardlink-checkout-noop[2.40.0] 635.0203 (1.15) 635.0203 (1.15) 635.0203 (1.15) 0.0000 (1.0) 635.0203 (1.15) 0.0000 (1.0) 0;0 1.5748 (0.87) 1 1
test_checkout_hardlink-checkout-noop[2.58.2] 683.8110 (1.23) 683.8110 (1.23) 683.8110 (1.23) 0.0000 (1.0) 683.8110 (1.23) 0.0000 (1.0) 0;0 1.4624 (0.81) 1 1
test_checkout_hardlink-checkout-noop[3.0.0] 706.9158 (1.28) 706.9158 (1.28) 706.9158 (1.28) 0.0000 (1.0) 706.9158 (1.28) 0.0000 (1.0) 0;0 1.4146 (0.78) 1 1
test_checkout_hardlink-checkout-noop[main] 694.4079 (1.25) 694.4079 (1.25) 694.4079 (1.25) 0.0000 (1.0) 694.4079 (1.25) 0.0000 (1.0) 0;0 1.4401 (0.80) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.11.0] 1.3429 (1.86) 1.3429 (1.86) 1.3429 (1.86) 0.0000 (1.0) 1.3429 (1.86) 0.0000 (1.0) 0;0 0.7446 (0.54) 1 1
test_checkout_hardlink-checkout-update[2.40.0] 0.7210 (1.0) 0.7210 (1.0) 0.7210 (1.0) 0.0000 (1.0) 0.7210 (1.0) 0.0000 (1.0) 0;0 1.3870 (1.0) 1 1
test_checkout_hardlink-checkout-update[2.58.2] 0.8833 (1.23) 0.8833 (1.23) 0.8833 (1.23) 0.0000 (1.0) 0.8833 (1.23) 0.0000 (1.0) 0;0 1.1321 (0.82) 1 1
test_checkout_hardlink-checkout-update[3.0.0] 0.7774 (1.08) 0.7774 (1.08) 0.7774 (1.08) 0.0000 (1.0) 0.7774 (1.08) 0.0000 (1.0) 0;0 1.2864 (0.93) 1 1
test_checkout_hardlink-checkout-update[main] 0.7697 (1.07) 0.7697 (1.07) 0.7697 (1.07) 0.0000 (1.0) 0.7697 (1.07) 0.0000 (1.0) 0;0 1.2992 (0.94) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.11.0] 5.4659 (1.85) 5.4659 (1.85) 5.4659 (1.85) 0.0000 (1.0) 5.4659 (1.85) 0.0000 (1.0) 0;0 0.1830 (0.54) 1 1
test_partial_add-add[2.40.0] 4.5379 (1.53) 4.5379 (1.53) 4.5379 (1.53) 0.0000 (1.0) 4.5379 (1.53) 0.0000 (1.0) 0;0 0.2204 (0.65) 1 1
test_partial_add-add[2.58.2] 3.1933 (1.08) 3.1933 (1.08) 3.1933 (1.08) 0.0000 (1.0) 3.1933 (1.08) 0.0000 (1.0) 0;0 0.3132 (0.93) 1 1
test_partial_add-add[3.0.0] 2.9580 (1.0) 2.9580 (1.0) 2.9580 (1.0) 0.0000 (1.0) 2.9580 (1.0) 0.0000 (1.0) 0;0 0.3381 (1.0) 1 1
test_partial_add-add[main] 3.2014 (1.08) 3.2014 (1.08) 3.2014 (1.08) 0.0000 (1.0) 3.2014 (1.08) 0.0000 (1.0) 0;0 0.3124 (0.92) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.11.0] 8.3257 (1.91) 8.3257 (1.91) 8.3257 (1.91) 0.0000 (1.0) 8.3257 (1.91) 0.0000 (1.0) 0;0 0.1201 (0.52) 1 1
test_partial_add-add-partial[2.40.0] 5.8952 (1.35) 5.8952 (1.35) 5.8952 (1.35) 0.0000 (1.0) 5.8952 (1.35) 0.0000 (1.0) 0;0 0.1696 (0.74) 1 1
test_partial_add-add-partial[2.58.2] 4.6178 (1.06) 4.6178 (1.06) 4.6178 (1.06) 0.0000 (1.0) 4.6178 (1.06) 0.0000 (1.0) 0;0 0.2166 (0.94) 1 1
test_partial_add-add-partial[3.0.0] 4.3546 (1.0) 4.3546 (1.0) 4.3546 (1.0) 0.0000 (1.0) 4.3546 (1.0) 0.0000 (1.0) 0;0 0.2296 (1.0) 1 1
test_partial_add-add-partial[main] 4.5922 (1.05) 4.5922 (1.05) 4.5922 (1.05) 0.0000 (1.0) 4.5922 (1.05) 0.0000 (1.0) 0;0 0.2178 (0.95) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.11.0] 622.6715 (1.0) 622.6715 (1.0) 622.6715 (1.0) 0.0000 (1.0) 622.6715 (1.0) 0.0000 (1.0) 0;0 1.6060 (1.0) 1 1
test_partial_add-gc-cloud-noop[2.40.0] 698.3452 (1.12) 698.3452 (1.12) 698.3452 (1.12) 0.0000 (1.0) 698.3452 (1.12) 0.0000 (1.0) 0;0 1.4320 (0.89) 1 1
test_partial_add-gc-cloud-noop[2.58.2] 871.3688 (1.40) 871.3688 (1.40) 871.3688 (1.40) 0.0000 (1.0) 871.3688 (1.40) 0.0000 (1.0) 0;0 1.1476 (0.71) 1 1
test_partial_add-gc-cloud-noop[3.0.0] 919.8546 (1.48) 919.8546 (1.48) 919.8546 (1.48) 0.0000 (1.0) 919.8546 (1.48) 0.0000 (1.0) 0;0 1.0871 (0.68) 1 1
test_partial_add-gc-cloud-noop[main] 940.5535 (1.51) 940.5535 (1.51) 940.5535 (1.51) 0.0000 (1.0) 940.5535 (1.51) 0.0000 (1.0) 0;0 1.0632 (0.66) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.11.0] 590.8632 (1.0) 590.8632 (1.0) 590.8632 (1.0) 0.0000 (1.0) 590.8632 (1.0) 0.0000 (1.0) 0;0 1.6924 (1.0) 1 1
test_partial_add-gc-noop[2.40.0] 616.2204 (1.04) 616.2204 (1.04) 616.2204 (1.04) 0.0000 (1.0) 616.2204 (1.04) 0.0000 (1.0) 0;0 1.6228 (0.96) 1 1
test_partial_add-gc-noop[2.58.2] 754.2203 (1.28) 754.2203 (1.28) 754.2203 (1.28) 0.0000 (1.0) 754.2203 (1.28) 0.0000 (1.0) 0;0 1.3259 (0.78) 1 1
test_partial_add-gc-noop[3.0.0] 798.6910 (1.35) 798.6910 (1.35) 798.6910 (1.35) 0.0000 (1.0) 798.6910 (1.35) 0.0000 (1.0) 0;0 1.2520 (0.74) 1 1
test_partial_add-gc-noop[main] 907.0610 (1.54) 907.0610 (1.54) 907.0610 (1.54) 0.0000 (1.0) 907.0610 (1.54) 0.0000 (1.0) 0;0 1.1025 (0.65) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.11.0] 3.2215 (2.28) 3.2215 (2.28) 3.2215 (2.28) 0.0000 (1.0) 3.2215 (2.28) 0.0000 (1.0) 0;0 0.3104 (0.44) 1 1
test_partial_add-push[2.40.0] 3.6039 (2.55) 3.6039 (2.55) 3.6039 (2.55) 0.0000 (1.0) 3.6039 (2.55) 0.0000 (1.0) 0;0 0.2775 (0.39) 1 1
test_partial_add-push[2.58.2] 2.7556 (1.95) 2.7556 (1.95) 2.7556 (1.95) 0.0000 (1.0) 2.7556 (1.95) 0.0000 (1.0) 0;0 0.3629 (0.51) 1 1
test_partial_add-push[3.0.0] 1.4156 (1.0) 1.4156 (1.0) 1.4156 (1.0) 0.0000 (1.0) 1.4156 (1.0) 0.0000 (1.0) 0;0 0.7064 (1.0) 1 1
test_partial_add-push[main] 2.8514 (2.01) 2.8514 (2.01) 2.8514 (2.01) 0.0000 (1.0) 2.8514 (2.01) 0.0000 (1.0) 0;0 0.3507 (0.50) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.11.0] 3.2055 (2.06) 3.2055 (2.06) 3.2055 (2.06) 0.0000 (1.0) 3.2055 (2.06) 0.0000 (1.0) 0;0 0.3120 (0.49) 1 1
test_partial_add-push-partial[2.40.0] 3.7812 (2.43) 3.7812 (2.43) 3.7812 (2.43) 0.0000 (1.0) 3.7812 (2.43) 0.0000 (1.0) 0;0 0.2645 (0.41) 1 1
test_partial_add-push-partial[2.58.2] 3.0553 (1.96) 3.0553 (1.96) 3.0553 (1.96) 0.0000 (1.0) 3.0553 (1.96) 0.0000 (1.0) 0;0 0.3273 (0.51) 1 1
test_partial_add-push-partial[3.0.0] 1.5566 (1.0) 1.5566 (1.0) 1.5566 (1.0) 0.0000 (1.0) 1.5566 (1.0) 0.0000 (1.0) 0;0 0.6424 (1.0) 1 1
test_partial_add-push-partial[main] 2.9995 (1.93) 2.9995 (1.93) 2.9995 (1.93) 0.0000 (1.0) 2.9995 (1.93) 0.0000 (1.0) 0;0 0.3334 (0.52) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_sharing_azure-add': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add[2.11.0] 10.5232 (1.99) 10.5232 (1.99) 10.5232 (1.99) 0.0000 (1.0) 10.5232 (1.99) 0.0000 (1.0) 0;0 0.0950 (0.50) 1 1
test_sharing_azure-add[2.11.0] 9.7416 (1.85) 9.7416 (1.85) 9.7416 (1.85) 0.0000 (1.0) 9.7416 (1.85) 0.0000 (1.0) 0;0 0.1027 (0.54) 1 1
test_sharing_azure-add[2.40.0] 8.4828 (1.61) 8.4828 (1.61) 8.4828 (1.61) 0.0000 (1.0) 8.4828 (1.61) 0.0000 (1.0) 0;0 0.1179 (0.62) 1 1
test_sharing_azure-add[2.40.0] 8.0368 (1.52) 8.0368 (1.52) 8.0368 (1.52) 0.0000 (1.0) 8.0368 (1.52) 0.0000 (1.0) 0;0 0.1244 (0.66) 1 1
test_sharing_azure-add[2.58.2] 5.2907 (1.00) 5.2907 (1.00) 5.2907 (1.00) 0.0000 (1.0) 5.2907 (1.00) 0.0000 (1.0) 0;0 0.1890 (1.00) 1 1
test_sharing_azure-add[2.58.2] 6.7780 (1.28) 6.7780 (1.28) 6.7780 (1.28) 0.0000 (1.0) 6.7780 (1.28) 0.0000 (1.0) 0;0 0.1475 (0.78) 1 1
test_sharing_azure-add[3.0.0] 5.4070 (1.02) 5.4070 (1.02) 5.4070 (1.02) 0.0000 (1.0) 5.4070 (1.02) 0.0000 (1.0) 0;0 0.1849 (0.98) 1 1
test_sharing_azure-add[3.0.0] 5.2797 (1.0) 5.2797 (1.0) 5.2797 (1.0) 0.0000 (1.0) 5.2797 (1.0) 0.0000 (1.0) 0;0 0.1894 (1.0) 1 1
test_sharing_azure-add[main] 6.4385 (1.22) 6.4385 (1.22) 6.4385 (1.22) 0.0000 (1.0) 6.4385 (1.22) 0.0000 (1.0) 0;0 0.1553 (0.82) 1 1
test_sharing_azure-add[main] 5.3881 (1.02) 5.3881 (1.02) 5.3881 (1.02) 0.0000 (1.0) 5.3881 (1.02) 0.0000 (1.0) 0;0 0.1856 (0.98) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-add-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-add-noop[2.11.0] 4.7801 (1.46) 4.7801 (1.46) 4.7801 (1.46) 0.0000 (1.0) 4.7801 (1.46) 0.0000 (1.0) 0;0 0.2092 (0.69) 1 1
test_sharing_azure-add-noop[2.11.0] 4.4898 (1.37) 4.4898 (1.37) 4.4898 (1.37) 0.0000 (1.0) 4.4898 (1.37) 0.0000 (1.0) 0;0 0.2227 (0.73) 1 1
test_sharing_azure-add-noop[2.40.0] 3.5025 (1.07) 3.5025 (1.07) 3.5025 (1.07) 0.0000 (1.0) 3.5025 (1.07) 0.0000 (1.0) 0;0 0.2855 (0.94) 1 1
test_sharing_azure-add-noop[2.40.0] 3.2803 (1.0) 3.2803 (1.0) 3.2803 (1.0) 0.0000 (1.0) 3.2803 (1.0) 0.0000 (1.0) 0;0 0.3049 (1.0) 1 1
test_sharing_azure-add-noop[2.58.2] 3.3801 (1.03) 3.3801 (1.03) 3.3801 (1.03) 0.0000 (1.0) 3.3801 (1.03) 0.0000 (1.0) 0;0 0.2959 (0.97) 1 1
test_sharing_azure-add-noop[2.58.2] 3.5404 (1.08) 3.5404 (1.08) 3.5404 (1.08) 0.0000 (1.0) 3.5404 (1.08) 0.0000 (1.0) 0;0 0.2825 (0.93) 1 1
test_sharing_azure-add-noop[3.0.0] 3.6833 (1.12) 3.6833 (1.12) 3.6833 (1.12) 0.0000 (1.0) 3.6833 (1.12) 0.0000 (1.0) 0;0 0.2715 (0.89) 1 1
test_sharing_azure-add-noop[3.0.0] 3.6300 (1.11) 3.6300 (1.11) 3.6300 (1.11) 0.0000 (1.0) 3.6300 (1.11) 0.0000 (1.0) 0;0 0.2755 (0.90) 1 1
test_sharing_azure-add-noop[main] 3.5314 (1.08) 3.5314 (1.08) 3.5314 (1.08) 0.0000 (1.0) 3.5314 (1.08) 0.0000 (1.0) 0;0 0.2832 (0.93) 1 1
test_sharing_azure-add-noop[main] 3.7875 (1.15) 3.7875 (1.15) 3.7875 (1.15) 0.0000 (1.0) 3.7875 (1.15) 0.0000 (1.0) 0;0 0.2640 (0.87) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-checkout-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-checkout-noop[2.11.0] 622.3669 (1.14) 622.3669 (1.14) 622.3669 (1.14) 0.0000 (1.0) 622.3669 (1.14) 0.0000 (1.0) 0;0 1.6068 (0.88) 1 1
test_sharing_azure-checkout-noop[2.11.0] 548.1035 (1.0) 548.1035 (1.0) 548.1035 (1.0) 0.0000 (1.0) 548.1035 (1.0) 0.0000 (1.0) 0;0 1.8245 (1.0) 1 1
test_sharing_azure-checkout-noop[2.40.0] 739.0363 (1.35) 739.0363 (1.35) 739.0363 (1.35) 0.0000 (1.0) 739.0363 (1.35) 0.0000 (1.0) 0;0 1.3531 (0.74) 1 1
test_sharing_azure-checkout-noop[2.40.0] 868.2794 (1.58) 868.2794 (1.58) 868.2794 (1.58) 0.0000 (1.0) 868.2794 (1.58) 0.0000 (1.0) 0;0 1.1517 (0.63) 1 1
test_sharing_azure-checkout-noop[2.58.2] 874.7051 (1.60) 874.7051 (1.60) 874.7051 (1.60) 0.0000 (1.0) 874.7051 (1.60) 0.0000 (1.0) 0;0 1.1432 (0.63) 1 1
test_sharing_azure-checkout-noop[2.58.2] 879.5177 (1.60) 879.5177 (1.60) 879.5177 (1.60) 0.0000 (1.0) 879.5177 (1.60) 0.0000 (1.0) 0;0 1.1370 (0.62) 1 1
test_sharing_azure-checkout-noop[3.0.0] 848.7995 (1.55) 848.7995 (1.55) 848.7995 (1.55) 0.0000 (1.0) 848.7995 (1.55) 0.0000 (1.0) 0;0 1.1781 (0.65) 1 1
test_sharing_azure-checkout-noop[3.0.0] 908.1226 (1.66) 908.1226 (1.66) 908.1226 (1.66) 0.0000 (1.0) 908.1226 (1.66) 0.0000 (1.0) 0;0 1.1012 (0.60) 1 1
test_sharing_azure-checkout-noop[main] 908.5351 (1.66) 908.5351 (1.66) 908.5351 (1.66) 0.0000 (1.0) 908.5351 (1.66) 0.0000 (1.0) 0;0 1.1007 (0.60) 1 1
test_sharing_azure-checkout-noop[main] 868.0723 (1.58) 868.0723 (1.58) 868.0723 (1.58) 0.0000 (1.0) 868.0723 (1.58) 0.0000 (1.0) 0;0 1.1520 (0.63) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull': 10 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull[2.11.0] 10.7369 (1.48) 10.7369 (1.48) 10.7369 (1.48) 0.0000 (1.0) 10.7369 (1.48) 0.0000 (1.0) 0;0 0.0931 (0.68) 1 1
test_sharing_azure-pull[2.11.0] 10.3910 (1.43) 10.3910 (1.43) 10.3910 (1.43) 0.0000 (1.0) 10.3910 (1.43) 0.0000 (1.0) 0;0 0.0962 (0.70) 1 1
test_sharing_azure-pull[2.40.0] 11.6283 (1.60) 11.6283 (1.60) 11.6283 (1.60) 0.0000 (1.0) 11.6283 (1.60) 0.0000 (1.0) 0;0 0.0860 (0.63) 1 1
test_sharing_azure-pull[2.40.0] 12.1397 (1.67) 12.1397 (1.67) 12.1397 (1.67) 0.0000 (1.0) 12.1397 (1.67) 0.0000 (1.0) 0;0 0.0824 (0.60) 1 1
test_sharing_azure-pull[2.58.2] 7.2690 (1.0) 7.2690 (1.0) 7.2690 (1.0) 0.0000 (1.0) 7.2690 (1.0) 0.0000 (1.0) 0;0 0.1376 (1.0) 1 1
test_sharing_azure-pull[2.58.2] 7.3357 (1.01) 7.3357 (1.01) 7.3357 (1.01) 0.0000 (1.0) 7.3357 (1.01) 0.0000 (1.0) 0;0 0.1363 (0.99) 1 1
test_sharing_azure-pull[3.0.0] 10.5406 (1.45) 10.5406 (1.45) 10.5406 (1.45) 0.0000 (1.0) 10.5406 (1.45) 0.0000 (1.0) 0;0 0.0949 (0.69) 1 1
test_sharing_azure-pull[3.0.0] 10.6319 (1.46) 10.6319 (1.46) 10.6319 (1.46) 0.0000 (1.0) 10.6319 (1.46) 0.0000 (1.0) 0;0 0.0941 (0.68) 1 1
test_sharing_azure-pull[main] 10.6642 (1.47) 10.6642 (1.47) 10.6642 (1.47) 0.0000 (1.0) 10.6642 (1.47) 0.0000 (1.0) 0;0 0.0938 (0.68) 1 1
test_sharing_azure-pull[main] 11.5487 (1.59) 11.5487 (1.59) 11.5487 (1.59) 0.0000 (1.0) 11.5487 (1.59) 0.0000 (1.0) 0;0 0.0866 (0.63) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_sharing_azure-pull-noop': 10 tests -------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-pull-noop[2.11.0] 619.7207 (1.0) 619.7207 (1.0) 619.7207 (1.0) 0.0000 (1.0) 619.7207 (1.0) 0.0000 (1.0) 0;0 1.6136 (1.0) 1 1
test_sharing_azure-pull-noop[2.11.0] 658.4973 (1.06) 658.4973 (1.06) 658.4973 (1.06) 0.0000 (1.0) 658.4973 (1.06) 0.0000 (1.0) 0;0 1.5186 (0.94) 1 1
test_sharing_azure-pull-noop[2.40.0] 840.7442 (1.36) 840.7442 (1.36) 840.7442 (1.36) 0.0000 (1.0) 840.7442 (1.36) 0.0000 (1.0) 0;0 1.1894 (0.74) 1 1
test_sharing_azure-pull-noop[2.40.0] 834.9749 (1.35) 834.9749 (1.35) 834.9749 (1.35) 0.0000 (1.0) 834.9749 (1.35) 0.0000 (1.0) 0;0 1.1976 (0.74) 1 1
test_sharing_azure-pull-noop[2.58.2] 956.7317 (1.54) 956.7317 (1.54) 956.7317 (1.54) 0.0000 (1.0) 956.7317 (1.54) 0.0000 (1.0) 0;0 1.0452 (0.65) 1 1
test_sharing_azure-pull-noop[2.58.2] 938.9968 (1.52) 938.9968 (1.52) 938.9968 (1.52) 0.0000 (1.0) 938.9968 (1.52) 0.0000 (1.0) 0;0 1.0650 (0.66) 1 1
test_sharing_azure-pull-noop[3.0.0] 1,035.9077 (1.67) 1,035.9077 (1.67) 1,035.9077 (1.67) 0.0000 (1.0) 1,035.9077 (1.67) 0.0000 (1.0) 0;0 0.9653 (0.60) 1 1
test_sharing_azure-pull-noop[3.0.0] 1,085.0387 (1.75) 1,085.0387 (1.75) 1,085.0387 (1.75) 0.0000 (1.0) 1,085.0387 (1.75) 0.0000 (1.0) 0;0 0.9216 (0.57) 1 1
test_sharing_azure-pull-noop[main] 1,083.4288 (1.75) 1,083.4288 (1.75) 1,083.4288 (1.75) 0.0000 (1.0) 1,083.4288 (1.75) 0.0000 (1.0) 0;0 0.9230 (0.57) 1 1
test_sharing_azure-pull-noop[main] 1,081.5834 (1.75) 1,081.5834 (1.75) 1,081.5834 (1.75) 0.0000 (1.0) 1,081.5834 (1.75) 0.0000 (1.0) 0;0 0.9246 (0.57) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_azure-push': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push[2.11.0] 5.7306 (2.59) 5.7306 (2.59) 5.7306 (2.59) 0.0000 (1.0) 5.7306 (2.59) 0.0000 (1.0) 0;0 0.1745 (0.39) 1 1
test_sharing_azure-push[2.11.0] 5.5892 (2.53) 5.5892 (2.53) 5.5892 (2.53) 0.0000 (1.0) 5.5892 (2.53) 0.0000 (1.0) 0;0 0.1789 (0.40) 1 1
test_sharing_azure-push[2.40.0] 6.8910 (3.12) 6.8910 (3.12) 6.8910 (3.12) 0.0000 (1.0) 6.8910 (3.12) 0.0000 (1.0) 0;0 0.1451 (0.32) 1 1
test_sharing_azure-push[2.40.0] 6.8565 (3.10) 6.8565 (3.10) 6.8565 (3.10) 0.0000 (1.0) 6.8565 (3.10) 0.0000 (1.0) 0;0 0.1458 (0.32) 1 1
test_sharing_azure-push[2.58.2] 4.5566 (2.06) 4.5566 (2.06) 4.5566 (2.06) 0.0000 (1.0) 4.5566 (2.06) 0.0000 (1.0) 0;0 0.2195 (0.48) 1 1
test_sharing_azure-push[2.58.2] 4.7820 (2.16) 4.7820 (2.16) 4.7820 (2.16) 0.0000 (1.0) 4.7820 (2.16) 0.0000 (1.0) 0;0 0.2091 (0.46) 1 1
test_sharing_azure-push[3.0.0] 2.4107 (1.09) 2.4107 (1.09) 2.4107 (1.09) 0.0000 (1.0) 2.4107 (1.09) 0.0000 (1.0) 0;0 0.4148 (0.92) 1 1
test_sharing_azure-push[3.0.0] 2.2098 (1.0) 2.2098 (1.0) 2.2098 (1.0) 0.0000 (1.0) 2.2098 (1.0) 0.0000 (1.0) 0;0 0.4525 (1.0) 1 1
test_sharing_azure-push[main] 4.5866 (2.08) 4.5866 (2.08) 4.5866 (2.08) 0.0000 (1.0) 4.5866 (2.08) 0.0000 (1.0) 0;0 0.2180 (0.48) 1 1
test_sharing_azure-push[main] 5.0000 (2.26) 5.0000 (2.26) 5.0000 (2.26) 0.0000 (1.0) 5.0000 (2.26) 0.0000 (1.0) 0;0 0.2000 (0.44) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing_azure-push-noop': 10 tests ---------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_azure-push-noop[2.11.0] 574.0554 (1.0) 574.0554 (1.0) 574.0554 (1.0) 0.0000 (1.0) 574.0554 (1.0) 0.0000 (1.0) 0;0 1.7420 (1.0) 1 1
test_sharing_azure-push-noop[2.11.0] 575.4280 (1.00) 575.4280 (1.00) 575.4280 (1.00) 0.0000 (1.0) 575.4280 (1.00) 0.0000 (1.0) 0;0 1.7378 (1.00) 1 1
test_sharing_azure-push-noop[2.40.0] 588.2458 (1.02) 588.2458 (1.02) 588.2458 (1.02) 0.0000 (1.0) 588.2458 (1.02) 0.0000 (1.0) 0;0 1.7000 (0.98) 1 1
test_sharing_azure-push-noop[2.40.0] 602.4859 (1.05) 602.4859 (1.05) 602.4859 (1.05) 0.0000 (1.0) 602.4859 (1.05) 0.0000 (1.0) 0;0 1.6598 (0.95) 1 1
test_sharing_azure-push-noop[2.58.2] 640.5675 (1.12) 640.5675 (1.12) 640.5675 (1.12) 0.0000 (1.0) 640.5675 (1.12) 0.0000 (1.0) 0;0 1.5611 (0.90) 1 1
test_sharing_azure-push-noop[2.58.2] 680.7120 (1.19) 680.7120 (1.19) 680.7120 (1.19) 0.0000 (1.0) 680.7120 (1.19) 0.0000 (1.0) 0;0 1.4691 (0.84) 1 1
test_sharing_azure-push-noop[3.0.0] 637.5852 (1.11) 637.5852 (1.11) 637.5852 (1.11) 0.0000 (1.0) 637.5852 (1.11) 0.0000 (1.0) 0;0 1.5684 (0.90) 1 1
test_sharing_azure-push-noop[3.0.0] 616.5578 (1.07) 616.5578 (1.07) 616.5578 (1.07) 0.0000 (1.0) 616.5578 (1.07) 0.0000 (1.0) 0;0 1.6219 (0.93) 1 1
test_sharing_azure-push-noop[main] 638.7197 (1.11) 638.7197 (1.11) 638.7197 (1.11) 0.0000 (1.0) 638.7197 (1.11) 0.0000 (1.0) 0;0 1.5656 (0.90) 1 1
test_sharing_azure-push-noop[main] 755.8676 (1.32) 755.8676 (1.32) 755.8676 (1.32) 0.0000 (1.0) 755.8676 (1.32) 0.0000 (1.0) 0;0 1.3230 (0.76) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.40.0] 1.2343 (1.03) 1.2343 (1.03) 1.2343 (1.03) 0.0000 (1.0) 1.2343 (1.03) 0.0000 (1.0) 0;0 0.8102 (0.97) 1 1
test_data_status_all_flags-data-changed[2.58.2] 1.2287 (1.03) 1.2287 (1.03) 1.2287 (1.03) 0.0000 (1.0) 1.2287 (1.03) 0.0000 (1.0) 0;0 0.8139 (0.97) 1 1
test_data_status_all_flags-data-changed[3.0.0] 1.2150 (1.02) 1.2150 (1.02) 1.2150 (1.02) 0.0000 (1.0) 1.2150 (1.02) 0.0000 (1.0) 0;0 0.8230 (0.98) 1 1
test_data_status_all_flags-data-changed[main] 1.1966 (1.0) 1.1966 (1.0) 1.1966 (1.0) 0.0000 (1.0) 1.1966 (1.0) 0.0000 (1.0) 0;0 0.8357 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.40.0] 1.2304 (1.02) 1.2304 (1.02) 1.2304 (1.02) 0.0000 (1.0) 1.2304 (1.02) 0.0000 (1.0) 0;0 0.8128 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[2.58.2] 1.2317 (1.02) 1.2317 (1.02) 1.2317 (1.02) 0.0000 (1.0) 1.2317 (1.02) 0.0000 (1.0) 0;0 0.8119 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[3.0.0] 1.2222 (1.02) 1.2222 (1.02) 1.2222 (1.02) 0.0000 (1.0) 1.2222 (1.02) 0.0000 (1.0) 0;0 0.8182 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.2020 (1.0) 1.2020 (1.0) 1.2020 (1.0) 0.0000 (1.0) 1.2020 (1.0) 0.0000 (1.0) 0;0 0.8319 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.40.0] 2.0475 (1.02) 2.0475 (1.02) 2.0475 (1.02) 0.0000 (1.0) 2.0475 (1.02) 0.0000 (1.0) 0;0 0.4884 (0.98) 1 1
test_data_status_all_flags-data-new[2.58.2] 2.0760 (1.03) 2.0760 (1.03) 2.0760 (1.03) 0.0000 (1.0) 2.0760 (1.03) 0.0000 (1.0) 0;0 0.4817 (0.97) 1 1
test_data_status_all_flags-data-new[3.0.0] 2.0454 (1.02) 2.0454 (1.02) 2.0454 (1.02) 0.0000 (1.0) 2.0454 (1.02) 0.0000 (1.0) 0;0 0.4889 (0.98) 1 1
test_data_status_all_flags-data-new[main] 2.0126 (1.0) 2.0126 (1.0) 2.0126 (1.0) 0.0000 (1.0) 2.0126 (1.0) 0.0000 (1.0) 0;0 0.4969 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.40.0] 1.1715 (1.0) 1.1715 (1.0) 1.1715 (1.0) 0.0000 (1.0) 1.1715 (1.0) 0.0000 (1.0) 0;0 0.8536 (1.0) 1 1
test_data_status_all_flags-data-noop[2.58.2] 1.1820 (1.01) 1.1820 (1.01) 1.1820 (1.01) 0.0000 (1.0) 1.1820 (1.01) 0.0000 (1.0) 0;0 0.8460 (0.99) 1 1
test_data_status_all_flags-data-noop[3.0.0] 1.1891 (1.01) 1.1891 (1.01) 1.1891 (1.01) 0.0000 (1.0) 1.1891 (1.01) 0.0000 (1.0) 0;0 0.8410 (0.99) 1 1
test_data_status_all_flags-data-noop[main] 1.1772 (1.00) 1.1772 (1.00) 1.1772 (1.00) 0.0000 (1.0) 1.1772 (1.00) 0.0000 (1.0) 0;0 0.8495 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.11.0] 12.1792 (1.23) 12.1792 (1.23) 12.1792 (1.23) 0.0000 (1.0) 12.1792 (1.23) 0.0000 (1.0) 0;0 0.0821 (0.81) 1 1
test_import-import[2.40.0] 9.9075 (1.0) 9.9075 (1.0) 9.9075 (1.0) 0.0000 (1.0) 9.9075 (1.0) 0.0000 (1.0) 0;0 0.1009 (1.0) 1 1
test_import-import[2.58.2] 10.2527 (1.03) 10.2527 (1.03) 10.2527 (1.03) 0.0000 (1.0) 10.2527 (1.03) 0.0000 (1.0) 0;0 0.0975 (0.97) 1 1
test_import-import[3.0.0] 10.1755 (1.03) 10.1755 (1.03) 10.1755 (1.03) 0.0000 (1.0) 10.1755 (1.03) 0.0000 (1.0) 0;0 0.0983 (0.97) 1 1
test_import-import[main] 11.0846 (1.12) 11.0846 (1.12) 11.0846 (1.12) 0.0000 (1.0) 11.0846 (1.12) 0.0000 (1.0) 0;0 0.0902 (0.89) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.11.0] 3.8016 (2.37) 3.8016 (2.37) 3.8016 (2.37) 0.0000 (1.0) 3.8016 (2.37) 0.0000 (1.0) 0;0 0.2630 (0.42) 1 1
test_push-push[2.40.0] 4.9308 (3.08) 4.9308 (3.08) 4.9308 (3.08) 0.0000 (1.0) 4.9308 (3.08) 0.0000 (1.0) 0;0 0.2028 (0.32) 1 1
test_push-push[2.58.2] 3.3498 (2.09) 3.3498 (2.09) 3.3498 (2.09) 0.0000 (1.0) 3.3498 (2.09) 0.0000 (1.0) 0;0 0.2985 (0.48) 1 1
test_push-push[3.0.0] 1.6023 (1.0) 1.6023 (1.0) 1.6023 (1.0) 0.0000 (1.0) 1.6023 (1.0) 0.0000 (1.0) 0;0 0.6241 (1.0) 1 1
test_push-push[main] 3.3543 (2.09) 3.3543 (2.09) 3.3543 (2.09) 0.0000 (1.0) 3.3543 (2.09) 0.0000 (1.0) 0;0 0.2981 (0.48) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------- benchmark 'test_sharing_s3-add': 10 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add[2.11.0] 11.0313 (1.87) 11.0313 (1.87) 11.0313 (1.87) 0.0000 (1.0) 11.0313 (1.87) 0.0000 (1.0) 0;0 0.0907 (0.54) 1 1
test_sharing_s3-add[2.11.0] 11.1130 (1.88) 11.1130 (1.88) 11.1130 (1.88) 0.0000 (1.0) 11.1130 (1.88) 0.0000 (1.0) 0;0 0.0900 (0.53) 1 1
test_sharing_s3-add[2.40.0] 9.1186 (1.54) 9.1186 (1.54) 9.1186 (1.54) 0.0000 (1.0) 9.1186 (1.54) 0.0000 (1.0) 0;0 0.1097 (0.65) 1 1
test_sharing_s3-add[2.40.0] 9.1692 (1.55) 9.1692 (1.55) 9.1692 (1.55) 0.0000 (1.0) 9.1692 (1.55) 0.0000 (1.0) 0;0 0.1091 (0.65) 1 1
test_sharing_s3-add[2.58.2] 5.9877 (1.01) 5.9877 (1.01) 5.9877 (1.01) 0.0000 (1.0) 5.9877 (1.01) 0.0000 (1.0) 0;0 0.1670 (0.99) 1 1
test_sharing_s3-add[2.58.2] 5.9146 (1.0) 5.9146 (1.0) 5.9146 (1.0) 0.0000 (1.0) 5.9146 (1.0) 0.0000 (1.0) 0;0 0.1691 (1.0) 1 1
test_sharing_s3-add[3.0.0] 6.1024 (1.03) 6.1024 (1.03) 6.1024 (1.03) 0.0000 (1.0) 6.1024 (1.03) 0.0000 (1.0) 0;0 0.1639 (0.97) 1 1
test_sharing_s3-add[3.0.0] 6.0775 (1.03) 6.0775 (1.03) 6.0775 (1.03) 0.0000 (1.0) 6.0775 (1.03) 0.0000 (1.0) 0;0 0.1645 (0.97) 1 1
test_sharing_s3-add[main] 5.9489 (1.01) 5.9489 (1.01) 5.9489 (1.01) 0.0000 (1.0) 5.9489 (1.01) 0.0000 (1.0) 0;0 0.1681 (0.99) 1 1
test_sharing_s3-add[main] 5.9995 (1.01) 5.9995 (1.01) 5.9995 (1.01) 0.0000 (1.0) 5.9995 (1.01) 0.0000 (1.0) 0;0 0.1667 (0.99) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 10 tests -----------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-add-noop[2.11.0] 5.0787 (1.35) 5.0787 (1.35) 5.0787 (1.35) 0.0000 (1.0) 5.0787 (1.35) 0.0000 (1.0) 0;0 0.1969 (0.74) 1 1
test_sharing_s3-add-noop[2.11.0] 5.1682 (1.38) 5.1682 (1.38) 5.1682 (1.38) 0.0000 (1.0) 5.1682 (1.38) 0.0000 (1.0) 0;0 0.1935 (0.73) 1 1
test_sharing_s3-add-noop[2.40.0] 3.7567 (1.0) 3.7567 (1.0) 3.7567 (1.0) 0.0000 (1.0) 3.7567 (1.0) 0.0000 (1.0) 0;0 0.2662 (1.0) 1 1
test_sharing_s3-add-noop[2.40.0] 3.8615 (1.03) 3.8615 (1.03) 3.8615 (1.03) 0.0000 (1.0) 3.8615 (1.03) 0.0000 (1.0) 0;0 0.2590 (0.97) 1 1
test_sharing_s3-add-noop[2.58.2] 4.1611 (1.11) 4.1611 (1.11) 4.1611 (1.11) 0.0000 (1.0) 4.1611 (1.11) 0.0000 (1.0) 0;0 0.2403 (0.90) 1 1
test_sharing_s3-add-noop[2.58.2] 3.8752 (1.03) 3.8752 (1.03) 3.8752 (1.03) 0.0000 (1.0) 3.8752 (1.03) 0.0000 (1.0) 0;0 0.2581 (0.97) 1 1
test_sharing_s3-add-noop[3.0.0] 3.9373 (1.05) 3.9373 (1.05) 3.9373 (1.05) 0.0000 (1.0) 3.9373 (1.05) 0.0000 (1.0) 0;0 0.2540 (0.95) 1 1
test_sharing_s3-add-noop[3.0.0] 3.8710 (1.03) 3.8710 (1.03) 3.8710 (1.03) 0.0000 (1.0) 3.8710 (1.03) 0.0000 (1.0) 0;0 0.2583 (0.97) 1 1
test_sharing_s3-add-noop[main] 3.8706 (1.03) 3.8706 (1.03) 3.8706 (1.03) 0.0000 (1.0) 3.8706 (1.03) 0.0000 (1.0) 0;0 0.2584 (0.97) 1 1
test_sharing_s3-add-noop[main] 3.9043 (1.04) 3.9043 (1.04) 3.9043 (1.04) 0.0000 (1.0) 3.9043 (1.04) 0.0000 (1.0) 0;0 0.2561 (0.96) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 10 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-checkout-noop[2.11.0] 742.2039 (1.11) 742.2039 (1.11) 742.2039 (1.11) 0.0000 (1.0) 742.2039 (1.11) 0.0000 (1.0) 0;0 1.3473 (0.90) 1 1
test_sharing_s3-checkout-noop[2.11.0] 668.9040 (1.0) 668.9040 (1.0) 668.9040 (1.0) 0.0000 (1.0) 668.9040 (1.0) 0.0000 (1.0) 0;0 1.4950 (1.0) 1 1
test_sharing_s3-checkout-noop[2.40.0] 929.6547 (1.39) 929.6547 (1.39) 929.6547 (1.39) 0.0000 (1.0) 929.6547 (1.39) 0.0000 (1.0) 0;0 1.0757 (0.72) 1 1
test_sharing_s3-checkout-noop[2.40.0] 933.8881 (1.40) 933.8881 (1.40) 933.8881 (1.40) 0.0000 (1.0) 933.8881 (1.40) 0.0000 (1.0) 0;0 1.0708 (0.72) 1 1
test_sharing_s3-checkout-noop[2.58.2] 1,001.5330 (1.50) 1,001.5330 (1.50) 1,001.5330 (1.50) 0.0000 (1.0) 1,001.5330 (1.50) 0.0000 (1.0) 0;0 0.9985 (0.67) 1 1
test_sharing_s3-checkout-noop[2.58.2] 933.7955 (1.40) 933.7955 (1.40) 933.7955 (1.40) 0.0000 (1.0) 933.7955 (1.40) 0.0000 (1.0) 0;0 1.0709 (0.72) 1 1
test_sharing_s3-checkout-noop[3.0.0] 1,261.8917 (1.89) 1,261.8917 (1.89) 1,261.8917 (1.89) 0.0000 (1.0) 1,261.8917 (1.89) 0.0000 (1.0) 0;0 0.7925 (0.53) 1 1
test_sharing_s3-checkout-noop[3.0.0] 1,199.8604 (1.79) 1,199.8604 (1.79) 1,199.8604 (1.79) 0.0000 (1.0) 1,199.8604 (1.79) 0.0000 (1.0) 0;0 0.8334 (0.56) 1 1
test_sharing_s3-checkout-noop[main] 974.3453 (1.46) 974.3453 (1.46) 974.3453 (1.46) 0.0000 (1.0) 974.3453 (1.46) 0.0000 (1.0) 0;0 1.0263 (0.69) 1 1
test_sharing_s3-checkout-noop[main] 986.9489 (1.48) 986.9489 (1.48) 986.9489 (1.48) 0.0000 (1.0) 986.9489 (1.48) 0.0000 (1.0) 0;0 1.0132 (0.68) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull[2.11.0] 20.9856 (1.31) 20.9856 (1.31) 20.9856 (1.31) 0.0000 (1.0) 20.9856 (1.31) 0.0000 (1.0) 0;0 0.0477 (0.77) 1 1
test_sharing_s3-pull[2.11.0] 21.2804 (1.33) 21.2804 (1.33) 21.2804 (1.33) 0.0000 (1.0) 21.2804 (1.33) 0.0000 (1.0) 0;0 0.0470 (0.75) 1 1
test_sharing_s3-pull[2.40.0] 21.8362 (1.36) 21.8362 (1.36) 21.8362 (1.36) 0.0000 (1.0) 21.8362 (1.36) 0.0000 (1.0) 0;0 0.0458 (0.74) 1 1
test_sharing_s3-pull[2.40.0] 22.2818 (1.39) 22.2818 (1.39) 22.2818 (1.39) 0.0000 (1.0) 22.2818 (1.39) 0.0000 (1.0) 0;0 0.0449 (0.72) 1 1
test_sharing_s3-pull[2.58.2] 16.0590 (1.0) 16.0590 (1.0) 16.0590 (1.0) 0.0000 (1.0) 16.0590 (1.0) 0.0000 (1.0) 0;0 0.0623 (1.0) 1 1
test_sharing_s3-pull[2.58.2] 16.3976 (1.02) 16.3976 (1.02) 16.3976 (1.02) 0.0000 (1.0) 16.3976 (1.02) 0.0000 (1.0) 0;0 0.0610 (0.98) 1 1
test_sharing_s3-pull[3.0.0] 18.3502 (1.14) 18.3502 (1.14) 18.3502 (1.14) 0.0000 (1.0) 18.3502 (1.14) 0.0000 (1.0) 0;0 0.0545 (0.88) 1 1
test_sharing_s3-pull[3.0.0] 18.4507 (1.15) 18.4507 (1.15) 18.4507 (1.15) 0.0000 (1.0) 18.4507 (1.15) 0.0000 (1.0) 0;0 0.0542 (0.87) 1 1
test_sharing_s3-pull[main] 18.0783 (1.13) 18.0783 (1.13) 18.0783 (1.13) 0.0000 (1.0) 18.0783 (1.13) 0.0000 (1.0) 0;0 0.0553 (0.89) 1 1
test_sharing_s3-pull[main] 19.1347 (1.19) 19.1347 (1.19) 19.1347 (1.19) 0.0000 (1.0) 19.1347 (1.19) 0.0000 (1.0) 0;0 0.0523 (0.84) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-pull-noop[2.11.0] 1.1447 (1.19) 1.1447 (1.19) 1.1447 (1.19) 0.0000 (1.0) 1.1447 (1.19) 0.0000 (1.0) 0;0 0.8736 (0.84) 1 1
test_sharing_s3-pull-noop[2.11.0] 0.9633 (1.0) 0.9633 (1.0) 0.9633 (1.0) 0.0000 (1.0) 0.9633 (1.0) 0.0000 (1.0) 0;0 1.0381 (1.0) 1 1
test_sharing_s3-pull-noop[2.40.0] 1.1941 (1.24) 1.1941 (1.24) 1.1941 (1.24) 0.0000 (1.0) 1.1941 (1.24) 0.0000 (1.0) 0;0 0.8374 (0.81) 1 1
test_sharing_s3-pull-noop[2.40.0] 1.1795 (1.22) 1.1795 (1.22) 1.1795 (1.22) 0.0000 (1.0) 1.1795 (1.22) 0.0000 (1.0) 0;0 0.8478 (0.82) 1 1
test_sharing_s3-pull-noop[2.58.2] 1.3033 (1.35) 1.3033 (1.35) 1.3033 (1.35) 0.0000 (1.0) 1.3033 (1.35) 0.0000 (1.0) 0;0 0.7673 (0.74) 1 1
test_sharing_s3-pull-noop[2.58.2] 1.2830 (1.33) 1.2830 (1.33) 1.2830 (1.33) 0.0000 (1.0) 1.2830 (1.33) 0.0000 (1.0) 0;0 0.7794 (0.75) 1 1
test_sharing_s3-pull-noop[3.0.0] 1.4456 (1.50) 1.4456 (1.50) 1.4456 (1.50) 0.0000 (1.0) 1.4456 (1.50) 0.0000 (1.0) 0;0 0.6917 (0.67) 1 1
test_sharing_s3-pull-noop[3.0.0] 1.4471 (1.50) 1.4471 (1.50) 1.4471 (1.50) 0.0000 (1.0) 1.4471 (1.50) 0.0000 (1.0) 0;0 0.6910 (0.67) 1 1
test_sharing_s3-pull-noop[main] 1.8334 (1.90) 1.8334 (1.90) 1.8334 (1.90) 0.0000 (1.0) 1.8334 (1.90) 0.0000 (1.0) 0;0 0.5454 (0.53) 1 1
test_sharing_s3-pull-noop[main] 1.8243 (1.89) 1.8243 (1.89) 1.8243 (1.89) 0.0000 (1.0) 1.8243 (1.89) 0.0000 (1.0) 0;0 0.5482 (0.53) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 10 tests -------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push[2.11.0] 30.1471 (2.67) 30.1471 (2.67) 30.1471 (2.67) 0.0000 (1.0) 30.1471 (2.67) 0.0000 (1.0) 0;0 0.0332 (0.38) 1 1
test_sharing_s3-push[2.11.0] 30.4752 (2.69) 30.4752 (2.69) 30.4752 (2.69) 0.0000 (1.0) 30.4752 (2.69) 0.0000 (1.0) 0;0 0.0328 (0.37) 1 1
test_sharing_s3-push[2.40.0] 32.4130 (2.87) 32.4130 (2.87) 32.4130 (2.87) 0.0000 (1.0) 32.4130 (2.87) 0.0000 (1.0) 0;0 0.0309 (0.35) 1 1
test_sharing_s3-push[2.40.0] 33.3134 (2.95) 33.3134 (2.95) 33.3134 (2.95) 0.0000 (1.0) 33.3134 (2.95) 0.0000 (1.0) 0;0 0.0300 (0.34) 1 1
test_sharing_s3-push[2.58.2] 13.0859 (1.16) 13.0859 (1.16) 13.0859 (1.16) 0.0000 (1.0) 13.0859 (1.16) 0.0000 (1.0) 0;0 0.0764 (0.86) 1 1
test_sharing_s3-push[2.58.2] 13.0384 (1.15) 13.0384 (1.15) 13.0384 (1.15) 0.0000 (1.0) 13.0384 (1.15) 0.0000 (1.0) 0;0 0.0767 (0.87) 1 1
test_sharing_s3-push[3.0.0] 11.3101 (1.0) 11.3101 (1.0) 11.3101 (1.0) 0.0000 (1.0) 11.3101 (1.0) 0.0000 (1.0) 0;0 0.0884 (1.0) 1 1
test_sharing_s3-push[3.0.0] 11.4215 (1.01) 11.4215 (1.01) 11.4215 (1.01) 0.0000 (1.0) 11.4215 (1.01) 0.0000 (1.0) 0;0 0.0876 (0.99) 1 1
test_sharing_s3-push[main] 13.2330 (1.17) 13.2330 (1.17) 13.2330 (1.17) 0.0000 (1.0) 13.2330 (1.17) 0.0000 (1.0) 0;0 0.0756 (0.85) 1 1
test_sharing_s3-push[main] 13.0455 (1.15) 13.0455 (1.15) 13.0455 (1.15) 0.0000 (1.0) 13.0455 (1.15) 0.0000 (1.0) 0;0 0.0767 (0.87) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------- benchmark 'test_sharing_s3-push-noop': 10 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing_s3-push-noop[2.11.0] 1.2708 (1.0) 1.2708 (1.0) 1.2708 (1.0) 0.0000 (1.0) 1.2708 (1.0) 0.0000 (1.0) 0;0 0.7869 (1.0) 1 1
test_sharing_s3-push-noop[2.11.0] 1.3406 (1.05) 1.3406 (1.05) 1.3406 (1.05) 0.0000 (1.0) 1.3406 (1.05) 0.0000 (1.0) 0;0 0.7459 (0.95) 1 1
test_sharing_s3-push-noop[2.40.0] 1.3704 (1.08) 1.3704 (1.08) 1.3704 (1.08) 0.0000 (1.0) 1.3704 (1.08) 0.0000 (1.0) 0;0 0.7297 (0.93) 1 1
test_sharing_s3-push-noop[2.40.0] 1.3203 (1.04) 1.3203 (1.04) 1.3203 (1.04) 0.0000 (1.0) 1.3203 (1.04) 0.0000 (1.0) 0;0 0.7574 (0.96) 1 1
test_sharing_s3-push-noop[2.58.2] 1.3903 (1.09) 1.3903 (1.09) 1.3903 (1.09) 0.0000 (1.0) 1.3903 (1.09) 0.0000 (1.0) 0;0 0.7193 (0.91) 1 1
test_sharing_s3-push-noop[2.58.2] 1.3693 (1.08) 1.3693 (1.08) 1.3693 (1.08) 0.0000 (1.0) 1.3693 (1.08) 0.0000 (1.0) 0;0 0.7303 (0.93) 1 1
test_sharing_s3-push-noop[3.0.0] 1.3560 (1.07) 1.3560 (1.07) 1.3560 (1.07) 0.0000 (1.0) 1.3560 (1.07) 0.0000 (1.0) 0;0 0.7375 (0.94) 1 1
test_sharing_s3-push-noop[3.0.0] 1.3560 (1.07) 1.3560 (1.07) 1.3560 (1.07) 0.0000 (1.0) 1.3560 (1.07) 0.0000 (1.0) 0;0 0.7375 (0.94) 1 1
test_sharing_s3-push-noop[main] 1.3904 (1.09) 1.3904 (1.09) 1.3904 (1.09) 0.0000 (1.0) 1.3904 (1.09) 0.0000 (1.0) 0;0 0.7192 (0.91) 1 1
test_sharing_s3-push-noop[main] 1.3775 (1.08) 1.3775 (1.08) 1.3775 (1.08) 0.0000 (1.0) 1.3775 (1.08) 0.0000 (1.0) 0;0 0.7260 (0.92) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.11.0] 2.8878 (1.56) 2.8878 (1.56) 2.8878 (1.56) 0.0000 (1.0) 2.8878 (1.56) 0.0000 (1.0) 0;0 0.3463 (0.64) 1 1
test_status-status[2.40.0] 1.9889 (1.08) 1.9889 (1.08) 1.9889 (1.08) 0.0000 (1.0) 1.9889 (1.08) 0.0000 (1.0) 0;0 0.5028 (0.93) 1 1
test_status-status[2.58.2] 1.9501 (1.06) 1.9501 (1.06) 1.9501 (1.06) 0.0000 (1.0) 1.9501 (1.06) 0.0000 (1.0) 0;0 0.5128 (0.95) 1 1
test_status-status[3.0.0] 1.8468 (1.0) 1.8468 (1.0) 1.8468 (1.0) 0.0000 (1.0) 1.8468 (1.0) 0.0000 (1.0) 0;0 0.5415 (1.0) 1 1
test_status-status[main] 1.8497 (1.00) 1.8497 (1.00) 1.8497 (1.00) 0.0000 (1.0) 1.8497 (1.00) 0.0000 (1.0) 0;0 0.5406 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_status-status-changed': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.11.0] 2.0744 (2.70) 2.0744 (2.70) 2.0744 (2.70) 0.0000 (1.0) 2.0744 (2.70) 0.0000 (1.0) 0;0 0.4821 (0.37) 1 1
test_status-status-changed[2.40.0] 0.7669 (1.0) 0.7669 (1.0) 0.7669 (1.0) 0.0000 (1.0) 0.7669 (1.0) 0.0000 (1.0) 0;0 1.3039 (1.0) 1 1
test_status-status-changed[2.58.2] 0.8493 (1.11) 0.8493 (1.11) 0.8493 (1.11) 0.0000 (1.0) 0.8493 (1.11) 0.0000 (1.0) 0;0 1.1774 (0.90) 1 1
test_status-status-changed[3.0.0] 0.7962 (1.04) 0.7962 (1.04) 0.7962 (1.04) 0.0000 (1.0) 0.7962 (1.04) 0.0000 (1.0) 0;0 1.2560 (0.96) 1 1
test_status-status-changed[main] 0.8049 (1.05) 0.8049 (1.05) 0.8049 (1.05) 0.0000 (1.0) 0.8049 (1.05) 0.0000 (1.0) 0;0 1.2423 (0.95) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.11.0] 959.2197 (1.22) 959.2197 (1.22) 959.2197 (1.22) 0.0000 (1.0) 959.2197 (1.22) 0.0000 (1.0) 0;0 1.0425 (0.82) 1 1
test_status-status-changed-noop[2.40.0] 784.4302 (1.00) 784.4302 (1.00) 784.4302 (1.00) 0.0000 (1.0) 784.4302 (1.00) 0.0000 (1.0) 0;0 1.2748 (1.00) 1 1
test_status-status-changed-noop[2.58.2] 889.5321 (1.13) 889.5321 (1.13) 889.5321 (1.13) 0.0000 (1.0) 889.5321 (1.13) 0.0000 (1.0) 0;0 1.1242 (0.88) 1 1
test_status-status-changed-noop[3.0.0] 783.9407 (1.0) 783.9407 (1.0) 783.9407 (1.0) 0.0000 (1.0) 783.9407 (1.0) 0.0000 (1.0) 0;0 1.2756 (1.0) 1 1
test_status-status-changed-noop[main] 831.6140 (1.06) 831.6140 (1.06) 831.6140 (1.06) 0.0000 (1.0) 831.6140 (1.06) 0.0000 (1.0) 0;0 1.2025 (0.94) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.11.0] 535.3387 (1.0) 535.3387 (1.0) 535.3387 (1.0) 0.0000 (1.0) 535.3387 (1.0) 0.0000 (1.0) 0;0 1.8680 (1.0) 1 1
test_status-status-noop[2.40.0] 810.1338 (1.51) 810.1338 (1.51) 810.1338 (1.51) 0.0000 (1.0) 810.1338 (1.51) 0.0000 (1.0) 0;0 1.2344 (0.66) 1 1
test_status-status-noop[2.58.2] 848.1422 (1.58) 848.1422 (1.58) 848.1422 (1.58) 0.0000 (1.0) 848.1422 (1.58) 0.0000 (1.0) 0;0 1.1790 (0.63) 1 1
test_status-status-noop[3.0.0] 787.1441 (1.47) 787.1441 (1.47) 787.1441 (1.47) 0.0000 (1.0) 787.1441 (1.47) 0.0000 (1.0) 0;0 1.2704 (0.68) 1 1
test_status-status-noop[main] 776.6580 (1.45) 776.6580 (1.45) 776.6580 (1.45) 0.0000 (1.0) 776.6580 (1.45) 0.0000 (1.0) 0;0 1.2876 (0.69) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_update-import-url': 5 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.11.0] 11.9594 (1.46) 11.9594 (1.46) 11.9594 (1.46) 0.0000 (1.0) 11.9594 (1.46) 0.0000 (1.0) 0;0 0.0836 (0.69) 1 1
test_update-import-url[2.40.0] 10.0376 (1.22) 10.0376 (1.22) 10.0376 (1.22) 0.0000 (1.0) 10.0376 (1.22) 0.0000 (1.0) 0;0 0.0996 (0.82) 1 1
test_update-import-url[2.58.2] 8.3284 (1.01) 8.3284 (1.01) 8.3284 (1.01) 0.0000 (1.0) 8.3284 (1.01) 0.0000 (1.0) 0;0 0.1201 (0.99) 1 1
test_update-import-url[3.0.0] 8.2069 (1.0) 8.2069 (1.0) 8.2069 (1.0) 0.0000 (1.0) 8.2069 (1.0) 0.0000 (1.0) 0;0 0.1218 (1.0) 1 1
test_update-import-url[main] 8.2944 (1.01) 8.2944 (1.01) 8.2944 (1.01) 0.0000 (1.0) 8.2944 (1.01) 0.0000 (1.0) 0;0 0.1206 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.11.0] 9.1231 (1.35) 9.1231 (1.35) 9.1231 (1.35) 0.0000 (1.0) 9.1231 (1.35) 0.0000 (1.0) 0;0 0.1096 (0.74) 1 1
test_update-update[2.40.0] 6.7688 (1.0) 6.7688 (1.0) 6.7688 (1.0) 0.0000 (1.0) 6.7688 (1.0) 0.0000 (1.0) 0;0 0.1477 (1.0) 1 1
test_update-update[2.58.2] 7.2677 (1.07) 7.2677 (1.07) 7.2677 (1.07) 0.0000 (1.0) 7.2677 (1.07) 0.0000 (1.0) 0;0 0.1376 (0.93) 1 1
test_update-update[3.0.0] 7.3021 (1.08) 7.3021 (1.08) 7.3021 (1.08) 0.0000 (1.0) 7.3021 (1.08) 0.0000 (1.0) 0;0 0.1369 (0.93) 1 1
test_update-update[main] 7.4304 (1.10) 7.4304 (1.10) 7.4304 (1.10) 0.0000 (1.0) 7.4304 (1.10) 0.0000 (1.0) 0;0 0.1346 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 5 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.11.0] 589.7317 (1.0) 589.7317 (1.0) 589.7317 (1.0) 0.0000 (1.0) 589.7317 (1.0) 0.0000 (1.0) 0;0 1.6957 (1.0) 1 1
test_update-update-noop[2.40.0] 984.2928 (1.67) 984.2928 (1.67) 984.2928 (1.67) 0.0000 (1.0) 984.2928 (1.67) 0.0000 (1.0) 0;0 1.0160 (0.60) 1 1
test_update-update-noop[2.58.2] 1,130.2314 (1.92) 1,130.2314 (1.92) 1,130.2314 (1.92) 0.0000 (1.0) 1,130.2314 (1.92) 0.0000 (1.0) 0;0 0.8848 (0.52) 1 1
test_update-update-noop[3.0.0] 1,143.4737 (1.94) 1,143.4737 (1.94) 1,143.4737 (1.94) 0.0000 (1.0) 1,143.4737 (1.94) 0.0000 (1.0) 0;0 0.8745 (0.52) 1 1
test_update-update-noop[main] 1,165.5029 (1.98) 1,165.5029 (1.98) 1,165.5029 (1.98) 0.0000 (1.0) 1,165.5029 (1.98) 0.0000 (1.0) 0;0 0.8580 (0.51) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
Superseded by #469.
Bumps aws-actions/configure-aws-credentials from 2 to 3.
Release notes
Sourced from aws-actions/configure-aws-credentials's releases.
Changelog
Sourced from aws-actions/configure-aws-credentials's changelog.
... (truncated)
Commits
ef93a73
V3 (#791)131c7b6
chore: Bump jest from 29.6.2 to 29.6.3 (#786)6334b40
chore: Bump aws-sdk from 2.1436.0 to 2.1441.0 (#787)360ea31
chore: Bump aws-sdk from 2.1431.0 to 2.1436.0 (#783)de93b00
chore: Bump eslint from 8.46.0 to 8.47.0 (#784)746d33e
chore: Bump aws-sdk from 2.1426.0 to 2.1431.0 (#782)706fc9a
chore: Bump eslint from 8.45.0 to 8.46.0 (#780)9918371
chore: Bump aws-sdk from 2.1421.0 to 2.1426.0 (#781)345462a
chore: Bump jest from 29.6.1 to 29.6.2 (#779)80a7a6c
chore: Bump aws-sdk from 2.1416.0 to 2.1421.0 (#778)Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase
.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show