github-actions[bot]
commented
6 months ago
Tue Jan 9 09:37:25 UTC 2024
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2] 3.5494 (1.05) 3.5494 (1.05) 3.5494 (1.05) 0.0000 (1.0) 3.5494 (1.05) 0.0000 (1.0) 0;0 0.2817 (0.95) 1 1
test_add-add[3.10.0] 3.5185 (1.04) 3.5185 (1.04) 3.5185 (1.04) 0.0000 (1.0) 3.5185 (1.04) 0.0000 (1.0) 0;0 0.2842 (0.96) 1 1
test_add-add[main] 3.3764 (1.0) 3.3764 (1.0) 3.3764 (1.0) 0.0000 (1.0) 3.3764 (1.0) 0.0000 (1.0) 0;0 0.2962 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 1.9071 (1.20) 1.9071 (1.20) 1.9071 (1.20) 0.0000 (1.0) 1.9071 (1.20) 0.0000 (1.0) 0;0 0.5244 (0.83) 1 1
test_checkout_copy-checkout[3.10.0] 3.8586 (2.43) 3.8586 (2.43) 3.8586 (2.43) 0.0000 (1.0) 3.8586 (2.43) 0.0000 (1.0) 0;0 0.2592 (0.41) 1 1
test_checkout_copy-checkout[main] 1.5851 (1.0) 1.5851 (1.0) 1.5851 (1.0) 0.0000 (1.0) 1.5851 (1.0) 0.0000 (1.0) 0;0 0.6309 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 598.4824 (1.06) 598.4824 (1.06) 598.4824 (1.06) 0.0000 (1.0) 598.4824 (1.06) 0.0000 (1.0) 0;0 1.6709 (0.94) 1 1
test_checkout_copy-checkout-noop[3.10.0] 688.2051 (1.22) 688.2051 (1.22) 688.2051 (1.22) 0.0000 (1.0) 688.2051 (1.22) 0.0000 (1.0) 0;0 1.4531 (0.82) 1 1
test_checkout_copy-checkout-noop[main] 563.9233 (1.0) 563.9233 (1.0) 563.9233 (1.0) 0.0000 (1.0) 563.9233 (1.0) 0.0000 (1.0) 0;0 1.7733 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 721.1559 (1.14) 721.1559 (1.14) 721.1559 (1.14) 0.0000 (1.0) 721.1559 (1.14) 0.0000 (1.0) 0;0 1.3867 (0.88) 1 1
test_checkout_copy-checkout-update[3.10.0] 650.8654 (1.03) 650.8654 (1.03) 650.8654 (1.03) 0.0000 (1.0) 650.8654 (1.03) 0.0000 (1.0) 0;0 1.5364 (0.97) 1 1
test_checkout_copy-checkout-update[main] 632.4227 (1.0) 632.4227 (1.0) 632.4227 (1.0) 0.0000 (1.0) 632.4227 (1.0) 0.0000 (1.0) 0;0 1.5812 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.2546 (1.15) 1.2546 (1.15) 1.2546 (1.15) 0.0000 (1.0) 1.2546 (1.15) 0.0000 (1.0) 0;0 0.7970 (0.87) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.1181 (1.03) 1.1181 (1.03) 1.1181 (1.03) 0.0000 (1.0) 1.1181 (1.03) 0.0000 (1.0) 0;0 0.8943 (0.97) 1 1
test_checkout_hardlink-checkout[main] 1.0872 (1.0) 1.0872 (1.0) 1.0872 (1.0) 0.0000 (1.0) 1.0872 (1.0) 0.0000 (1.0) 0;0 0.9198 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 616.1719 (1.12) 616.1719 (1.12) 616.1719 (1.12) 0.0000 (1.0) 616.1719 (1.12) 0.0000 (1.0) 0;0 1.6229 (0.89) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 577.8036 (1.05) 577.8036 (1.05) 577.8036 (1.05) 0.0000 (1.0) 577.8036 (1.05) 0.0000 (1.0) 0;0 1.7307 (0.95) 1 1
test_checkout_hardlink-checkout-noop[main] 549.5347 (1.0) 549.5347 (1.0) 549.5347 (1.0) 0.0000 (1.0) 549.5347 (1.0) 0.0000 (1.0) 0;0 1.8197 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 701.1635 (1.17) 701.1635 (1.17) 701.1635 (1.17) 0.0000 (1.0) 701.1635 (1.17) 0.0000 (1.0) 0;0 1.4262 (0.86) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 653.0071 (1.09) 653.0071 (1.09) 653.0071 (1.09) 0.0000 (1.0) 653.0071 (1.09) 0.0000 (1.0) 0;0 1.5314 (0.92) 1 1
test_checkout_hardlink-checkout-update[main] 601.5752 (1.0) 601.5752 (1.0) 601.5752 (1.0) 0.0000 (1.0) 601.5752 (1.0) 0.0000 (1.0) 0;0 1.6623 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.3397 (1.16) 1.3397 (1.16) 1.3397 (1.16) 0.0000 (1.0) 1.3397 (1.16) 0.0000 (1.0) 0;0 0.7464 (0.86) 1 1
test_checkout_symlink-checkout[3.10.0] 1.1978 (1.04) 1.1978 (1.04) 1.1978 (1.04) 0.0000 (1.0) 1.1978 (1.04) 0.0000 (1.0) 0;0 0.8349 (0.96) 1 1
test_checkout_symlink-checkout[main] 1.1539 (1.0) 1.1539 (1.0) 1.1539 (1.0) 0.0000 (1.0) 1.1539 (1.0) 0.0000 (1.0) 0;0 0.8666 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 594.5027 (1.0) 594.5027 (1.0) 594.5027 (1.0) 0.0000 (1.0) 594.5027 (1.0) 0.0000 (1.0) 0;0 1.6821 (1.0) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 610.8088 (1.03) 610.8088 (1.03) 610.8088 (1.03) 0.0000 (1.0) 610.8088 (1.03) 0.0000 (1.0) 0;0 1.6372 (0.97) 1 1
test_checkout_symlink-checkout-noop[main] 608.2518 (1.02) 608.2518 (1.02) 608.2518 (1.02) 0.0000 (1.0) 608.2518 (1.02) 0.0000 (1.0) 0;0 1.6441 (0.98) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 776.4328 (1.11) 776.4328 (1.11) 776.4328 (1.11) 0.0000 (1.0) 776.4328 (1.11) 0.0000 (1.0) 0;0 1.2879 (0.90) 1 1
test_checkout_symlink-checkout-update[3.10.0] 749.7017 (1.07) 749.7017 (1.07) 749.7017 (1.07) 0.0000 (1.0) 749.7017 (1.07) 0.0000 (1.0) 0;0 1.3339 (0.93) 1 1
test_checkout_symlink-checkout-update[main] 699.3589 (1.0) 699.3589 (1.0) 699.3589 (1.0) 0.0000 (1.0) 699.3589 (1.0) 0.0000 (1.0) 0;0 1.4299 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 587.8582 (1.04) 587.8582 (1.04) 587.8582 (1.04) 0.0000 (1.0) 587.8582 (1.04) 0.0000 (1.0) 0;0 1.7011 (0.96) 1 1
test_data_status-data-changed[3.10.0] 566.7756 (1.0) 566.7756 (1.0) 566.7756 (1.0) 0.0000 (1.0) 566.7756 (1.0) 0.0000 (1.0) 0;0 1.7644 (1.0) 1 1
test_data_status-data-changed[main] 570.8188 (1.01) 570.8188 (1.01) 570.8188 (1.01) 0.0000 (1.0) 570.8188 (1.01) 0.0000 (1.0) 0;0 1.7519 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 589.4785 (1.05) 589.4785 (1.05) 589.4785 (1.05) 0.0000 (1.0) 589.4785 (1.05) 0.0000 (1.0) 0;0 1.6964 (0.96) 1 1
test_data_status-data-changed-noop[3.10.0] 571.6180 (1.02) 571.6180 (1.02) 571.6180 (1.02) 0.0000 (1.0) 571.6180 (1.02) 0.0000 (1.0) 0;0 1.7494 (0.98) 1 1
test_data_status-data-changed-noop[main] 562.9745 (1.0) 562.9745 (1.0) 562.9745 (1.0) 0.0000 (1.0) 562.9745 (1.0) 0.0000 (1.0) 0;0 1.7763 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.2427 (1.01) 1.2427 (1.01) 1.2427 (1.01) 0.0000 (1.0) 1.2427 (1.01) 0.0000 (1.0) 0;0 0.8047 (0.99) 1 1
test_data_status-data-new[3.10.0] 1.2302 (1.0) 1.2302 (1.0) 1.2302 (1.0) 0.0000 (1.0) 1.2302 (1.0) 0.0000 (1.0) 0;0 0.8129 (1.0) 1 1
test_data_status-data-new[main] 1.2424 (1.01) 1.2424 (1.01) 1.2424 (1.01) 0.0000 (1.0) 1.2424 (1.01) 0.0000 (1.0) 0;0 0.8049 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 599.0119 (1.06) 599.0119 (1.06) 599.0119 (1.06) 0.0000 (1.0) 599.0119 (1.06) 0.0000 (1.0) 0;0 1.6694 (0.95) 1 1
test_data_status-data-noop[3.10.0] 566.1962 (1.0) 566.1962 (1.0) 566.1962 (1.0) 0.0000 (1.0) 566.1962 (1.0) 0.0000 (1.0) 0;0 1.7662 (1.0) 1 1
test_data_status-data-noop[main] 574.2374 (1.01) 574.2374 (1.01) 574.2374 (1.01) 0.0000 (1.0) 574.2374 (1.01) 0.0000 (1.0) 0;0 1.7414 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.0275 (1.03) 1.0275 (1.03) 1.0275 (1.03) 0.0000 (1.0) 1.0275 (1.03) 0.0000 (1.0) 0;0 0.9733 (0.97) 1 1
test_data_status_all_flags-data-changed[3.10.0] 1.0059 (1.01) 1.0059 (1.01) 1.0059 (1.01) 0.0000 (1.0) 1.0059 (1.01) 0.0000 (1.0) 0;0 0.9941 (0.99) 1 1
test_data_status_all_flags-data-changed[main] 0.9976 (1.0) 0.9976 (1.0) 0.9976 (1.0) 0.0000 (1.0) 0.9976 (1.0) 0.0000 (1.0) 0;0 1.0024 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.0286 (1.05) 1.0286 (1.05) 1.0286 (1.05) 0.0000 (1.0) 1.0286 (1.05) 0.0000 (1.0) 0;0 0.9722 (0.96) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 1.0213 (1.04) 1.0213 (1.04) 1.0213 (1.04) 0.0000 (1.0) 1.0213 (1.04) 0.0000 (1.0) 0;0 0.9791 (0.96) 1 1
test_data_status_all_flags-data-changed-noop[main] 0.9842 (1.0) 0.9842 (1.0) 0.9842 (1.0) 0.0000 (1.0) 0.9842 (1.0) 0.0000 (1.0) 0;0 1.0161 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 1.6692 (1.01) 1.6692 (1.01) 1.6692 (1.01) 0.0000 (1.0) 1.6692 (1.01) 0.0000 (1.0) 0;0 0.5991 (0.99) 1 1
test_data_status_all_flags-data-new[3.10.0] 1.6863 (1.02) 1.6863 (1.02) 1.6863 (1.02) 0.0000 (1.0) 1.6863 (1.02) 0.0000 (1.0) 0;0 0.5930 (0.98) 1 1
test_data_status_all_flags-data-new[main] 1.6490 (1.0) 1.6490 (1.0) 1.6490 (1.0) 0.0000 (1.0) 1.6490 (1.0) 0.0000 (1.0) 0;0 0.6064 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 972.6256 (1.0) 972.6256 (1.0) 972.6256 (1.0) 0.0000 (1.0) 972.6256 (1.0) 0.0000 (1.0) 0;0 1.0281 (1.0) 1 1
test_data_status_all_flags-data-noop[3.10.0] 977.6430 (1.01) 977.6430 (1.01) 977.6430 (1.01) 0.0000 (1.0) 977.6430 (1.01) 0.0000 (1.0) 0;0 1.0229 (0.99) 1 1
test_data_status_all_flags-data-noop[main] 984.4207 (1.01) 984.4207 (1.01) 984.4207 (1.01) 0.0000 (1.0) 984.4207 (1.01) 0.0000 (1.0) 0;0 1.0158 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.2056 (1.0) 1.2056 (1.0) 1.2056 (1.0) 0.0000 (1.0) 1.2056 (1.0) 0.0000 (1.0) 0;0 0.8295 (1.0) 1 1
test_diff-diff[3.10.0] 1.2297 (1.02) 1.2297 (1.02) 1.2297 (1.02) 0.0000 (1.0) 1.2297 (1.02) 0.0000 (1.0) 0;0 0.8132 (0.98) 1 1
test_diff-diff[main] 1.2520 (1.04) 1.2520 (1.04) 1.2520 (1.04) 0.0000 (1.0) 1.2520 (1.04) 0.0000 (1.0) 0;0 0.7987 (0.96) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 635.3948 (1.04) 635.3948 (1.04) 635.3948 (1.04) 0.0000 (1.0) 635.3948 (1.04) 0.0000 (1.0) 0;0 1.5738 (0.96) 1 1
test_diff-diff-changed[3.10.0] 660.8093 (1.09) 660.8093 (1.09) 660.8093 (1.09) 0.0000 (1.0) 660.8093 (1.09) 0.0000 (1.0) 0;0 1.5133 (0.92) 1 1
test_diff-diff-changed[main] 608.5647 (1.0) 608.5647 (1.0) 608.5647 (1.0) 0.0000 (1.0) 608.5647 (1.0) 0.0000 (1.0) 0;0 1.6432 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 640.4624 (1.05) 640.4624 (1.05) 640.4624 (1.05) 0.0000 (1.0) 640.4624 (1.05) 0.0000 (1.0) 0;0 1.5614 (0.95) 1 1
test_diff-diff-changed-noop[3.10.0] 647.1453 (1.06) 647.1453 (1.06) 647.1453 (1.06) 0.0000 (1.0) 647.1453 (1.06) 0.0000 (1.0) 0;0 1.5452 (0.94) 1 1
test_diff-diff-changed-noop[main] 608.3098 (1.0) 608.3098 (1.0) 608.3098 (1.0) 0.0000 (1.0) 608.3098 (1.0) 0.0000 (1.0) 0;0 1.6439 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 575.1144 (1.0) 575.1144 (1.0) 575.1144 (1.0) 0.0000 (1.0) 575.1144 (1.0) 0.0000 (1.0) 0;0 1.7388 (1.0) 1 1
test_diff-diff-noop[3.10.0] 582.8244 (1.01) 582.8244 (1.01) 582.8244 (1.01) 0.0000 (1.0) 582.8244 (1.01) 0.0000 (1.0) 0;0 1.7158 (0.99) 1 1
test_diff-diff-noop[main] 604.1115 (1.05) 604.1115 (1.05) 604.1115 (1.05) 0.0000 (1.0) 604.1115 (1.05) 0.0000 (1.0) 0;0 1.6553 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 835.4653 (1.0) 835.4653 (1.0) 835.4653 (1.0) 0.0000 (1.0) 835.4653 (1.0) 0.0000 (1.0) 0;0 1.1969 (1.0) 1 1
test_exp_show-exp[3.10.0] 4,747.8788 (5.68) 4,747.8788 (5.68) 4,747.8788 (5.68) 0.0000 (1.0) 4,747.8788 (5.68) 0.0000 (1.0) 0;0 0.2106 (0.18) 1 1
test_exp_show-exp[main] 4,272.8839 (5.11) 4,272.8839 (5.11) 4,272.8839 (5.11) 0.0000 (1.0) 4,272.8839 (5.11) 0.0000 (1.0) 0;0 0.2340 (0.20) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 3.9827 (2.17) 3.9827 (2.17) 3.9827 (2.17) 0.0000 (1.0) 3.9827 (2.17) 0.0000 (1.0) 0;0 0.2511 (0.46) 1 1
test_fetch-fetch[3.10.0] 4.3823 (2.39) 4.3823 (2.39) 4.3823 (2.39) 0.0000 (1.0) 4.3823 (2.39) 0.0000 (1.0) 0;0 0.2282 (0.42) 1 1
test_fetch-fetch[main] 1.8339 (1.0) 1.8339 (1.0) 1.8339 (1.0) 0.0000 (1.0) 1.8339 (1.0) 0.0000 (1.0) 0;0 0.5453 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 493.6646 (1.03) 493.6646 (1.03) 493.6646 (1.03) 0.0000 (1.0) 493.6646 (1.03) 0.0000 (1.0) 0;0 2.0257 (0.97) 1 1
test_gc-gc[3.10.0] 501.2410 (1.05) 501.2410 (1.05) 501.2410 (1.05) 0.0000 (1.0) 501.2410 (1.05) 0.0000 (1.0) 0;0 1.9950 (0.95) 1 1
test_gc-gc[main] 478.0287 (1.0) 478.0287 (1.0) 478.0287 (1.0) 0.0000 (1.0) 478.0287 (1.0) 0.0000 (1.0) 0;0 2.0919 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 5.9371 (1.10) 5.9371 (1.10) 5.9371 (1.10) 0.0000 (1.0) 5.9371 (1.10) 0.0000 (1.0) 0;0 0.1684 (0.91) 1 1
test_get-get[3.10.0] 7.1197 (1.32) 7.1197 (1.32) 7.1197 (1.32) 0.0000 (1.0) 7.1197 (1.32) 0.0000 (1.0) 0;0 0.1405 (0.76) 1 1
test_get-get[main] 5.3924 (1.0) 5.3924 (1.0) 5.3924 (1.0) 0.0000 (1.0) 5.3924 (1.0) 0.0000 (1.0) 0;0 0.1854 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 3.0667 (3.28) 3.0667 (3.28) 3.0667 (3.28) 0.0000 (1.0) 3.0667 (3.28) 0.0000 (1.0) 0;0 0.3261 (0.30) 1 1
test_get_url-get-url[3.10.0] 3.1746 (3.40) 3.1746 (3.40) 3.1746 (3.40) 0.0000 (1.0) 3.1746 (3.40) 0.0000 (1.0) 0;0 0.3150 (0.29) 1 1
test_get_url-get-url[main] 0.9350 (1.0) 0.9350 (1.0) 0.9350 (1.0) 0.0000 (1.0) 0.9350 (1.0) 0.0000 (1.0) 0;0 1.0695 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 124.6056 (1.02) 129.7111 (1.02) 126.5231 (1.02) 0.7671 (1.04) 126.5481 (1.02) 1.0396 (1.14) 27;1 7.9037 (0.98) 100 1
test_help---help[3.10.0] 122.5026 (1.0) 127.1086 (1.0) 123.9361 (1.0) 0.7348 (1.0) 123.8411 (1.0) 1.0121 (1.11) 33;1 8.0687 (1.0) 100 1
test_help---help[main] 123.7294 (1.01) 136.8667 (1.08) 125.6705 (1.01) 1.7614 (2.40) 125.3481 (1.01) 0.9096 (1.0) 6;7 7.9573 (0.99) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 9.3016 (1.10) 9.3016 (1.10) 9.3016 (1.10) 0.0000 (1.0) 9.3016 (1.10) 0.0000 (1.0) 0;0 0.1075 (0.91) 1 1
test_import-import[3.10.0] 10.2528 (1.22) 10.2528 (1.22) 10.2528 (1.22) 0.0000 (1.0) 10.2528 (1.22) 0.0000 (1.0) 0;0 0.0975 (0.82) 1 1
test_import-import[main] 8.4183 (1.0) 8.4183 (1.0) 8.4183 (1.0) 0.0000 (1.0) 8.4183 (1.0) 0.0000 (1.0) 0;0 0.1188 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 7.7330 (1.47) 7.7330 (1.47) 7.7330 (1.47) 0.0000 (1.0) 7.7330 (1.47) 0.0000 (1.0) 0;0 0.1293 (0.68) 1 1
test_import_url-import-url[3.10.0] 7.8148 (1.48) 7.8148 (1.48) 7.8148 (1.48) 0.0000 (1.0) 7.8148 (1.48) 0.0000 (1.0) 0;0 0.1280 (0.67) 1 1
test_import_url-import-url[main] 5.2664 (1.0) 5.2664 (1.0) 5.2664 (1.0) 0.0000 (1.0) 5.2664 (1.0) 0.0000 (1.0) 0;0 0.1899 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 370.5910 (1.00) 409.6756 (1.0) 380.7603 (1.0) 7.7273 (1.05) 378.3188 (1.0) 7.4723 (1.58) 24;6 2.6263 (1.0) 100 1
test_init-init[3.10.0] 379.4147 (1.03) 466.0900 (1.14) 391.3571 (1.03) 9.5666 (1.30) 389.5830 (1.03) 7.1330 (1.51) 9;5 2.5552 (0.97) 100 1
test_init-init[main] 369.9986 (1.0) 432.5314 (1.06) 383.3487 (1.01) 7.3584 (1.0) 382.0692 (1.01) 4.7279 (1.0) 13;6 2.6086 (0.99) 100 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 401.2959 (1.05) 401.2959 (1.05) 401.2959 (1.05) 0.0000 (1.0) 401.2959 (1.05) 0.0000 (1.0) 0;0 2.4919 (0.95) 1 1
test_list-list[3.10.0] 399.0412 (1.05) 399.0412 (1.05) 399.0412 (1.05) 0.0000 (1.0) 399.0412 (1.05) 0.0000 (1.0) 0;0 2.5060 (0.95) 1 1
test_list-list[main] 380.7863 (1.0) 380.7863 (1.0) 380.7863 (1.0) 0.0000 (1.0) 380.7863 (1.0) 0.0000 (1.0) 0;0 2.6261 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 381.1693 (1.05) 381.1693 (1.05) 381.1693 (1.05) 0.0000 (1.0) 381.1693 (1.05) 0.0000 (1.0) 0;0 2.6235 (0.95) 1 1
test_list-list-dvc-only[3.10.0] 374.8696 (1.04) 374.8696 (1.04) 374.8696 (1.04) 0.0000 (1.0) 374.8696 (1.04) 0.0000 (1.0) 0;0 2.6676 (0.97) 1 1
test_list-list-dvc-only[main] 361.9009 (1.0) 361.9009 (1.0) 361.9009 (1.0) 0.0000 (1.0) 361.9009 (1.0) 0.0000 (1.0) 0;0 2.7632 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 467.1109 (1.03) 467.1109 (1.03) 467.1109 (1.03) 0.0000 (1.0) 467.1109 (1.03) 0.0000 (1.0) 0;0 2.1408 (0.97) 1 1
test_list-list-recursive[3.10.0] 461.0036 (1.01) 461.0036 (1.01) 461.0036 (1.01) 0.0000 (1.0) 461.0036 (1.01) 0.0000 (1.0) 0;0 2.1692 (0.99) 1 1
test_list-list-recursive[main] 454.7974 (1.0) 454.7974 (1.0) 454.7974 (1.0) 0.0000 (1.0) 454.7974 (1.0) 0.0000 (1.0) 0;0 2.1988 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 383.2074 (1.05) 383.2074 (1.05) 383.2074 (1.05) 0.0000 (1.0) 383.2074 (1.05) 0.0000 (1.0) 0;0 2.6096 (0.95) 1 1
test_list-list-shallow[3.10.0] 376.9350 (1.03) 376.9350 (1.03) 376.9350 (1.03) 0.0000 (1.0) 376.9350 (1.03) 0.0000 (1.0) 0;0 2.6530 (0.97) 1 1
test_list-list-shallow[main] 364.3993 (1.0) 364.3993 (1.0) 364.3993 (1.0) 0.0000 (1.0) 364.3993 (1.0) 0.0000 (1.0) 0;0 2.7442 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.1325 (1.07) 2.1325 (1.07) 2.1325 (1.07) 0.0000 (1.0) 2.1325 (1.07) 0.0000 (1.0) 0;0 0.4689 (0.94) 1 1
test_partial_add-add[3.10.0] 2.1557 (1.08) 2.1557 (1.08) 2.1557 (1.08) 0.0000 (1.0) 2.1557 (1.08) 0.0000 (1.0) 0;0 0.4639 (0.93) 1 1
test_partial_add-add[main] 2.0010 (1.0) 2.0010 (1.0) 2.0010 (1.0) 0.0000 (1.0) 2.0010 (1.0) 0.0000 (1.0) 0;0 0.4997 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 3.0538 (1.05) 3.0538 (1.05) 3.0538 (1.05) 0.0000 (1.0) 3.0538 (1.05) 0.0000 (1.0) 0;0 0.3275 (0.95) 1 1
test_partial_add-add-partial[3.10.0] 3.1741 (1.10) 3.1741 (1.10) 3.1741 (1.10) 0.0000 (1.0) 3.1741 (1.10) 0.0000 (1.0) 0;0 0.3150 (0.91) 1 1
test_partial_add-add-partial[main] 2.8964 (1.0) 2.8964 (1.0) 2.8964 (1.0) 0.0000 (1.0) 2.8964 (1.0) 0.0000 (1.0) 0;0 0.3453 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 584.9921 (1.0) 584.9921 (1.0) 584.9921 (1.0) 0.0000 (1.0) 584.9921 (1.0) 0.0000 (1.0) 0;0 1.7094 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 694.8682 (1.19) 694.8682 (1.19) 694.8682 (1.19) 0.0000 (1.0) 694.8682 (1.19) 0.0000 (1.0) 0;0 1.4391 (0.84) 1 1
test_partial_add-gc-cloud-noop[main] 681.2672 (1.16) 681.2672 (1.16) 681.2672 (1.16) 0.0000 (1.0) 681.2672 (1.16) 0.0000 (1.0) 0;0 1.4679 (0.86) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 504.7156 (1.0) 504.7156 (1.0) 504.7156 (1.0) 0.0000 (1.0) 504.7156 (1.0) 0.0000 (1.0) 0;0 1.9813 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 589.3493 (1.17) 589.3493 (1.17) 589.3493 (1.17) 0.0000 (1.0) 589.3493 (1.17) 0.0000 (1.0) 0;0 1.6968 (0.86) 1 1
test_partial_add-gc-noop[main] 544.7751 (1.08) 544.7751 (1.08) 544.7751 (1.08) 0.0000 (1.0) 544.7751 (1.08) 0.0000 (1.0) 0;0 1.8356 (0.93) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 2.0014 (1.77) 2.0014 (1.77) 2.0014 (1.77) 0.0000 (1.0) 2.0014 (1.77) 0.0000 (1.0) 0;0 0.4997 (0.57) 1 1
test_partial_add-push[3.10.0] 1.2077 (1.07) 1.2077 (1.07) 1.2077 (1.07) 0.0000 (1.0) 1.2077 (1.07) 0.0000 (1.0) 0;0 0.8280 (0.94) 1 1
test_partial_add-push[main] 1.1314 (1.0) 1.1314 (1.0) 1.1314 (1.0) 0.0000 (1.0) 1.1314 (1.0) 0.0000 (1.0) 0;0 0.8839 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 2.0278 (1.68) 2.0278 (1.68) 2.0278 (1.68) 0.0000 (1.0) 2.0278 (1.68) 0.0000 (1.0) 0;0 0.4932 (0.59) 1 1
test_partial_add-push-partial[3.10.0] 1.2572 (1.04) 1.2572 (1.04) 1.2572 (1.04) 0.0000 (1.0) 1.2572 (1.04) 0.0000 (1.0) 0;0 0.7954 (0.96) 1 1
test_partial_add-push-partial[main] 1.2061 (1.0) 1.2061 (1.0) 1.2061 (1.0) 0.0000 (1.0) 1.2061 (1.0) 0.0000 (1.0) 0;0 0.8291 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.5979 (1.05) 3.5979 (1.05) 3.5979 (1.05) 0.0000 (1.0) 3.5979 (1.05) 0.0000 (1.0) 0;0 0.2779 (0.95) 1 1
test_partial_remove-add[3.10.0] 3.6813 (1.08) 3.6813 (1.08) 3.6813 (1.08) 0.0000 (1.0) 3.6813 (1.08) 0.0000 (1.0) 0;0 0.2716 (0.93) 1 1
test_partial_remove-add[main] 3.4137 (1.0) 3.4137 (1.0) 3.4137 (1.0) 0.0000 (1.0) 3.4137 (1.0) 0.0000 (1.0) 0;0 0.2929 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.4340 (1.05) 1.4340 (1.05) 1.4340 (1.05) 0.0000 (1.0) 1.4340 (1.05) 0.0000 (1.0) 0;0 0.6974 (0.96) 1 1
test_partial_remove-add-update[3.10.0] 1.4660 (1.07) 1.4660 (1.07) 1.4660 (1.07) 0.0000 (1.0) 1.4660 (1.07) 0.0000 (1.0) 0;0 0.6821 (0.93) 1 1
test_partial_remove-add-update[main] 1.3699 (1.0) 1.3699 (1.0) 1.3699 (1.0) 0.0000 (1.0) 1.3699 (1.0) 0.0000 (1.0) 0;0 0.7300 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 498.7406 (1.0) 498.7406 (1.0) 498.7406 (1.0) 0.0000 (1.0) 498.7406 (1.0) 0.0000 (1.0) 0;0 2.0051 (1.0) 1 1
test_partial_remove-gc[3.10.0] 544.2271 (1.09) 544.2271 (1.09) 544.2271 (1.09) 0.0000 (1.0) 544.2271 (1.09) 0.0000 (1.0) 0;0 1.8375 (0.92) 1 1
test_partial_remove-gc[main] 527.8353 (1.06) 527.8353 (1.06) 527.8353 (1.06) 0.0000 (1.0) 527.8353 (1.06) 0.0000 (1.0) 0;0 1.8945 (0.94) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 559.1342 (1.0) 559.1342 (1.0) 559.1342 (1.0) 0.0000 (1.0) 559.1342 (1.0) 0.0000 (1.0) 0;0 1.7885 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 593.2734 (1.06) 593.2734 (1.06) 593.2734 (1.06) 0.0000 (1.0) 593.2734 (1.06) 0.0000 (1.0) 0;0 1.6856 (0.94) 1 1
test_partial_remove-gc-cloud[main] 621.9860 (1.11) 621.9860 (1.11) 621.9860 (1.11) 0.0000 (1.0) 621.9860 (1.11) 0.0000 (1.0) 0;0 1.6078 (0.90) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 3.4191 (2.38) 3.4191 (2.38) 3.4191 (2.38) 0.0000 (1.0) 3.4191 (2.38) 0.0000 (1.0) 0;0 0.2925 (0.42) 1 1
test_partial_remove-push[3.10.0] 1.8989 (1.32) 1.8989 (1.32) 1.8989 (1.32) 0.0000 (1.0) 1.8989 (1.32) 0.0000 (1.0) 0;0 0.5266 (0.76) 1 1
test_partial_remove-push[main] 1.4388 (1.0) 1.4388 (1.0) 1.4388 (1.0) 0.0000 (1.0) 1.4388 (1.0) 0.0000 (1.0) 0;0 0.6950 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 489.0085 (1.02) 489.0085 (1.02) 489.0085 (1.02) 0.0000 (1.0) 489.0085 (1.02) 0.0000 (1.0) 0;0 2.0450 (0.98) 1 1
test_partial_remove-push-update[3.10.0] 477.8802 (1.0) 477.8802 (1.0) 477.8802 (1.0) 0.0000 (1.0) 477.8802 (1.0) 0.0000 (1.0) 0;0 2.0926 (1.0) 1 1
test_partial_remove-push-update[main] 783.6556 (1.64) 783.6556 (1.64) 783.6556 (1.64) 0.0000 (1.0) 783.6556 (1.64) 0.0000 (1.0) 0;0 1.2761 (0.61) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 419.6662 (1.0) 423.5443 (1.0) 422.1340 (1.0) 1.6510 (1.0) 422.7978 (1.0) 2.5802 (1.0) 1;0 2.3689 (1.0) 5 3
test_plots-plots-diff[3.10.0] 782.1139 (1.86) 794.9745 (1.88) 787.5968 (1.87) 6.7568 (4.09) 783.8256 (1.85) 12.8281 (4.97) 2;0 1.2697 (0.54) 5 3
test_plots-plots-diff[main] 748.3840 (1.78) 760.0891 (1.79) 756.2823 (1.79) 4.6826 (2.84) 758.5037 (1.79) 5.0863 (1.97) 1;0 1.3223 (0.56) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 431.7504 (1.0) 445.8982 (1.0) 436.5529 (1.0) 5.4414 (1.0) 435.3229 (1.0) 4.6174 (1.0) 1;1 2.2907 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,036.8794 (2.40) 1,071.5219 (2.40) 1,046.2318 (2.40) 14.5565 (2.68) 1,040.2059 (2.39) 14.9428 (3.24) 1;0 0.9558 (0.42) 5 3
test_plots-plots-diff-json[main] 817.1222 (1.89) 849.4197 (1.90) 833.3547 (1.91) 12.0199 (2.21) 830.6597 (1.91) 15.1876 (3.29) 2;0 1.2000 (0.52) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 387.8831 (1.0) 399.0205 (1.0) 392.1607 (1.0) 4.7800 (1.0) 389.9201 (1.0) 7.6401 (1.0) 1;0 2.5500 (1.0) 5 3
test_plots-plots-show[3.10.0] 647.5887 (1.67) 665.5941 (1.67) 657.4859 (1.68) 6.8849 (1.44) 657.5025 (1.69) 9.7339 (1.27) 2;0 1.5209 (0.60) 5 3
test_plots-plots-show[main] 625.1047 (1.61) 639.0094 (1.60) 632.5525 (1.61) 5.7723 (1.21) 634.7058 (1.63) 9.3631 (1.23) 2;0 1.5809 (0.62) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 402.6147 (1.0) 410.5445 (1.0) 405.7120 (1.0) 3.6500 (1.0) 403.6791 (1.0) 6.2471 (1.0) 1;0 2.4648 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 801.4717 (1.99) 887.5857 (2.16) 821.5984 (2.03) 37.0367 (10.15) 804.5512 (1.99) 26.4756 (4.24) 1;1 1.2171 (0.49) 5 3
test_plots-plots-show-json[main] 675.4922 (1.68) 705.5693 (1.72) 692.9286 (1.71) 15.8339 (4.34) 703.6639 (1.74) 28.8949 (4.63) 2;0 1.4432 (0.59) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 3.4202 (2.44) 3.4202 (2.44) 3.4202 (2.44) 0.0000 (1.0) 3.4202 (2.44) 0.0000 (1.0) 0;0 0.2924 (0.41) 1 1
test_push-push[3.10.0] 1.9078 (1.36) 1.9078 (1.36) 1.9078 (1.36) 0.0000 (1.0) 1.9078 (1.36) 0.0000 (1.0) 0;0 0.5242 (0.74) 1 1
test_push-push[main] 1.4031 (1.0) 1.4031 (1.0) 1.4031 (1.0) 0.0000 (1.0) 1.4031 (1.0) 0.0000 (1.0) 0;0 0.7127 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2] 3.6268 (1.04) 3.6268 (1.04) 3.6268 (1.04) 0.0000 (1.0) 3.6268 (1.04) 0.0000 (1.0) 0;0 0.2757 (0.96) 1 1
test_sharing-add[3.10.0] 3.6252 (1.04) 3.6252 (1.04) 3.6252 (1.04) 0.0000 (1.0) 3.6252 (1.04) 0.0000 (1.0) 0;0 0.2758 (0.96) 1 1
test_sharing-add[main] 3.4870 (1.0) 3.4870 (1.0) 3.4870 (1.0) 0.0000 (1.0) 3.4870 (1.0) 0.0000 (1.0) 0;0 0.2868 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2] 2.4712 (1.09) 2.4712 (1.09) 2.4712 (1.09) 0.0000 (1.0) 2.4712 (1.09) 0.0000 (1.0) 0;0 0.4047 (0.92) 1 1
test_sharing-add-noop[3.10.0] 2.4430 (1.08) 2.4430 (1.08) 2.4430 (1.08) 0.0000 (1.0) 2.4430 (1.08) 0.0000 (1.0) 0;0 0.4093 (0.93) 1 1
test_sharing-add-noop[main] 2.2720 (1.0) 2.2720 (1.0) 2.2720 (1.0) 0.0000 (1.0) 2.2720 (1.0) 0.0000 (1.0) 0;0 0.4401 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2] 1.7266 (1.25) 1.7266 (1.25) 1.7266 (1.25) 0.0000 (1.0) 1.7266 (1.25) 0.0000 (1.0) 0;0 0.5792 (0.80) 1 1
test_sharing-checkout[3.10.0] 3.6937 (2.67) 3.6937 (2.67) 3.6937 (2.67) 0.0000 (1.0) 3.6937 (2.67) 0.0000 (1.0) 0;0 0.2707 (0.37) 1 1
test_sharing-checkout[main] 1.3821 (1.0) 1.3821 (1.0) 1.3821 (1.0) 0.0000 (1.0) 1.3821 (1.0) 0.0000 (1.0) 0;0 0.7235 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2] 550.1230 (1.0) 550.1230 (1.0) 550.1230 (1.0) 0.0000 (1.0) 550.1230 (1.0) 0.0000 (1.0) 0;0 1.8178 (1.0) 1 1
test_sharing-checkout-noop[3.10.0] 575.9545 (1.05) 575.9545 (1.05) 575.9545 (1.05) 0.0000 (1.0) 575.9545 (1.05) 0.0000 (1.0) 0;0 1.7362 (0.96) 1 1
test_sharing-checkout-noop[main] 558.7527 (1.02) 558.7527 (1.02) 558.7527 (1.02) 0.0000 (1.0) 558.7527 (1.02) 0.0000 (1.0) 0;0 1.7897 (0.98) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 3.9247 (2.11) 3.9247 (2.11) 3.9247 (2.11) 0.0000 (1.0) 3.9247 (2.11) 0.0000 (1.0) 0;0 0.2548 (0.47) 1 1
test_sharing-fetch[3.10.0] 4.3848 (2.36) 4.3848 (2.36) 4.3848 (2.36) 0.0000 (1.0) 4.3848 (2.36) 0.0000 (1.0) 0;0 0.2281 (0.42) 1 1
test_sharing-fetch[main] 1.8605 (1.0) 1.8605 (1.0) 1.8605 (1.0) 0.0000 (1.0) 1.8605 (1.0) 0.0000 (1.0) 0;0 0.5375 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 422.5906 (1.0) 422.5906 (1.0) 422.5906 (1.0) 0.0000 (1.0) 422.5906 (1.0) 0.0000 (1.0) 0;0 2.3664 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 508.6525 (1.20) 508.6525 (1.20) 508.6525 (1.20) 0.0000 (1.0) 508.6525 (1.20) 0.0000 (1.0) 0;0 1.9660 (0.83) 1 1
test_sharing-fetch-noop[main] 832.5534 (1.97) 832.5534 (1.97) 832.5534 (1.97) 0.0000 (1.0) 832.5534 (1.97) 0.0000 (1.0) 0;0 1.2011 (0.51) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 3.3957 (2.32) 3.3957 (2.32) 3.3957 (2.32) 0.0000 (1.0) 3.3957 (2.32) 0.0000 (1.0) 0;0 0.2945 (0.43) 1 1
test_sharing-push[3.10.0] 1.9014 (1.30) 1.9014 (1.30) 1.9014 (1.30) 0.0000 (1.0) 1.9014 (1.30) 0.0000 (1.0) 0;0 0.5259 (0.77) 1 1
test_sharing-push[main] 1.4634 (1.0) 1.4634 (1.0) 1.4634 (1.0) 0.0000 (1.0) 1.4634 (1.0) 0.0000 (1.0) 0;0 0.6834 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 440.4759 (1.0) 440.4759 (1.0) 440.4759 (1.0) 0.0000 (1.0) 440.4759 (1.0) 0.0000 (1.0) 0;0 2.2703 (1.0) 1 1
test_sharing-push-noop[3.10.0] 441.2819 (1.00) 441.2819 (1.00) 441.2819 (1.00) 0.0000 (1.0) 441.2819 (1.00) 0.0000 (1.0) 0;0 2.2661 (1.00) 1 1
test_sharing-push-noop[main] 807.7762 (1.83) 807.7762 (1.83) 807.7762 (1.83) 0.0000 (1.0) 807.7762 (1.83) 0.0000 (1.0) 0;0 1.2380 (0.55) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.1955 (1.02) 1.1955 (1.02) 1.1955 (1.02) 0.0000 (1.0) 1.1955 (1.02) 0.0000 (1.0) 0;0 0.8365 (0.98) 1 1
test_status-status[3.10.0] 1.2088 (1.03) 1.2088 (1.03) 1.2088 (1.03) 0.0000 (1.0) 1.2088 (1.03) 0.0000 (1.0) 0;0 0.8272 (0.97) 1 1
test_status-status[main] 1.1751 (1.0) 1.1751 (1.0) 1.1751 (1.0) 0.0000 (1.0) 1.1751 (1.0) 0.0000 (1.0) 0;0 0.8510 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 533.3028 (1.0) 533.3028 (1.0) 533.3028 (1.0) 0.0000 (1.0) 533.3028 (1.0) 0.0000 (1.0) 0;0 1.8751 (1.0) 1 1
test_status-status-changed[3.10.0] 552.3700 (1.04) 552.3700 (1.04) 552.3700 (1.04) 0.0000 (1.0) 552.3700 (1.04) 0.0000 (1.0) 0;0 1.8104 (0.97) 1 1
test_status-status-changed[main] 539.0116 (1.01) 539.0116 (1.01) 539.0116 (1.01) 0.0000 (1.0) 539.0116 (1.01) 0.0000 (1.0) 0;0 1.8552 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 553.1870 (1.05) 553.1870 (1.05) 553.1870 (1.05) 0.0000 (1.0) 553.1870 (1.05) 0.0000 (1.0) 0;0 1.8077 (0.95) 1 1
test_status-status-changed-noop[3.10.0] 556.4281 (1.06) 556.4281 (1.06) 556.4281 (1.06) 0.0000 (1.0) 556.4281 (1.06) 0.0000 (1.0) 0;0 1.7972 (0.94) 1 1
test_status-status-changed-noop[main] 525.0573 (1.0) 525.0573 (1.0) 525.0573 (1.0) 0.0000 (1.0) 525.0573 (1.0) 0.0000 (1.0) 0;0 1.9046 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 544.9666 (1.04) 544.9666 (1.04) 544.9666 (1.04) 0.0000 (1.0) 544.9666 (1.04) 0.0000 (1.0) 0;0 1.8350 (0.96) 1 1
test_status-status-noop[3.10.0] 560.7857 (1.07) 560.7857 (1.07) 560.7857 (1.07) 0.0000 (1.0) 560.7857 (1.07) 0.0000 (1.0) 0;0 1.7832 (0.93) 1 1
test_status-status-noop[main] 523.0696 (1.0) 523.0696 (1.0) 523.0696 (1.0) 0.0000 (1.0) 523.0696 (1.0) 0.0000 (1.0) 0;0 1.9118 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 7.4143 (1.46) 7.4143 (1.46) 7.4143 (1.46) 0.0000 (1.0) 7.4143 (1.46) 0.0000 (1.0) 0;0 0.1349 (0.68) 1 1
test_update-import-url[3.10.0] 7.5432 (1.49) 7.5432 (1.49) 7.5432 (1.49) 0.0000 (1.0) 7.5432 (1.49) 0.0000 (1.0) 0;0 0.1326 (0.67) 1 1
test_update-import-url[main] 5.0664 (1.0) 5.0664 (1.0) 5.0664 (1.0) 0.0000 (1.0) 5.0664 (1.0) 0.0000 (1.0) 0;0 0.1974 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 6.5861 (1.51) 6.5861 (1.51) 6.5861 (1.51) 0.0000 (1.0) 6.5861 (1.51) 0.0000 (1.0) 0;0 0.1518 (0.66) 1 1
test_update-update[3.10.0] 6.7311 (1.54) 6.7311 (1.54) 6.7311 (1.54) 0.0000 (1.0) 6.7311 (1.54) 0.0000 (1.0) 0;0 0.1486 (0.65) 1 1
test_update-update[main] 4.3655 (1.0) 4.3655 (1.0) 4.3655 (1.0) 0.0000 (1.0) 4.3655 (1.0) 0.0000 (1.0) 0;0 0.2291 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 958.3399 (1.0) 958.3399 (1.0) 958.3399 (1.0) 0.0000 (1.0) 958.3399 (1.0) 0.0000 (1.0) 0;0 1.0435 (1.0) 1 1
test_update-update-noop[3.10.0] 1,000.9340 (1.04) 1,000.9340 (1.04) 1,000.9340 (1.04) 0.0000 (1.0) 1,000.9340 (1.04) 0.0000 (1.0) 0;0 0.9991 (0.96) 1 1
test_update-update-noop[main] 962.4094 (1.00) 962.4094 (1.00) 962.4094 (1.00) 0.0000 (1.0) 962.4094 (1.00) 0.0000 (1.0) 0;0 1.0391 (1.00) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
dependabot[bot]
Bumps google-github-actions/auth from 2.0.0 to 2.0.1.
Release notes
Sourced from google-github-actions/auth's releases.
Commits
f6de816Release: v2.0.1 (#382)a57dd04Support newline-separated inputs for delegates and access_token_scopes (#381)fb74905Note .dockerignore in the exclusion for credentials (#376)56562ddUse new markdown syntax for alerts (#371)5f7afaaAdd service_account to WIF through SA example (#369)82c1c58Update README and CI to use latest version (#365)5e5db2bDocument that project_id might be required (#367)b372ba4Remove broken markdown links (#362)042a305Fix a small docs issue (#359)68ea0b8Trigger release on pushes to release branches (#358)Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show