github-actions[bot]
commented
5 months ago
Tue Jan 23 09:59:25 UTC 2024
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2] 3.7230 (1.07) 3.7230 (1.07) 3.7230 (1.07) 0.0000 (1.0) 3.7230 (1.07) 0.0000 (1.0) 0;0 0.2686 (0.93) 1 1
test_add-add[3.10.0] 3.7311 (1.07) 3.7311 (1.07) 3.7311 (1.07) 0.0000 (1.0) 3.7311 (1.07) 0.0000 (1.0) 0;0 0.2680 (0.93) 1 1
test_add-add[main] 3.4753 (1.0) 3.4753 (1.0) 3.4753 (1.0) 0.0000 (1.0) 3.4753 (1.0) 0.0000 (1.0) 0;0 0.2877 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 1.8589 (1.20) 1.8589 (1.20) 1.8589 (1.20) 0.0000 (1.0) 1.8589 (1.20) 0.0000 (1.0) 0;0 0.5380 (0.83) 1 1
test_checkout_copy-checkout[3.10.0] 3.7265 (2.41) 3.7265 (2.41) 3.7265 (2.41) 0.0000 (1.0) 3.7265 (2.41) 0.0000 (1.0) 0;0 0.2684 (0.41) 1 1
test_checkout_copy-checkout[main] 1.5444 (1.0) 1.5444 (1.0) 1.5444 (1.0) 0.0000 (1.0) 1.5444 (1.0) 0.0000 (1.0) 0;0 0.6475 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 546.6148 (1.00) 546.6148 (1.00) 546.6148 (1.00) 0.0000 (1.0) 546.6148 (1.00) 0.0000 (1.0) 0;0 1.8294 (1.00) 1 1
test_checkout_copy-checkout-noop[3.10.0] 562.9680 (1.03) 562.9680 (1.03) 562.9680 (1.03) 0.0000 (1.0) 562.9680 (1.03) 0.0000 (1.0) 0;0 1.7763 (0.97) 1 1
test_checkout_copy-checkout-noop[main] 546.1550 (1.0) 546.1550 (1.0) 546.1550 (1.0) 0.0000 (1.0) 546.1550 (1.0) 0.0000 (1.0) 0;0 1.8310 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 728.3327 (1.22) 728.3327 (1.22) 728.3327 (1.22) 0.0000 (1.0) 728.3327 (1.22) 0.0000 (1.0) 0;0 1.3730 (0.82) 1 1
test_checkout_copy-checkout-update[3.10.0] 620.5277 (1.04) 620.5277 (1.04) 620.5277 (1.04) 0.0000 (1.0) 620.5277 (1.04) 0.0000 (1.0) 0;0 1.6115 (0.96) 1 1
test_checkout_copy-checkout-update[main] 595.8089 (1.0) 595.8089 (1.0) 595.8089 (1.0) 0.0000 (1.0) 595.8089 (1.0) 0.0000 (1.0) 0;0 1.6784 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.2323 (1.17) 1.2323 (1.17) 1.2323 (1.17) 0.0000 (1.0) 1.2323 (1.17) 0.0000 (1.0) 0;0 0.8115 (0.86) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.0752 (1.02) 1.0752 (1.02) 1.0752 (1.02) 0.0000 (1.0) 1.0752 (1.02) 0.0000 (1.0) 0;0 0.9301 (0.98) 1 1
test_checkout_hardlink-checkout[main] 1.0575 (1.0) 1.0575 (1.0) 1.0575 (1.0) 0.0000 (1.0) 1.0575 (1.0) 0.0000 (1.0) 0;0 0.9456 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 562.7865 (1.03) 562.7865 (1.03) 562.7865 (1.03) 0.0000 (1.0) 562.7865 (1.03) 0.0000 (1.0) 0;0 1.7769 (0.98) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 577.0894 (1.05) 577.0894 (1.05) 577.0894 (1.05) 0.0000 (1.0) 577.0894 (1.05) 0.0000 (1.0) 0;0 1.7328 (0.95) 1 1
test_checkout_hardlink-checkout-noop[main] 548.9688 (1.0) 548.9688 (1.0) 548.9688 (1.0) 0.0000 (1.0) 548.9688 (1.0) 0.0000 (1.0) 0;0 1.8216 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 702.6491 (1.13) 702.6491 (1.13) 702.6491 (1.13) 0.0000 (1.0) 702.6491 (1.13) 0.0000 (1.0) 0;0 1.4232 (0.88) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 633.2145 (1.02) 633.2145 (1.02) 633.2145 (1.02) 0.0000 (1.0) 633.2145 (1.02) 0.0000 (1.0) 0;0 1.5792 (0.98) 1 1
test_checkout_hardlink-checkout-update[main] 619.4027 (1.0) 619.4027 (1.0) 619.4027 (1.0) 0.0000 (1.0) 619.4027 (1.0) 0.0000 (1.0) 0;0 1.6145 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.2905 (1.15) 1.2905 (1.15) 1.2905 (1.15) 0.0000 (1.0) 1.2905 (1.15) 0.0000 (1.0) 0;0 0.7749 (0.87) 1 1
test_checkout_symlink-checkout[3.10.0] 1.1830 (1.05) 1.1830 (1.05) 1.1830 (1.05) 0.0000 (1.0) 1.1830 (1.05) 0.0000 (1.0) 0;0 0.8453 (0.95) 1 1
test_checkout_symlink-checkout[main] 1.1220 (1.0) 1.1220 (1.0) 1.1220 (1.0) 0.0000 (1.0) 1.1220 (1.0) 0.0000 (1.0) 0;0 0.8912 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 581.0611 (1.00) 581.0611 (1.00) 581.0611 (1.00) 0.0000 (1.0) 581.0611 (1.00) 0.0000 (1.0) 0;0 1.7210 (1.00) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 606.9302 (1.05) 606.9302 (1.05) 606.9302 (1.05) 0.0000 (1.0) 606.9302 (1.05) 0.0000 (1.0) 0;0 1.6476 (0.96) 1 1
test_checkout_symlink-checkout-noop[main] 580.2538 (1.0) 580.2538 (1.0) 580.2538 (1.0) 0.0000 (1.0) 580.2538 (1.0) 0.0000 (1.0) 0;0 1.7234 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 752.7002 (1.13) 752.7002 (1.13) 752.7002 (1.13) 0.0000 (1.0) 752.7002 (1.13) 0.0000 (1.0) 0;0 1.3286 (0.88) 1 1
test_checkout_symlink-checkout-update[3.10.0] 688.8893 (1.04) 688.8893 (1.04) 688.8893 (1.04) 0.0000 (1.0) 688.8893 (1.04) 0.0000 (1.0) 0;0 1.4516 (0.96) 1 1
test_checkout_symlink-checkout-update[main] 664.5484 (1.0) 664.5484 (1.0) 664.5484 (1.0) 0.0000 (1.0) 664.5484 (1.0) 0.0000 (1.0) 0;0 1.5048 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 622.4245 (1.06) 622.4245 (1.06) 622.4245 (1.06) 0.0000 (1.0) 622.4245 (1.06) 0.0000 (1.0) 0;0 1.6066 (0.95) 1 1
test_data_status-data-changed[3.10.0] 597.8011 (1.01) 597.8011 (1.01) 597.8011 (1.01) 0.0000 (1.0) 597.8011 (1.01) 0.0000 (1.0) 0;0 1.6728 (0.99) 1 1
test_data_status-data-changed[main] 589.4553 (1.0) 589.4553 (1.0) 589.4553 (1.0) 0.0000 (1.0) 589.4553 (1.0) 0.0000 (1.0) 0;0 1.6965 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 629.7470 (1.08) 629.7470 (1.08) 629.7470 (1.08) 0.0000 (1.0) 629.7470 (1.08) 0.0000 (1.0) 0;0 1.5879 (0.93) 1 1
test_data_status-data-changed-noop[3.10.0] 601.1915 (1.03) 601.1915 (1.03) 601.1915 (1.03) 0.0000 (1.0) 601.1915 (1.03) 0.0000 (1.0) 0;0 1.6634 (0.97) 1 1
test_data_status-data-changed-noop[main] 584.6460 (1.0) 584.6460 (1.0) 584.6460 (1.0) 0.0000 (1.0) 584.6460 (1.0) 0.0000 (1.0) 0;0 1.7104 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.2769 (1.03) 1.2769 (1.03) 1.2769 (1.03) 0.0000 (1.0) 1.2769 (1.03) 0.0000 (1.0) 0;0 0.7832 (0.97) 1 1
test_data_status-data-new[3.10.0] 1.2557 (1.01) 1.2557 (1.01) 1.2557 (1.01) 0.0000 (1.0) 1.2557 (1.01) 0.0000 (1.0) 0;0 0.7963 (0.99) 1 1
test_data_status-data-new[main] 1.2427 (1.0) 1.2427 (1.0) 1.2427 (1.0) 0.0000 (1.0) 1.2427 (1.0) 0.0000 (1.0) 0;0 0.8047 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 626.7070 (1.08) 626.7070 (1.08) 626.7070 (1.08) 0.0000 (1.0) 626.7070 (1.08) 0.0000 (1.0) 0;0 1.5956 (0.93) 1 1
test_data_status-data-noop[3.10.0] 594.7223 (1.02) 594.7223 (1.02) 594.7223 (1.02) 0.0000 (1.0) 594.7223 (1.02) 0.0000 (1.0) 0;0 1.6815 (0.98) 1 1
test_data_status-data-noop[main] 582.1615 (1.0) 582.1615 (1.0) 582.1615 (1.0) 0.0000 (1.0) 582.1615 (1.0) 0.0000 (1.0) 0;0 1.7177 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.0065 (1.02) 1.0065 (1.02) 1.0065 (1.02) 0.0000 (1.0) 1.0065 (1.02) 0.0000 (1.0) 0;0 0.9935 (0.98) 1 1
test_data_status_all_flags-data-changed[3.10.0] 0.9950 (1.01) 0.9950 (1.01) 0.9950 (1.01) 0.0000 (1.0) 0.9950 (1.01) 0.0000 (1.0) 0;0 1.0050 (0.99) 1 1
test_data_status_all_flags-data-changed[main] 0.9827 (1.0) 0.9827 (1.0) 0.9827 (1.0) 0.0000 (1.0) 0.9827 (1.0) 0.0000 (1.0) 0;0 1.0176 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.0034 (1.01) 1.0034 (1.01) 1.0034 (1.01) 0.0000 (1.0) 1.0034 (1.01) 0.0000 (1.0) 0;0 0.9966 (0.99) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 0.9957 (1.00) 0.9957 (1.00) 0.9957 (1.00) 0.0000 (1.0) 0.9957 (1.00) 0.0000 (1.0) 0;0 1.0043 (1.00) 1 1
test_data_status_all_flags-data-changed-noop[main] 0.9909 (1.0) 0.9909 (1.0) 0.9909 (1.0) 0.0000 (1.0) 0.9909 (1.0) 0.0000 (1.0) 0;0 1.0092 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 1.6851 (1.03) 1.6851 (1.03) 1.6851 (1.03) 0.0000 (1.0) 1.6851 (1.03) 0.0000 (1.0) 0;0 0.5934 (0.97) 1 1
test_data_status_all_flags-data-new[3.10.0] 1.6660 (1.02) 1.6660 (1.02) 1.6660 (1.02) 0.0000 (1.0) 1.6660 (1.02) 0.0000 (1.0) 0;0 0.6002 (0.98) 1 1
test_data_status_all_flags-data-new[main] 1.6376 (1.0) 1.6376 (1.0) 1.6376 (1.0) 0.0000 (1.0) 1.6376 (1.0) 0.0000 (1.0) 0;0 0.6107 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 971.7501 (1.0) 971.7501 (1.0) 971.7501 (1.0) 0.0000 (1.0) 971.7501 (1.0) 0.0000 (1.0) 0;0 1.0291 (1.0) 1 1
test_data_status_all_flags-data-noop[3.10.0] 979.6744 (1.01) 979.6744 (1.01) 979.6744 (1.01) 0.0000 (1.0) 979.6744 (1.01) 0.0000 (1.0) 0;0 1.0207 (0.99) 1 1
test_data_status_all_flags-data-noop[main] 974.1762 (1.00) 974.1762 (1.00) 974.1762 (1.00) 0.0000 (1.0) 974.1762 (1.00) 0.0000 (1.0) 0;0 1.0265 (1.00) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.2113 (1.0) 1.2113 (1.0) 1.2113 (1.0) 0.0000 (1.0) 1.2113 (1.0) 0.0000 (1.0) 0;0 0.8256 (1.0) 1 1
test_diff-diff[3.10.0] 1.2458 (1.03) 1.2458 (1.03) 1.2458 (1.03) 0.0000 (1.0) 1.2458 (1.03) 0.0000 (1.0) 0;0 0.8027 (0.97) 1 1
test_diff-diff[main] 1.2647 (1.04) 1.2647 (1.04) 1.2647 (1.04) 0.0000 (1.0) 1.2647 (1.04) 0.0000 (1.0) 0;0 0.7907 (0.96) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 644.2576 (1.06) 644.2576 (1.06) 644.2576 (1.06) 0.0000 (1.0) 644.2576 (1.06) 0.0000 (1.0) 0;0 1.5522 (0.95) 1 1
test_diff-diff-changed[3.10.0] 663.1264 (1.09) 663.1264 (1.09) 663.1264 (1.09) 0.0000 (1.0) 663.1264 (1.09) 0.0000 (1.0) 0;0 1.5080 (0.92) 1 1
test_diff-diff-changed[main] 609.3036 (1.0) 609.3036 (1.0) 609.3036 (1.0) 0.0000 (1.0) 609.3036 (1.0) 0.0000 (1.0) 0;0 1.6412 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 610.8238 (1.01) 610.8238 (1.01) 610.8238 (1.01) 0.0000 (1.0) 610.8238 (1.01) 0.0000 (1.0) 0;0 1.6371 (0.99) 1 1
test_diff-diff-changed-noop[3.10.0] 630.9786 (1.04) 630.9786 (1.04) 630.9786 (1.04) 0.0000 (1.0) 630.9786 (1.04) 0.0000 (1.0) 0;0 1.5848 (0.96) 1 1
test_diff-diff-changed-noop[main] 605.1908 (1.0) 605.1908 (1.0) 605.1908 (1.0) 0.0000 (1.0) 605.1908 (1.0) 0.0000 (1.0) 0;0 1.6524 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 590.7917 (1.0) 590.7917 (1.0) 590.7917 (1.0) 0.0000 (1.0) 590.7917 (1.0) 0.0000 (1.0) 0;0 1.6926 (1.0) 1 1
test_diff-diff-noop[3.10.0] 611.7497 (1.04) 611.7497 (1.04) 611.7497 (1.04) 0.0000 (1.0) 611.7497 (1.04) 0.0000 (1.0) 0;0 1.6347 (0.97) 1 1
test_diff-diff-noop[main] 603.8338 (1.02) 603.8338 (1.02) 603.8338 (1.02) 0.0000 (1.0) 603.8338 (1.02) 0.0000 (1.0) 0;0 1.6561 (0.98) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 853.9977 (1.0) 853.9977 (1.0) 853.9977 (1.0) 0.0000 (1.0) 853.9977 (1.0) 0.0000 (1.0) 0;0 1.1710 (1.0) 1 1
test_exp_show-exp[3.10.0] 14,970.3780 (17.53) 14,970.3780 (17.53) 14,970.3780 (17.53) 0.0000 (1.0) 14,970.3780 (17.53) 0.0000 (1.0) 0;0 0.0668 (0.06) 1 1
test_exp_show-exp[main] 12,391.9792 (14.51) 12,391.9792 (14.51) 12,391.9792 (14.51) 0.0000 (1.0) 12,391.9792 (14.51) 0.0000 (1.0) 0;0 0.0807 (0.07) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 3.8631 (2.07) 3.8631 (2.07) 3.8631 (2.07) 0.0000 (1.0) 3.8631 (2.07) 0.0000 (1.0) 0;0 0.2589 (0.48) 1 1
test_fetch-fetch[3.10.0] 4.2498 (2.27) 4.2498 (2.27) 4.2498 (2.27) 0.0000 (1.0) 4.2498 (2.27) 0.0000 (1.0) 0;0 0.2353 (0.44) 1 1
test_fetch-fetch[main] 1.8704 (1.0) 1.8704 (1.0) 1.8704 (1.0) 0.0000 (1.0) 1.8704 (1.0) 0.0000 (1.0) 0;0 0.5346 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 502.0669 (1.07) 502.0669 (1.07) 502.0669 (1.07) 0.0000 (1.0) 502.0669 (1.07) 0.0000 (1.0) 0;0 1.9918 (0.93) 1 1
test_gc-gc[3.10.0] 497.9127 (1.06) 497.9127 (1.06) 497.9127 (1.06) 0.0000 (1.0) 497.9127 (1.06) 0.0000 (1.0) 0;0 2.0084 (0.94) 1 1
test_gc-gc[main] 469.2975 (1.0) 469.2975 (1.0) 469.2975 (1.0) 0.0000 (1.0) 469.2975 (1.0) 0.0000 (1.0) 0;0 2.1308 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 6.0184 (1.13) 6.0184 (1.13) 6.0184 (1.13) 0.0000 (1.0) 6.0184 (1.13) 0.0000 (1.0) 0;0 0.1662 (0.89) 1 1
test_get-get[3.10.0] 7.0610 (1.32) 7.0610 (1.32) 7.0610 (1.32) 0.0000 (1.0) 7.0610 (1.32) 0.0000 (1.0) 0;0 0.1416 (0.76) 1 1
test_get-get[main] 5.3385 (1.0) 5.3385 (1.0) 5.3385 (1.0) 0.0000 (1.0) 5.3385 (1.0) 0.0000 (1.0) 0;0 0.1873 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 3.0446 (3.28) 3.0446 (3.28) 3.0446 (3.28) 0.0000 (1.0) 3.0446 (3.28) 0.0000 (1.0) 0;0 0.3285 (0.31) 1 1
test_get_url-get-url[3.10.0] 3.1870 (3.43) 3.1870 (3.43) 3.1870 (3.43) 0.0000 (1.0) 3.1870 (3.43) 0.0000 (1.0) 0;0 0.3138 (0.29) 1 1
test_get_url-get-url[main] 0.9290 (1.0) 0.9290 (1.0) 0.9290 (1.0) 0.0000 (1.0) 0.9290 (1.0) 0.0000 (1.0) 0;0 1.0764 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 125.3239 (1.02) 130.3853 (1.01) 126.8933 (1.02) 1.0535 (1.21) 126.6334 (1.02) 1.4373 (1.55) 29;3 7.8806 (0.98) 100 1
test_help---help[3.10.0] 122.8195 (1.0) 128.9995 (1.0) 124.3352 (1.0) 0.8706 (1.0) 124.1911 (1.0) 0.9292 (1.0) 21;3 8.0428 (1.0) 100 1
test_help---help[main] 123.7960 (1.01) 137.8356 (1.07) 128.1251 (1.03) 2.4030 (2.76) 127.6913 (1.03) 3.3830 (3.64) 31;1 7.8049 (0.97) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 9.2690 (1.08) 9.2690 (1.08) 9.2690 (1.08) 0.0000 (1.0) 9.2690 (1.08) 0.0000 (1.0) 0;0 0.1079 (0.93) 1 1
test_import-import[3.10.0] 10.5421 (1.22) 10.5421 (1.22) 10.5421 (1.22) 0.0000 (1.0) 10.5421 (1.22) 0.0000 (1.0) 0;0 0.0949 (0.82) 1 1
test_import-import[main] 8.6060 (1.0) 8.6060 (1.0) 8.6060 (1.0) 0.0000 (1.0) 8.6060 (1.0) 0.0000 (1.0) 0;0 0.1162 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 7.4454 (1.49) 7.4454 (1.49) 7.4454 (1.49) 0.0000 (1.0) 7.4454 (1.49) 0.0000 (1.0) 0;0 0.1343 (0.67) 1 1
test_import_url-import-url[3.10.0] 7.6732 (1.53) 7.6732 (1.53) 7.6732 (1.53) 0.0000 (1.0) 7.6732 (1.53) 0.0000 (1.0) 0;0 0.1303 (0.65) 1 1
test_import_url-import-url[main] 5.0064 (1.0) 5.0064 (1.0) 5.0064 (1.0) 0.0000 (1.0) 5.0064 (1.0) 0.0000 (1.0) 0;0 0.1997 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 374.5503 (1.0) 427.8006 (1.03) 387.9966 (1.0) 8.2700 (1.61) 385.1950 (1.0) 10.1731 (1.91) 27;1 2.5773 (1.0) 100 1
test_init-init[3.10.0] 385.0279 (1.03) 448.1875 (1.08) 395.2632 (1.02) 7.5049 (1.46) 393.5633 (1.02) 6.0655 (1.14) 12;4 2.5300 (0.98) 100 1
test_init-init[main] 380.3347 (1.02) 415.2660 (1.0) 389.9456 (1.01) 5.1404 (1.0) 388.8730 (1.01) 5.3171 (1.0) 23;4 2.5645 (1.00) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 425.1910 (1.08) 425.1910 (1.08) 425.1910 (1.08) 0.0000 (1.0) 425.1910 (1.08) 0.0000 (1.0) 0;0 2.3519 (0.92) 1 1
test_list-list[3.10.0] 413.8986 (1.05) 413.8986 (1.05) 413.8986 (1.05) 0.0000 (1.0) 413.8986 (1.05) 0.0000 (1.0) 0;0 2.4161 (0.95) 1 1
test_list-list[main] 393.0225 (1.0) 393.0225 (1.0) 393.0225 (1.0) 0.0000 (1.0) 393.0225 (1.0) 0.0000 (1.0) 0;0 2.5444 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 394.1857 (1.05) 394.1857 (1.05) 394.1857 (1.05) 0.0000 (1.0) 394.1857 (1.05) 0.0000 (1.0) 0;0 2.5369 (0.95) 1 1
test_list-list-dvc-only[3.10.0] 398.3319 (1.07) 398.3319 (1.07) 398.3319 (1.07) 0.0000 (1.0) 398.3319 (1.07) 0.0000 (1.0) 0;0 2.5105 (0.94) 1 1
test_list-list-dvc-only[main] 373.7005 (1.0) 373.7005 (1.0) 373.7005 (1.0) 0.0000 (1.0) 373.7005 (1.0) 0.0000 (1.0) 0;0 2.6759 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 470.5460 (1.03) 470.5460 (1.03) 470.5460 (1.03) 0.0000 (1.0) 470.5460 (1.03) 0.0000 (1.0) 0;0 2.1252 (0.97) 1 1
test_list-list-recursive[3.10.0] 472.3047 (1.03) 472.3047 (1.03) 472.3047 (1.03) 0.0000 (1.0) 472.3047 (1.03) 0.0000 (1.0) 0;0 2.1173 (0.97) 1 1
test_list-list-recursive[main] 458.2262 (1.0) 458.2262 (1.0) 458.2262 (1.0) 0.0000 (1.0) 458.2262 (1.0) 0.0000 (1.0) 0;0 2.1823 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 394.0779 (1.02) 394.0779 (1.02) 394.0779 (1.02) 0.0000 (1.0) 394.0779 (1.02) 0.0000 (1.0) 0;0 2.5376 (0.98) 1 1
test_list-list-shallow[3.10.0] 385.1783 (1.0) 385.1783 (1.0) 385.1783 (1.0) 0.0000 (1.0) 385.1783 (1.0) 0.0000 (1.0) 0;0 2.5962 (1.0) 1 1
test_list-list-shallow[main] 396.9618 (1.03) 396.9618 (1.03) 396.9618 (1.03) 0.0000 (1.0) 396.9618 (1.03) 0.0000 (1.0) 0;0 2.5191 (0.97) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.0620 (1.04) 2.0620 (1.04) 2.0620 (1.04) 0.0000 (1.0) 2.0620 (1.04) 0.0000 (1.0) 0;0 0.4850 (0.96) 1 1
test_partial_add-add[3.10.0] 2.0541 (1.04) 2.0541 (1.04) 2.0541 (1.04) 0.0000 (1.0) 2.0541 (1.04) 0.0000 (1.0) 0;0 0.4868 (0.97) 1 1
test_partial_add-add[main] 1.9827 (1.0) 1.9827 (1.0) 1.9827 (1.0) 0.0000 (1.0) 1.9827 (1.0) 0.0000 (1.0) 0;0 0.5044 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 3.0498 (1.06) 3.0498 (1.06) 3.0498 (1.06) 0.0000 (1.0) 3.0498 (1.06) 0.0000 (1.0) 0;0 0.3279 (0.95) 1 1
test_partial_add-add-partial[3.10.0] 3.0428 (1.05) 3.0428 (1.05) 3.0428 (1.05) 0.0000 (1.0) 3.0428 (1.05) 0.0000 (1.0) 0;0 0.3286 (0.95) 1 1
test_partial_add-add-partial[main] 2.8881 (1.0) 2.8881 (1.0) 2.8881 (1.0) 0.0000 (1.0) 2.8881 (1.0) 0.0000 (1.0) 0;0 0.3463 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 594.2416 (1.0) 594.2416 (1.0) 594.2416 (1.0) 0.0000 (1.0) 594.2416 (1.0) 0.0000 (1.0) 0;0 1.6828 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 642.5579 (1.08) 642.5579 (1.08) 642.5579 (1.08) 0.0000 (1.0) 642.5579 (1.08) 0.0000 (1.0) 0;0 1.5563 (0.92) 1 1
test_partial_add-gc-cloud-noop[main] 678.0740 (1.14) 678.0740 (1.14) 678.0740 (1.14) 0.0000 (1.0) 678.0740 (1.14) 0.0000 (1.0) 0;0 1.4748 (0.88) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 483.2717 (1.0) 483.2717 (1.0) 483.2717 (1.0) 0.0000 (1.0) 483.2717 (1.0) 0.0000 (1.0) 0;0 2.0692 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 565.0309 (1.17) 565.0309 (1.17) 565.0309 (1.17) 0.0000 (1.0) 565.0309 (1.17) 0.0000 (1.0) 0;0 1.7698 (0.86) 1 1
test_partial_add-gc-noop[main] 545.2156 (1.13) 545.2156 (1.13) 545.2156 (1.13) 0.0000 (1.0) 545.2156 (1.13) 0.0000 (1.0) 0;0 1.8341 (0.89) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 1.9232 (1.83) 1.9232 (1.83) 1.9232 (1.83) 0.0000 (1.0) 1.9232 (1.83) 0.0000 (1.0) 0;0 0.5200 (0.55) 1 1
test_partial_add-push[3.10.0] 1.1632 (1.11) 1.1632 (1.11) 1.1632 (1.11) 0.0000 (1.0) 1.1632 (1.11) 0.0000 (1.0) 0;0 0.8597 (0.90) 1 1
test_partial_add-push[main] 1.0487 (1.0) 1.0487 (1.0) 1.0487 (1.0) 0.0000 (1.0) 1.0487 (1.0) 0.0000 (1.0) 0;0 0.9536 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 2.0227 (1.74) 2.0227 (1.74) 2.0227 (1.74) 0.0000 (1.0) 2.0227 (1.74) 0.0000 (1.0) 0;0 0.4944 (0.57) 1 1
test_partial_add-push-partial[3.10.0] 1.2577 (1.08) 1.2577 (1.08) 1.2577 (1.08) 0.0000 (1.0) 1.2577 (1.08) 0.0000 (1.0) 0;0 0.7951 (0.92) 1 1
test_partial_add-push-partial[main] 1.1599 (1.0) 1.1599 (1.0) 1.1599 (1.0) 0.0000 (1.0) 1.1599 (1.0) 0.0000 (1.0) 0;0 0.8621 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.5780 (1.05) 3.5780 (1.05) 3.5780 (1.05) 0.0000 (1.0) 3.5780 (1.05) 0.0000 (1.0) 0;0 0.2795 (0.95) 1 1
test_partial_remove-add[3.10.0] 3.6132 (1.06) 3.6132 (1.06) 3.6132 (1.06) 0.0000 (1.0) 3.6132 (1.06) 0.0000 (1.0) 0;0 0.2768 (0.94) 1 1
test_partial_remove-add[main] 3.3997 (1.0) 3.3997 (1.0) 3.3997 (1.0) 0.0000 (1.0) 3.3997 (1.0) 0.0000 (1.0) 0;0 0.2941 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.4279 (1.00) 1.4279 (1.00) 1.4279 (1.00) 0.0000 (1.0) 1.4279 (1.00) 0.0000 (1.0) 0;0 0.7003 (1.00) 1 1
test_partial_remove-add-update[3.10.0] 1.4900 (1.04) 1.4900 (1.04) 1.4900 (1.04) 0.0000 (1.0) 1.4900 (1.04) 0.0000 (1.0) 0;0 0.6711 (0.96) 1 1
test_partial_remove-add-update[main] 1.4278 (1.0) 1.4278 (1.0) 1.4278 (1.0) 0.0000 (1.0) 1.4278 (1.0) 0.0000 (1.0) 0;0 0.7004 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 487.9490 (1.0) 487.9490 (1.0) 487.9490 (1.0) 0.0000 (1.0) 487.9490 (1.0) 0.0000 (1.0) 0;0 2.0494 (1.0) 1 1
test_partial_remove-gc[3.10.0] 549.7253 (1.13) 549.7253 (1.13) 549.7253 (1.13) 0.0000 (1.0) 549.7253 (1.13) 0.0000 (1.0) 0;0 1.8191 (0.89) 1 1
test_partial_remove-gc[main] 520.1123 (1.07) 520.1123 (1.07) 520.1123 (1.07) 0.0000 (1.0) 520.1123 (1.07) 0.0000 (1.0) 0;0 1.9227 (0.94) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 547.1001 (1.0) 547.1001 (1.0) 547.1001 (1.0) 0.0000 (1.0) 547.1001 (1.0) 0.0000 (1.0) 0;0 1.8278 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 612.6366 (1.12) 612.6366 (1.12) 612.6366 (1.12) 0.0000 (1.0) 612.6366 (1.12) 0.0000 (1.0) 0;0 1.6323 (0.89) 1 1
test_partial_remove-gc-cloud[main] 602.9775 (1.10) 602.9775 (1.10) 602.9775 (1.10) 0.0000 (1.0) 602.9775 (1.10) 0.0000 (1.0) 0;0 1.6584 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 3.3972 (2.35) 3.3972 (2.35) 3.3972 (2.35) 0.0000 (1.0) 3.3972 (2.35) 0.0000 (1.0) 0;0 0.2944 (0.43) 1 1
test_partial_remove-push[3.10.0] 1.9301 (1.33) 1.9301 (1.33) 1.9301 (1.33) 0.0000 (1.0) 1.9301 (1.33) 0.0000 (1.0) 0;0 0.5181 (0.75) 1 1
test_partial_remove-push[main] 1.4472 (1.0) 1.4472 (1.0) 1.4472 (1.0) 0.0000 (1.0) 1.4472 (1.0) 0.0000 (1.0) 0;0 0.6910 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 475.5950 (1.0) 475.5950 (1.0) 475.5950 (1.0) 0.0000 (1.0) 475.5950 (1.0) 0.0000 (1.0) 0;0 2.1026 (1.0) 1 1
test_partial_remove-push-update[3.10.0] 483.0323 (1.02) 483.0323 (1.02) 483.0323 (1.02) 0.0000 (1.0) 483.0323 (1.02) 0.0000 (1.0) 0;0 2.0703 (0.98) 1 1
test_partial_remove-push-update[main] 762.3694 (1.60) 762.3694 (1.60) 762.3694 (1.60) 0.0000 (1.0) 762.3694 (1.60) 0.0000 (1.0) 0;0 1.3117 (0.62) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 416.7565 (1.0) 425.8519 (1.0) 421.6031 (1.0) 4.1719 (1.0) 422.8161 (1.0) 7.7253 (1.74) 2;0 2.3719 (1.0) 5 3
test_plots-plots-diff[3.10.0] 761.2381 (1.83) 792.7773 (1.86) 773.8887 (1.84) 12.5475 (3.01) 773.6168 (1.83) 18.2268 (4.11) 2;0 1.2922 (0.54) 5 3
test_plots-plots-diff[main] 717.0759 (1.72) 732.4816 (1.72) 721.8448 (1.71) 6.0765 (1.46) 720.0324 (1.70) 4.4316 (1.0) 1;1 1.3853 (0.58) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 427.6180 (1.0) 429.0544 (1.0) 428.4069 (1.0) 0.5573 (1.0) 428.3599 (1.0) 0.8099 (1.0) 2;0 2.3342 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,033.4206 (2.42) 1,060.6544 (2.47) 1,046.1837 (2.44) 10.1510 (18.22) 1,046.3380 (2.44) 13.3568 (16.49) 2;0 0.9559 (0.41) 5 3
test_plots-plots-diff-json[main] 799.0795 (1.87) 804.5392 (1.88) 800.7779 (1.87) 2.3273 (4.18) 799.6714 (1.87) 3.1870 (3.94) 1;0 1.2488 (0.53) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 383.0260 (1.0) 386.7087 (1.0) 384.1662 (1.0) 1.4996 (1.0) 383.4682 (1.0) 1.6671 (1.0) 1;0 2.6030 (1.0) 5 3
test_plots-plots-show[3.10.0] 641.1370 (1.67) 672.5957 (1.74) 659.4149 (1.72) 14.1336 (9.43) 666.7916 (1.74) 24.0966 (14.45) 1;0 1.5165 (0.58) 5 3
test_plots-plots-show[main] 616.0532 (1.61) 654.4747 (1.69) 626.8360 (1.63) 15.6647 (10.45) 621.8351 (1.62) 12.2214 (7.33) 1;1 1.5953 (0.61) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 402.6661 (1.0) 410.6222 (1.0) 406.7995 (1.0) 2.8865 (1.07) 406.9458 (1.0) 3.3284 (1.0) 2;0 2.4582 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 781.6253 (1.94) 792.6769 (1.93) 785.6932 (1.93) 4.2139 (1.56) 784.1111 (1.93) 4.3771 (1.32) 1;0 1.2728 (0.52) 5 3
test_plots-plots-show-json[main] 657.4006 (1.63) 664.1341 (1.62) 660.1839 (1.62) 2.7020 (1.0) 659.4040 (1.62) 4.0947 (1.23) 2;0 1.5147 (0.62) 5 3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 3.4103 (2.42) 3.4103 (2.42) 3.4103 (2.42) 0.0000 (1.0) 3.4103 (2.42) 0.0000 (1.0) 0;0 0.2932 (0.41) 1 1
test_push-push[3.10.0] 1.8959 (1.35) 1.8959 (1.35) 1.8959 (1.35) 0.0000 (1.0) 1.8959 (1.35) 0.0000 (1.0) 0;0 0.5275 (0.74) 1 1
test_push-push[main] 1.4076 (1.0) 1.4076 (1.0) 1.4076 (1.0) 0.0000 (1.0) 1.4076 (1.0) 0.0000 (1.0) 0;0 0.7104 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2] 3.6267 (1.08) 3.6267 (1.08) 3.6267 (1.08) 0.0000 (1.0) 3.6267 (1.08) 0.0000 (1.0) 0;0 0.2757 (0.93) 1 1
test_sharing-add[3.10.0] 3.5196 (1.04) 3.5196 (1.04) 3.5196 (1.04) 0.0000 (1.0) 3.5196 (1.04) 0.0000 (1.0) 0;0 0.2841 (0.96) 1 1
test_sharing-add[main] 3.3722 (1.0) 3.3722 (1.0) 3.3722 (1.0) 0.0000 (1.0) 3.3722 (1.0) 0.0000 (1.0) 0;0 0.2965 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2] 2.4191 (1.07) 2.4191 (1.07) 2.4191 (1.07) 0.0000 (1.0) 2.4191 (1.07) 0.0000 (1.0) 0;0 0.4134 (0.93) 1 1
test_sharing-add-noop[3.10.0] 2.4715 (1.09) 2.4715 (1.09) 2.4715 (1.09) 0.0000 (1.0) 2.4715 (1.09) 0.0000 (1.0) 0;0 0.4046 (0.91) 1 1
test_sharing-add-noop[main] 2.2600 (1.0) 2.2600 (1.0) 2.2600 (1.0) 0.0000 (1.0) 2.2600 (1.0) 0.0000 (1.0) 0;0 0.4425 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2] 1.7693 (1.31) 1.7693 (1.31) 1.7693 (1.31) 0.0000 (1.0) 1.7693 (1.31) 0.0000 (1.0) 0;0 0.5652 (0.77) 1 1
test_sharing-checkout[3.10.0] 3.6866 (2.72) 3.6866 (2.72) 3.6866 (2.72) 0.0000 (1.0) 3.6866 (2.72) 0.0000 (1.0) 0;0 0.2713 (0.37) 1 1
test_sharing-checkout[main] 1.3548 (1.0) 1.3548 (1.0) 1.3548 (1.0) 0.0000 (1.0) 1.3548 (1.0) 0.0000 (1.0) 0;0 0.7381 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2] 555.2774 (1.02) 555.2774 (1.02) 555.2774 (1.02) 0.0000 (1.0) 555.2774 (1.02) 0.0000 (1.0) 0;0 1.8009 (0.98) 1 1
test_sharing-checkout-noop[3.10.0] 572.7413 (1.05) 572.7413 (1.05) 572.7413 (1.05) 0.0000 (1.0) 572.7413 (1.05) 0.0000 (1.0) 0;0 1.7460 (0.95) 1 1
test_sharing-checkout-noop[main] 546.1688 (1.0) 546.1688 (1.0) 546.1688 (1.0) 0.0000 (1.0) 546.1688 (1.0) 0.0000 (1.0) 0;0 1.8309 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 3.8579 (2.03) 3.8579 (2.03) 3.8579 (2.03) 0.0000 (1.0) 3.8579 (2.03) 0.0000 (1.0) 0;0 0.2592 (0.49) 1 1
test_sharing-fetch[3.10.0] 4.3120 (2.27) 4.3120 (2.27) 4.3120 (2.27) 0.0000 (1.0) 4.3120 (2.27) 0.0000 (1.0) 0;0 0.2319 (0.44) 1 1
test_sharing-fetch[main] 1.8985 (1.0) 1.8985 (1.0) 1.8985 (1.0) 0.0000 (1.0) 1.8985 (1.0) 0.0000 (1.0) 0;0 0.5267 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 420.8450 (1.0) 420.8450 (1.0) 420.8450 (1.0) 0.0000 (1.0) 420.8450 (1.0) 0.0000 (1.0) 0;0 2.3762 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 499.0717 (1.19) 499.0717 (1.19) 499.0717 (1.19) 0.0000 (1.0) 499.0717 (1.19) 0.0000 (1.0) 0;0 2.0037 (0.84) 1 1
test_sharing-fetch-noop[main] 857.7824 (2.04) 857.7824 (2.04) 857.7824 (2.04) 0.0000 (1.0) 857.7824 (2.04) 0.0000 (1.0) 0;0 1.1658 (0.49) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 3.5079 (2.50) 3.5079 (2.50) 3.5079 (2.50) 0.0000 (1.0) 3.5079 (2.50) 0.0000 (1.0) 0;0 0.2851 (0.40) 1 1
test_sharing-push[3.10.0] 1.8868 (1.35) 1.8868 (1.35) 1.8868 (1.35) 0.0000 (1.0) 1.8868 (1.35) 0.0000 (1.0) 0;0 0.5300 (0.74) 1 1
test_sharing-push[main] 1.4007 (1.0) 1.4007 (1.0) 1.4007 (1.0) 0.0000 (1.0) 1.4007 (1.0) 0.0000 (1.0) 0;0 0.7139 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 449.6688 (1.03) 449.6688 (1.03) 449.6688 (1.03) 0.0000 (1.0) 449.6688 (1.03) 0.0000 (1.0) 0;0 2.2239 (0.97) 1 1
test_sharing-push-noop[3.10.0] 434.4827 (1.0) 434.4827 (1.0) 434.4827 (1.0) 0.0000 (1.0) 434.4827 (1.0) 0.0000 (1.0) 0;0 2.3016 (1.0) 1 1
test_sharing-push-noop[main] 819.6886 (1.89) 819.6886 (1.89) 819.6886 (1.89) 0.0000 (1.0) 819.6886 (1.89) 0.0000 (1.0) 0;0 1.2200 (0.53) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.2578 (1.04) 1.2578 (1.04) 1.2578 (1.04) 0.0000 (1.0) 1.2578 (1.04) 0.0000 (1.0) 0;0 0.7950 (0.96) 1 1
test_status-status[3.10.0] 1.2799 (1.06) 1.2799 (1.06) 1.2799 (1.06) 0.0000 (1.0) 1.2799 (1.06) 0.0000 (1.0) 0;0 0.7813 (0.94) 1 1
test_status-status[main] 1.2068 (1.0) 1.2068 (1.0) 1.2068 (1.0) 0.0000 (1.0) 1.2068 (1.0) 0.0000 (1.0) 0;0 0.8286 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 545.3581 (1.00) 545.3581 (1.00) 545.3581 (1.00) 0.0000 (1.0) 545.3581 (1.00) 0.0000 (1.0) 0;0 1.8337 (1.00) 1 1
test_status-status-changed[3.10.0] 567.0261 (1.04) 567.0261 (1.04) 567.0261 (1.04) 0.0000 (1.0) 567.0261 (1.04) 0.0000 (1.0) 0;0 1.7636 (0.96) 1 1
test_status-status-changed[main] 543.7937 (1.0) 543.7937 (1.0) 543.7937 (1.0) 0.0000 (1.0) 543.7937 (1.0) 0.0000 (1.0) 0;0 1.8389 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 545.5582 (1.03) 545.5582 (1.03) 545.5582 (1.03) 0.0000 (1.0) 545.5582 (1.03) 0.0000 (1.0) 0;0 1.8330 (0.98) 1 1
test_status-status-changed-noop[3.10.0] 581.0059 (1.09) 581.0059 (1.09) 581.0059 (1.09) 0.0000 (1.0) 581.0059 (1.09) 0.0000 (1.0) 0;0 1.7212 (0.92) 1 1
test_status-status-changed-noop[main] 531.9281 (1.0) 531.9281 (1.0) 531.9281 (1.0) 0.0000 (1.0) 531.9281 (1.0) 0.0000 (1.0) 0;0 1.8800 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 557.8519 (1.01) 557.8519 (1.01) 557.8519 (1.01) 0.0000 (1.0) 557.8519 (1.01) 0.0000 (1.0) 0;0 1.7926 (0.99) 1 1
test_status-status-noop[3.10.0] 559.7464 (1.02) 559.7464 (1.02) 559.7464 (1.02) 0.0000 (1.0) 559.7464 (1.02) 0.0000 (1.0) 0;0 1.7865 (0.98) 1 1
test_status-status-noop[main] 550.5161 (1.0) 550.5161 (1.0) 550.5161 (1.0) 0.0000 (1.0) 550.5161 (1.0) 0.0000 (1.0) 0;0 1.8165 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 7.3356 (1.46) 7.3356 (1.46) 7.3356 (1.46) 0.0000 (1.0) 7.3356 (1.46) 0.0000 (1.0) 0;0 0.1363 (0.69) 1 1
test_update-import-url[3.10.0] 7.4532 (1.48) 7.4532 (1.48) 7.4532 (1.48) 0.0000 (1.0) 7.4532 (1.48) 0.0000 (1.0) 0;0 0.1342 (0.68) 1 1
test_update-import-url[main] 5.0340 (1.0) 5.0340 (1.0) 5.0340 (1.0) 0.0000 (1.0) 5.0340 (1.0) 0.0000 (1.0) 0;0 0.1986 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 6.5825 (1.52) 6.5825 (1.52) 6.5825 (1.52) 0.0000 (1.0) 6.5825 (1.52) 0.0000 (1.0) 0;0 0.1519 (0.66) 1 1
test_update-update[3.10.0] 6.6522 (1.54) 6.6522 (1.54) 6.6522 (1.54) 0.0000 (1.0) 6.6522 (1.54) 0.0000 (1.0) 0;0 0.1503 (0.65) 1 1
test_update-update[main] 4.3169 (1.0) 4.3169 (1.0) 4.3169 (1.0) 0.0000 (1.0) 4.3169 (1.0) 0.0000 (1.0) 0;0 0.2316 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 970.6963 (1.02) 970.6963 (1.02) 970.6963 (1.02) 0.0000 (1.0) 970.6963 (1.02) 0.0000 (1.0) 0;0 1.0302 (0.98) 1 1
test_update-update-noop[3.10.0] 1,001.9367 (1.05) 1,001.9367 (1.05) 1,001.9367 (1.05) 0.0000 (1.0) 1,001.9367 (1.05) 0.0000 (1.0) 0;0 0.9981 (0.95) 1 1
test_update-update-noop[main] 950.7010 (1.0) 950.7010 (1.0) 950.7010 (1.0) 0.0000 (1.0) 950.7010 (1.0) 0.0000 (1.0) 0;0 1.0519 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
dependabot[bot]
Bumps google-github-actions/auth from 2.0.0 to 2.1.0.
Release notes
Sourced from google-github-actions/auth's releases.
Commits
5a50e58Release: v2.1.0 (#385)aaf2e69Update deps (#384)f6de816Release: v2.0.1 (#382)a57dd04Support newline-separated inputs for delegates and access_token_scopes (#381)fb74905Note .dockerignore in the exclusion for credentials (#376)56562ddUse new markdown syntax for alerts (#371)5f7afaaAdd service_account to WIF through SA example (#369)82c1c58Update README and CI to use latest version (#365)5e5db2bDocument that project_id might be required (#367)b372ba4Remove broken markdown links (#362)Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show