github-actions[bot]
commented
8 months ago
Mon Feb 12 21:51:03 UTC 2024
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2] 3.5829 (1.01) 3.5829 (1.01) 3.5829 (1.01) 0.0000 (1.0) 3.5829 (1.01) 0.0000 (1.0) 0;0 0.2791 (0.99) 1 1
test_add-add[3.10.0] 3.5481 (1.0) 3.5481 (1.0) 3.5481 (1.0) 0.0000 (1.0) 3.5481 (1.0) 0.0000 (1.0) 0;0 0.2818 (1.0) 1 1
test_add-add[main] 4.1037 (1.16) 4.1037 (1.16) 4.1037 (1.16) 0.0000 (1.0) 4.1037 (1.16) 0.0000 (1.0) 0;0 0.2437 (0.86) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 1.8414 (1.19) 1.8414 (1.19) 1.8414 (1.19) 0.0000 (1.0) 1.8414 (1.19) 0.0000 (1.0) 0;0 0.5431 (0.84) 1 1
test_checkout_copy-checkout[3.10.0] 3.7955 (2.44) 3.7955 (2.44) 3.7955 (2.44) 0.0000 (1.0) 3.7955 (2.44) 0.0000 (1.0) 0;0 0.2635 (0.41) 1 1
test_checkout_copy-checkout[main] 1.5532 (1.0) 1.5532 (1.0) 1.5532 (1.0) 0.0000 (1.0) 1.5532 (1.0) 0.0000 (1.0) 0;0 0.6438 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 545.5791 (1.0) 545.5791 (1.0) 545.5791 (1.0) 0.0000 (1.0) 545.5791 (1.0) 0.0000 (1.0) 0;0 1.8329 (1.0) 1 1
test_checkout_copy-checkout-noop[3.10.0] 585.7238 (1.07) 585.7238 (1.07) 585.7238 (1.07) 0.0000 (1.0) 585.7238 (1.07) 0.0000 (1.0) 0;0 1.7073 (0.93) 1 1
test_checkout_copy-checkout-noop[main] 548.5564 (1.01) 548.5564 (1.01) 548.5564 (1.01) 0.0000 (1.0) 548.5564 (1.01) 0.0000 (1.0) 0;0 1.8230 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 657.5363 (1.10) 657.5363 (1.10) 657.5363 (1.10) 0.0000 (1.0) 657.5363 (1.10) 0.0000 (1.0) 0;0 1.5208 (0.91) 1 1
test_checkout_copy-checkout-update[3.10.0] 615.6536 (1.03) 615.6536 (1.03) 615.6536 (1.03) 0.0000 (1.0) 615.6536 (1.03) 0.0000 (1.0) 0;0 1.6243 (0.97) 1 1
test_checkout_copy-checkout-update[main] 599.5349 (1.0) 599.5349 (1.0) 599.5349 (1.0) 0.0000 (1.0) 599.5349 (1.0) 0.0000 (1.0) 0;0 1.6680 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.2122 (1.14) 1.2122 (1.14) 1.2122 (1.14) 0.0000 (1.0) 1.2122 (1.14) 0.0000 (1.0) 0;0 0.8249 (0.88) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.0899 (1.03) 1.0899 (1.03) 1.0899 (1.03) 0.0000 (1.0) 1.0899 (1.03) 0.0000 (1.0) 0;0 0.9175 (0.98) 1 1
test_checkout_hardlink-checkout[main] 1.0629 (1.0) 1.0629 (1.0) 1.0629 (1.0) 0.0000 (1.0) 1.0629 (1.0) 0.0000 (1.0) 0;0 0.9408 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 552.5763 (1.01) 552.5763 (1.01) 552.5763 (1.01) 0.0000 (1.0) 552.5763 (1.01) 0.0000 (1.0) 0;0 1.8097 (0.99) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 573.2843 (1.05) 573.2843 (1.05) 573.2843 (1.05) 0.0000 (1.0) 573.2843 (1.05) 0.0000 (1.0) 0;0 1.7443 (0.95) 1 1
test_checkout_hardlink-checkout-noop[main] 545.5986 (1.0) 545.5986 (1.0) 545.5986 (1.0) 0.0000 (1.0) 545.5986 (1.0) 0.0000 (1.0) 0;0 1.8328 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 709.6109 (1.17) 709.6109 (1.17) 709.6109 (1.17) 0.0000 (1.0) 709.6109 (1.17) 0.0000 (1.0) 0;0 1.4092 (0.85) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 629.4488 (1.04) 629.4488 (1.04) 629.4488 (1.04) 0.0000 (1.0) 629.4488 (1.04) 0.0000 (1.0) 0;0 1.5887 (0.96) 1 1
test_checkout_hardlink-checkout-update[main] 603.9626 (1.0) 603.9626 (1.0) 603.9626 (1.0) 0.0000 (1.0) 603.9626 (1.0) 0.0000 (1.0) 0;0 1.6557 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.3193 (1.13) 1.3193 (1.13) 1.3193 (1.13) 0.0000 (1.0) 1.3193 (1.13) 0.0000 (1.0) 0;0 0.7580 (0.89) 1 1
test_checkout_symlink-checkout[3.10.0] 1.2318 (1.05) 1.2318 (1.05) 1.2318 (1.05) 0.0000 (1.0) 1.2318 (1.05) 0.0000 (1.0) 0;0 0.8118 (0.95) 1 1
test_checkout_symlink-checkout[main] 1.1687 (1.0) 1.1687 (1.0) 1.1687 (1.0) 0.0000 (1.0) 1.1687 (1.0) 0.0000 (1.0) 0;0 0.8556 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 598.5272 (1.02) 598.5272 (1.02) 598.5272 (1.02) 0.0000 (1.0) 598.5272 (1.02) 0.0000 (1.0) 0;0 1.6708 (0.98) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 631.4271 (1.07) 631.4271 (1.07) 631.4271 (1.07) 0.0000 (1.0) 631.4271 (1.07) 0.0000 (1.0) 0;0 1.5837 (0.93) 1 1
test_checkout_symlink-checkout-noop[main] 589.0978 (1.0) 589.0978 (1.0) 589.0978 (1.0) 0.0000 (1.0) 589.0978 (1.0) 0.0000 (1.0) 0;0 1.6975 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 779.5558 (1.13) 779.5558 (1.13) 779.5558 (1.13) 0.0000 (1.0) 779.5558 (1.13) 0.0000 (1.0) 0;0 1.2828 (0.88) 1 1
test_checkout_symlink-checkout-update[3.10.0] 763.8498 (1.11) 763.8498 (1.11) 763.8498 (1.11) 0.0000 (1.0) 763.8498 (1.11) 0.0000 (1.0) 0;0 1.3092 (0.90) 1 1
test_checkout_symlink-checkout-update[main] 688.7092 (1.0) 688.7092 (1.0) 688.7092 (1.0) 0.0000 (1.0) 688.7092 (1.0) 0.0000 (1.0) 0;0 1.4520 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 540.9680 (1.04) 540.9680 (1.04) 540.9680 (1.04) 0.0000 (1.0) 540.9680 (1.04) 0.0000 (1.0) 0;0 1.8485 (0.96) 1 1
test_data_status-data-changed[3.10.0] 568.9957 (1.10) 568.9957 (1.10) 568.9957 (1.10) 0.0000 (1.0) 568.9957 (1.10) 0.0000 (1.0) 0;0 1.7575 (0.91) 1 1
test_data_status-data-changed[main] 518.6321 (1.0) 518.6321 (1.0) 518.6321 (1.0) 0.0000 (1.0) 518.6321 (1.0) 0.0000 (1.0) 0;0 1.9281 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 553.9132 (1.05) 553.9132 (1.05) 553.9132 (1.05) 0.0000 (1.0) 553.9132 (1.05) 0.0000 (1.0) 0;0 1.8053 (0.96) 1 1
test_data_status-data-changed-noop[3.10.0] 529.6001 (1.0) 529.6001 (1.0) 529.6001 (1.0) 0.0000 (1.0) 529.6001 (1.0) 0.0000 (1.0) 0;0 1.8882 (1.0) 1 1
test_data_status-data-changed-noop[main] 558.1454 (1.05) 558.1454 (1.05) 558.1454 (1.05) 0.0000 (1.0) 558.1454 (1.05) 0.0000 (1.0) 0;0 1.7916 (0.95) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.1625 (1.0) 1.1625 (1.0) 1.1625 (1.0) 0.0000 (1.0) 1.1625 (1.0) 0.0000 (1.0) 0;0 0.8602 (1.0) 1 1
test_data_status-data-new[3.10.0] 1.1728 (1.01) 1.1728 (1.01) 1.1728 (1.01) 0.0000 (1.0) 1.1728 (1.01) 0.0000 (1.0) 0;0 0.8527 (0.99) 1 1
test_data_status-data-new[main] 1.1778 (1.01) 1.1778 (1.01) 1.1778 (1.01) 0.0000 (1.0) 1.1778 (1.01) 0.0000 (1.0) 0;0 0.8490 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 549.4747 (1.06) 549.4747 (1.06) 549.4747 (1.06) 0.0000 (1.0) 549.4747 (1.06) 0.0000 (1.0) 0;0 1.8199 (0.94) 1 1
test_data_status-data-noop[3.10.0] 544.2737 (1.05) 544.2737 (1.05) 544.2737 (1.05) 0.0000 (1.0) 544.2737 (1.05) 0.0000 (1.0) 0;0 1.8373 (0.95) 1 1
test_data_status-data-noop[main] 518.0802 (1.0) 518.0802 (1.0) 518.0802 (1.0) 0.0000 (1.0) 518.0802 (1.0) 0.0000 (1.0) 0;0 1.9302 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.0198 (1.02) 1.0198 (1.02) 1.0198 (1.02) 0.0000 (1.0) 1.0198 (1.02) 0.0000 (1.0) 0;0 0.9806 (0.98) 1 1
test_data_status_all_flags-data-changed[3.10.0] 1.0171 (1.02) 1.0171 (1.02) 1.0171 (1.02) 0.0000 (1.0) 1.0171 (1.02) 0.0000 (1.0) 0;0 0.9832 (0.98) 1 1
test_data_status_all_flags-data-changed[main] 0.9971 (1.0) 0.9971 (1.0) 0.9971 (1.0) 0.0000 (1.0) 0.9971 (1.0) 0.0000 (1.0) 0;0 1.0030 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.0123 (1.00) 1.0123 (1.00) 1.0123 (1.00) 0.0000 (1.0) 1.0123 (1.00) 0.0000 (1.0) 0;0 0.9879 (1.00) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 1.0102 (1.0) 1.0102 (1.0) 1.0102 (1.0) 0.0000 (1.0) 1.0102 (1.0) 0.0000 (1.0) 0;0 0.9899 (1.0) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.0212 (1.01) 1.0212 (1.01) 1.0212 (1.01) 0.0000 (1.0) 1.0212 (1.01) 0.0000 (1.0) 0;0 0.9792 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 1.6707 (1.01) 1.6707 (1.01) 1.6707 (1.01) 0.0000 (1.0) 1.6707 (1.01) 0.0000 (1.0) 0;0 0.5986 (0.99) 1 1
test_data_status_all_flags-data-new[3.10.0] 1.6912 (1.03) 1.6912 (1.03) 1.6912 (1.03) 0.0000 (1.0) 1.6912 (1.03) 0.0000 (1.0) 0;0 0.5913 (0.97) 1 1
test_data_status_all_flags-data-new[main] 1.6473 (1.0) 1.6473 (1.0) 1.6473 (1.0) 0.0000 (1.0) 1.6473 (1.0) 0.0000 (1.0) 0;0 0.6070 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 974.9772 (1.0) 974.9772 (1.0) 974.9772 (1.0) 0.0000 (1.0) 974.9772 (1.0) 0.0000 (1.0) 0;0 1.0257 (1.0) 1 1
test_data_status_all_flags-data-noop[3.10.0] 981.3215 (1.01) 981.3215 (1.01) 981.3215 (1.01) 0.0000 (1.0) 981.3215 (1.01) 0.0000 (1.0) 0;0 1.0190 (0.99) 1 1
test_data_status_all_flags-data-noop[main] 975.0978 (1.00) 975.0978 (1.00) 975.0978 (1.00) 0.0000 (1.0) 975.0978 (1.00) 0.0000 (1.0) 0;0 1.0255 (1.00) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.2144 (1.0) 1.2144 (1.0) 1.2144 (1.0) 0.0000 (1.0) 1.2144 (1.0) 0.0000 (1.0) 0;0 0.8234 (1.0) 1 1
test_diff-diff[3.10.0] 1.2344 (1.02) 1.2344 (1.02) 1.2344 (1.02) 0.0000 (1.0) 1.2344 (1.02) 0.0000 (1.0) 0;0 0.8101 (0.98) 1 1
test_diff-diff[main] 1.2903 (1.06) 1.2903 (1.06) 1.2903 (1.06) 0.0000 (1.0) 1.2903 (1.06) 0.0000 (1.0) 0;0 0.7750 (0.94) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 652.2488 (1.07) 652.2488 (1.07) 652.2488 (1.07) 0.0000 (1.0) 652.2488 (1.07) 0.0000 (1.0) 0;0 1.5332 (0.94) 1 1
test_diff-diff-changed[3.10.0] 672.1109 (1.10) 672.1109 (1.10) 672.1109 (1.10) 0.0000 (1.0) 672.1109 (1.10) 0.0000 (1.0) 0;0 1.4878 (0.91) 1 1
test_diff-diff-changed[main] 611.8144 (1.0) 611.8144 (1.0) 611.8144 (1.0) 0.0000 (1.0) 611.8144 (1.0) 0.0000 (1.0) 0;0 1.6345 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 624.7268 (1.03) 624.7268 (1.03) 624.7268 (1.03) 0.0000 (1.0) 624.7268 (1.03) 0.0000 (1.0) 0;0 1.6007 (0.97) 1 1
test_diff-diff-changed-noop[3.10.0] 637.0532 (1.05) 637.0532 (1.05) 637.0532 (1.05) 0.0000 (1.0) 637.0532 (1.05) 0.0000 (1.0) 0;0 1.5697 (0.95) 1 1
test_diff-diff-changed-noop[main] 606.0835 (1.0) 606.0835 (1.0) 606.0835 (1.0) 0.0000 (1.0) 606.0835 (1.0) 0.0000 (1.0) 0;0 1.6499 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 578.6447 (1.0) 578.6447 (1.0) 578.6447 (1.0) 0.0000 (1.0) 578.6447 (1.0) 0.0000 (1.0) 0;0 1.7282 (1.0) 1 1
test_diff-diff-noop[3.10.0] 596.2547 (1.03) 596.2547 (1.03) 596.2547 (1.03) 0.0000 (1.0) 596.2547 (1.03) 0.0000 (1.0) 0;0 1.6771 (0.97) 1 1
test_diff-diff-noop[main] 609.6748 (1.05) 609.6748 (1.05) 609.6748 (1.05) 0.0000 (1.0) 609.6748 (1.05) 0.0000 (1.0) 0;0 1.6402 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests ----------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 964.3971 (1.0) 964.3971 (1.0) 964.3971 (1.0) 0.0000 (1.0) 964.3971 (1.0) 0.0000 (1.0) 0;0 1.0369 (1.0) 1 1
test_exp_show-exp[3.10.0] 14,003.1154 (14.52) 14,003.1154 (14.52) 14,003.1154 (14.52) 0.0000 (1.0) 14,003.1154 (14.52) 0.0000 (1.0) 0;0 0.0714 (0.07) 1 1
test_exp_show-exp[main] 10,651.8128 (11.05) 10,651.8128 (11.05) 10,651.8128 (11.05) 0.0000 (1.0) 10,651.8128 (11.05) 0.0000 (1.0) 0;0 0.0939 (0.09) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 3.8313 (2.05) 3.8313 (2.05) 3.8313 (2.05) 0.0000 (1.0) 3.8313 (2.05) 0.0000 (1.0) 0;0 0.2610 (0.49) 1 1
test_fetch-fetch[3.10.0] 4.3235 (2.31) 4.3235 (2.31) 4.3235 (2.31) 0.0000 (1.0) 4.3235 (2.31) 0.0000 (1.0) 0;0 0.2313 (0.43) 1 1
test_fetch-fetch[main] 1.8732 (1.0) 1.8732 (1.0) 1.8732 (1.0) 0.0000 (1.0) 1.8732 (1.0) 0.0000 (1.0) 0;0 0.5338 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 516.8523 (1.06) 516.8523 (1.06) 516.8523 (1.06) 0.0000 (1.0) 516.8523 (1.06) 0.0000 (1.0) 0;0 1.9348 (0.95) 1 1
test_gc-gc[3.10.0] 515.7007 (1.05) 515.7007 (1.05) 515.7007 (1.05) 0.0000 (1.0) 515.7007 (1.05) 0.0000 (1.0) 0;0 1.9391 (0.95) 1 1
test_gc-gc[main] 489.7838 (1.0) 489.7838 (1.0) 489.7838 (1.0) 0.0000 (1.0) 489.7838 (1.0) 0.0000 (1.0) 0;0 2.0417 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 5.9451 (1.14) 5.9451 (1.14) 5.9451 (1.14) 0.0000 (1.0) 5.9451 (1.14) 0.0000 (1.0) 0;0 0.1682 (0.88) 1 1
test_get-get[3.10.0] 7.0108 (1.34) 7.0108 (1.34) 7.0108 (1.34) 0.0000 (1.0) 7.0108 (1.34) 0.0000 (1.0) 0;0 0.1426 (0.75) 1 1
test_get-get[main] 5.2349 (1.0) 5.2349 (1.0) 5.2349 (1.0) 0.0000 (1.0) 5.2349 (1.0) 0.0000 (1.0) 0;0 0.1910 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 3.0829 (3.28) 3.0829 (3.28) 3.0829 (3.28) 0.0000 (1.0) 3.0829 (3.28) 0.0000 (1.0) 0;0 0.3244 (0.30) 1 1
test_get_url-get-url[3.10.0] 3.2060 (3.41) 3.2060 (3.41) 3.2060 (3.41) 0.0000 (1.0) 3.2060 (3.41) 0.0000 (1.0) 0;0 0.3119 (0.29) 1 1
test_get_url-get-url[main] 0.9389 (1.0) 0.9389 (1.0) 0.9389 (1.0) 0.0000 (1.0) 0.9389 (1.0) 0.0000 (1.0) 0;0 1.0651 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 128.0390 (1.02) 141.8207 (1.05) 131.6294 (1.02) 2.1957 (1.21) 131.2889 (1.02) 2.1575 (1.05) 16;4 7.5971 (0.98) 100 1
test_help---help[3.10.0] 125.7412 (1.0) 134.6630 (1.0) 129.4834 (1.0) 1.8165 (1.0) 129.1595 (1.0) 2.0523 (1.0) 25;5 7.7230 (1.0) 100 1
test_help---help[main] 126.4210 (1.01) 136.0425 (1.01) 130.2563 (1.01) 2.0884 (1.15) 129.8226 (1.01) 2.6852 (1.31) 33;1 7.6772 (0.99) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 9.4308 (1.10) 9.4308 (1.10) 9.4308 (1.10) 0.0000 (1.0) 9.4308 (1.10) 0.0000 (1.0) 0;0 0.1060 (0.91) 1 1
test_import-import[3.10.0] 10.5418 (1.23) 10.5418 (1.23) 10.5418 (1.23) 0.0000 (1.0) 10.5418 (1.23) 0.0000 (1.0) 0;0 0.0949 (0.81) 1 1
test_import-import[main] 8.5916 (1.0) 8.5916 (1.0) 8.5916 (1.0) 0.0000 (1.0) 8.5916 (1.0) 0.0000 (1.0) 0;0 0.1164 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 7.4900 (1.45) 7.4900 (1.45) 7.4900 (1.45) 0.0000 (1.0) 7.4900 (1.45) 0.0000 (1.0) 0;0 0.1335 (0.69) 1 1
test_import_url-import-url[3.10.0] 7.5561 (1.46) 7.5561 (1.46) 7.5561 (1.46) 0.0000 (1.0) 7.5561 (1.46) 0.0000 (1.0) 0;0 0.1323 (0.68) 1 1
test_import_url-import-url[main] 5.1683 (1.0) 5.1683 (1.0) 5.1683 (1.0) 0.0000 (1.0) 5.1683 (1.0) 0.0000 (1.0) 0;0 0.1935 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 362.0482 (1.01) 485.6916 (1.27) 370.4827 (1.01) 13.0746 (3.43) 368.1591 (1.01) 5.2515 (1.14) 4;6 2.6992 (0.99) 100 1
test_init-init[3.10.0] 366.0112 (1.02) 415.0136 (1.09) 375.5289 (1.03) 5.2692 (1.38) 375.1362 (1.03) 4.8046 (1.05) 12;2 2.6629 (0.97) 100 1
test_init-init[main] 358.7924 (1.0) 381.7621 (1.0) 365.7630 (1.0) 3.8107 (1.0) 365.0598 (1.0) 4.5910 (1.0) 27;3 2.7340 (1.0) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 443.0242 (1.16) 443.0242 (1.16) 443.0242 (1.16) 0.0000 (1.0) 443.0242 (1.16) 0.0000 (1.0) 0;0 2.2572 (0.86) 1 1
test_list-list[3.10.0] 409.5557 (1.07) 409.5557 (1.07) 409.5557 (1.07) 0.0000 (1.0) 409.5557 (1.07) 0.0000 (1.0) 0;0 2.4417 (0.93) 1 1
test_list-list[main] 382.3476 (1.0) 382.3476 (1.0) 382.3476 (1.0) 0.0000 (1.0) 382.3476 (1.0) 0.0000 (1.0) 0;0 2.6154 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 436.6222 (1.14) 436.6222 (1.14) 436.6222 (1.14) 0.0000 (1.0) 436.6222 (1.14) 0.0000 (1.0) 0;0 2.2903 (0.88) 1 1
test_list-list-dvc-only[3.10.0] 394.0530 (1.03) 394.0530 (1.03) 394.0530 (1.03) 0.0000 (1.0) 394.0530 (1.03) 0.0000 (1.0) 0;0 2.5377 (0.97) 1 1
test_list-list-dvc-only[main] 382.2716 (1.0) 382.2716 (1.0) 382.2716 (1.0) 0.0000 (1.0) 382.2716 (1.0) 0.0000 (1.0) 0;0 2.6159 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 528.2896 (1.12) 528.2896 (1.12) 528.2896 (1.12) 0.0000 (1.0) 528.2896 (1.12) 0.0000 (1.0) 0;0 1.8929 (0.89) 1 1
test_list-list-recursive[3.10.0] 475.5099 (1.01) 475.5099 (1.01) 475.5099 (1.01) 0.0000 (1.0) 475.5099 (1.01) 0.0000 (1.0) 0;0 2.1030 (0.99) 1 1
test_list-list-recursive[main] 471.6214 (1.0) 471.6214 (1.0) 471.6214 (1.0) 0.0000 (1.0) 471.6214 (1.0) 0.0000 (1.0) 0;0 2.1203 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 435.6451 (1.10) 435.6451 (1.10) 435.6451 (1.10) 0.0000 (1.0) 435.6451 (1.10) 0.0000 (1.0) 0;0 2.2954 (0.91) 1 1
test_list-list-shallow[3.10.0] 395.0230 (1.0) 395.0230 (1.0) 395.0230 (1.0) 0.0000 (1.0) 395.0230 (1.0) 0.0000 (1.0) 0;0 2.5315 (1.0) 1 1
test_list-list-shallow[main] 401.2261 (1.02) 401.2261 (1.02) 401.2261 (1.02) 0.0000 (1.0) 401.2261 (1.02) 0.0000 (1.0) 0;0 2.4924 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.0841 (1.04) 2.0841 (1.04) 2.0841 (1.04) 0.0000 (1.0) 2.0841 (1.04) 0.0000 (1.0) 0;0 0.4798 (0.97) 1 1
test_partial_add-add[3.10.0] 2.0770 (1.03) 2.0770 (1.03) 2.0770 (1.03) 0.0000 (1.0) 2.0770 (1.03) 0.0000 (1.0) 0;0 0.4815 (0.97) 1 1
test_partial_add-add[main] 2.0125 (1.0) 2.0125 (1.0) 2.0125 (1.0) 0.0000 (1.0) 2.0125 (1.0) 0.0000 (1.0) 0;0 0.4969 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 3.0831 (1.04) 3.0831 (1.04) 3.0831 (1.04) 0.0000 (1.0) 3.0831 (1.04) 0.0000 (1.0) 0;0 0.3244 (0.96) 1 1
test_partial_add-add-partial[3.10.0] 3.1007 (1.05) 3.1007 (1.05) 3.1007 (1.05) 0.0000 (1.0) 3.1007 (1.05) 0.0000 (1.0) 0;0 0.3225 (0.96) 1 1
test_partial_add-add-partial[main] 2.9620 (1.0) 2.9620 (1.0) 2.9620 (1.0) 0.0000 (1.0) 2.9620 (1.0) 0.0000 (1.0) 0;0 0.3376 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 579.1638 (1.0) 579.1638 (1.0) 579.1638 (1.0) 0.0000 (1.0) 579.1638 (1.0) 0.0000 (1.0) 0;0 1.7266 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 654.4309 (1.13) 654.4309 (1.13) 654.4309 (1.13) 0.0000 (1.0) 654.4309 (1.13) 0.0000 (1.0) 0;0 1.5280 (0.88) 1 1
test_partial_add-gc-cloud-noop[main] 684.8901 (1.18) 684.8901 (1.18) 684.8901 (1.18) 0.0000 (1.0) 684.8901 (1.18) 0.0000 (1.0) 0;0 1.4601 (0.85) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 497.6849 (1.0) 497.6849 (1.0) 497.6849 (1.0) 0.0000 (1.0) 497.6849 (1.0) 0.0000 (1.0) 0;0 2.0093 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 580.0121 (1.17) 580.0121 (1.17) 580.0121 (1.17) 0.0000 (1.0) 580.0121 (1.17) 0.0000 (1.0) 0;0 1.7241 (0.86) 1 1
test_partial_add-gc-noop[main] 555.6889 (1.12) 555.6889 (1.12) 555.6889 (1.12) 0.0000 (1.0) 555.6889 (1.12) 0.0000 (1.0) 0;0 1.7996 (0.90) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 1.9700 (1.67) 1.9700 (1.67) 1.9700 (1.67) 0.0000 (1.0) 1.9700 (1.67) 0.0000 (1.0) 0;0 0.5076 (0.60) 1 1
test_partial_add-push[3.10.0] 1.1960 (1.02) 1.1960 (1.02) 1.1960 (1.02) 0.0000 (1.0) 1.1960 (1.02) 0.0000 (1.0) 0;0 0.8361 (0.98) 1 1
test_partial_add-push[main] 1.1768 (1.0) 1.1768 (1.0) 1.1768 (1.0) 0.0000 (1.0) 1.1768 (1.0) 0.0000 (1.0) 0;0 0.8498 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 2.0315 (1.62) 2.0315 (1.62) 2.0315 (1.62) 0.0000 (1.0) 2.0315 (1.62) 0.0000 (1.0) 0;0 0.4923 (0.62) 1 1
test_partial_add-push-partial[3.10.0] 1.2552 (1.0) 1.2552 (1.0) 1.2552 (1.0) 0.0000 (1.0) 1.2552 (1.0) 0.0000 (1.0) 0;0 0.7967 (1.0) 1 1
test_partial_add-push-partial[main] 1.2681 (1.01) 1.2681 (1.01) 1.2681 (1.01) 0.0000 (1.0) 1.2681 (1.01) 0.0000 (1.0) 0;0 0.7886 (0.99) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.5359 (1.04) 3.5359 (1.04) 3.5359 (1.04) 0.0000 (1.0) 3.5359 (1.04) 0.0000 (1.0) 0;0 0.2828 (0.96) 1 1
test_partial_remove-add[3.10.0] 3.5228 (1.04) 3.5228 (1.04) 3.5228 (1.04) 0.0000 (1.0) 3.5228 (1.04) 0.0000 (1.0) 0;0 0.2839 (0.96) 1 1
test_partial_remove-add[main] 3.3865 (1.0) 3.3865 (1.0) 3.3865 (1.0) 0.0000 (1.0) 3.3865 (1.0) 0.0000 (1.0) 0;0 0.2953 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.4406 (1.05) 1.4406 (1.05) 1.4406 (1.05) 0.0000 (1.0) 1.4406 (1.05) 0.0000 (1.0) 0;0 0.6942 (0.95) 1 1
test_partial_remove-add-update[3.10.0] 1.4630 (1.07) 1.4630 (1.07) 1.4630 (1.07) 0.0000 (1.0) 1.4630 (1.07) 0.0000 (1.0) 0;0 0.6835 (0.94) 1 1
test_partial_remove-add-update[main] 1.3704 (1.0) 1.3704 (1.0) 1.3704 (1.0) 0.0000 (1.0) 1.3704 (1.0) 0.0000 (1.0) 0;0 0.7297 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 478.6659 (1.0) 478.6659 (1.0) 478.6659 (1.0) 0.0000 (1.0) 478.6659 (1.0) 0.0000 (1.0) 0;0 2.0891 (1.0) 1 1
test_partial_remove-gc[3.10.0] 535.3899 (1.12) 535.3899 (1.12) 535.3899 (1.12) 0.0000 (1.0) 535.3899 (1.12) 0.0000 (1.0) 0;0 1.8678 (0.89) 1 1
test_partial_remove-gc[main] 513.9267 (1.07) 513.9267 (1.07) 513.9267 (1.07) 0.0000 (1.0) 513.9267 (1.07) 0.0000 (1.0) 0;0 1.9458 (0.93) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 544.4435 (1.0) 544.4435 (1.0) 544.4435 (1.0) 0.0000 (1.0) 544.4435 (1.0) 0.0000 (1.0) 0;0 1.8367 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 612.4501 (1.12) 612.4501 (1.12) 612.4501 (1.12) 0.0000 (1.0) 612.4501 (1.12) 0.0000 (1.0) 0;0 1.6328 (0.89) 1 1
test_partial_remove-gc-cloud[main] 629.9530 (1.16) 629.9530 (1.16) 629.9530 (1.16) 0.0000 (1.0) 629.9530 (1.16) 0.0000 (1.0) 0;0 1.5874 (0.86) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 3.3978 (2.44) 3.3978 (2.44) 3.3978 (2.44) 0.0000 (1.0) 3.3978 (2.44) 0.0000 (1.0) 0;0 0.2943 (0.41) 1 1
test_partial_remove-push[3.10.0] 1.8804 (1.35) 1.8804 (1.35) 1.8804 (1.35) 0.0000 (1.0) 1.8804 (1.35) 0.0000 (1.0) 0;0 0.5318 (0.74) 1 1
test_partial_remove-push[main] 1.3944 (1.0) 1.3944 (1.0) 1.3944 (1.0) 0.0000 (1.0) 1.3944 (1.0) 0.0000 (1.0) 0;0 0.7172 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 470.2042 (1.01) 470.2042 (1.01) 470.2042 (1.01) 0.0000 (1.0) 470.2042 (1.01) 0.0000 (1.0) 0;0 2.1267 (0.99) 1 1
test_partial_remove-push-update[3.10.0] 466.8876 (1.0) 466.8876 (1.0) 466.8876 (1.0) 0.0000 (1.0) 466.8876 (1.0) 0.0000 (1.0) 0;0 2.1418 (1.0) 1 1
test_partial_remove-push-update[main] 760.3055 (1.63) 760.3055 (1.63) 760.3055 (1.63) 0.0000 (1.0) 760.3055 (1.63) 0.0000 (1.0) 0;0 1.3153 (0.61) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 446.9859 (1.0) 451.4858 (1.0) 448.8445 (1.0) 1.7899 (1.0) 448.2111 (1.0) 2.6142 (1.02) 2;0 2.2279 (1.0) 5 3
test_plots-plots-diff[3.10.0] 815.4677 (1.82) 827.9795 (1.83) 822.1590 (1.83) 5.5230 (3.09) 821.7401 (1.83) 10.0308 (3.92) 2;0 1.2163 (0.55) 5 3
test_plots-plots-diff[main] 757.5028 (1.69) 765.0815 (1.69) 760.0494 (1.69) 2.9280 (1.64) 759.0653 (1.69) 2.5562 (1.0) 1;1 1.3157 (0.59) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 463.8700 (1.0) 470.1675 (1.0) 466.0597 (1.0) 2.3962 (1.0) 465.3231 (1.0) 1.8303 (1.0) 1;1 2.1456 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,080.0489 (2.33) 1,108.2748 (2.36) 1,089.7090 (2.34) 10.9035 (4.55) 1,087.4918 (2.34) 10.4521 (5.71) 1;0 0.9177 (0.43) 5 3
test_plots-plots-diff-json[main] 837.5292 (1.81) 867.9904 (1.85) 852.6270 (1.83) 11.2532 (4.70) 852.3457 (1.83) 14.5285 (7.94) 2;0 1.1728 (0.55) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 395.8263 (1.0) 409.8015 (1.0) 402.9760 (1.0) 4.9729 (1.0) 403.4493 (1.0) 4.5429 (1.0) 2;0 2.4815 (1.0) 5 3
test_plots-plots-show[3.10.0] 670.3259 (1.69) 685.6843 (1.67) 678.4637 (1.68) 6.6673 (1.34) 677.7323 (1.68) 11.8863 (2.62) 2;0 1.4739 (0.59) 5 3
test_plots-plots-show[main] 629.7868 (1.59) 650.8622 (1.59) 640.6734 (1.59) 8.0826 (1.63) 642.7784 (1.59) 11.4136 (2.51) 2;0 1.5609 (0.63) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 418.6618 (1.0) 434.1489 (1.0) 425.9143 (1.0) 5.9613 (1.39) 424.6111 (1.0) 8.6140 (1.48) 2;0 2.3479 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 817.9077 (1.95) 830.2545 (1.91) 826.1506 (1.94) 4.9755 (1.16) 826.4224 (1.95) 5.8289 (1.0) 1;0 1.2104 (0.52) 5 3
test_plots-plots-show-json[main] 685.7982 (1.64) 696.2241 (1.60) 691.7096 (1.62) 4.3040 (1.0) 693.6265 (1.63) 6.7093 (1.15) 2;0 1.4457 (0.62) 5 3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 3.5369 (2.40) 3.5369 (2.40) 3.5369 (2.40) 0.0000 (1.0) 3.5369 (2.40) 0.0000 (1.0) 0;0 0.2827 (0.42) 1 1
test_push-push[3.10.0] 1.9973 (1.36) 1.9973 (1.36) 1.9973 (1.36) 0.0000 (1.0) 1.9973 (1.36) 0.0000 (1.0) 0;0 0.5007 (0.74) 1 1
test_push-push[main] 1.4725 (1.0) 1.4725 (1.0) 1.4725 (1.0) 0.0000 (1.0) 1.4725 (1.0) 0.0000 (1.0) 0;0 0.6791 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2] 3.5121 (1.03) 3.5121 (1.03) 3.5121 (1.03) 0.0000 (1.0) 3.5121 (1.03) 0.0000 (1.0) 0;0 0.2847 (0.97) 1 1
test_sharing-add[3.10.0] 3.5705 (1.05) 3.5705 (1.05) 3.5705 (1.05) 0.0000 (1.0) 3.5705 (1.05) 0.0000 (1.0) 0;0 0.2801 (0.96) 1 1
test_sharing-add[main] 3.4116 (1.0) 3.4116 (1.0) 3.4116 (1.0) 0.0000 (1.0) 3.4116 (1.0) 0.0000 (1.0) 0;0 0.2931 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2] 2.4136 (1.09) 2.4136 (1.09) 2.4136 (1.09) 0.0000 (1.0) 2.4136 (1.09) 0.0000 (1.0) 0;0 0.4143 (0.92) 1 1
test_sharing-add-noop[3.10.0] 2.4237 (1.09) 2.4237 (1.09) 2.4237 (1.09) 0.0000 (1.0) 2.4237 (1.09) 0.0000 (1.0) 0;0 0.4126 (0.91) 1 1
test_sharing-add-noop[main] 2.2156 (1.0) 2.2156 (1.0) 2.2156 (1.0) 0.0000 (1.0) 2.2156 (1.0) 0.0000 (1.0) 0;0 0.4514 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2] 1.7094 (1.26) 1.7094 (1.26) 1.7094 (1.26) 0.0000 (1.0) 1.7094 (1.26) 0.0000 (1.0) 0;0 0.5850 (0.79) 1 1
test_sharing-checkout[3.10.0] 3.6909 (2.72) 3.6909 (2.72) 3.6909 (2.72) 0.0000 (1.0) 3.6909 (2.72) 0.0000 (1.0) 0;0 0.2709 (0.37) 1 1
test_sharing-checkout[main] 1.3554 (1.0) 1.3554 (1.0) 1.3554 (1.0) 0.0000 (1.0) 1.3554 (1.0) 0.0000 (1.0) 0;0 0.7378 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2] 543.2168 (1.0) 543.2168 (1.0) 543.2168 (1.0) 0.0000 (1.0) 543.2168 (1.0) 0.0000 (1.0) 0;0 1.8409 (1.0) 1 1
test_sharing-checkout-noop[3.10.0] 568.8316 (1.05) 568.8316 (1.05) 568.8316 (1.05) 0.0000 (1.0) 568.8316 (1.05) 0.0000 (1.0) 0;0 1.7580 (0.95) 1 1
test_sharing-checkout-noop[main] 544.0390 (1.00) 544.0390 (1.00) 544.0390 (1.00) 0.0000 (1.0) 544.0390 (1.00) 0.0000 (1.0) 0;0 1.8381 (1.00) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 3.8658 (2.15) 3.8658 (2.15) 3.8658 (2.15) 0.0000 (1.0) 3.8658 (2.15) 0.0000 (1.0) 0;0 0.2587 (0.47) 1 1
test_sharing-fetch[3.10.0] 4.2394 (2.35) 4.2394 (2.35) 4.2394 (2.35) 0.0000 (1.0) 4.2394 (2.35) 0.0000 (1.0) 0;0 0.2359 (0.42) 1 1
test_sharing-fetch[main] 1.8006 (1.0) 1.8006 (1.0) 1.8006 (1.0) 0.0000 (1.0) 1.8006 (1.0) 0.0000 (1.0) 0;0 0.5554 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 408.3453 (1.0) 408.3453 (1.0) 408.3453 (1.0) 0.0000 (1.0) 408.3453 (1.0) 0.0000 (1.0) 0;0 2.4489 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 491.1645 (1.20) 491.1645 (1.20) 491.1645 (1.20) 0.0000 (1.0) 491.1645 (1.20) 0.0000 (1.0) 0;0 2.0360 (0.83) 1 1
test_sharing-fetch-noop[main] 771.8055 (1.89) 771.8055 (1.89) 771.8055 (1.89) 0.0000 (1.0) 771.8055 (1.89) 0.0000 (1.0) 0;0 1.2957 (0.53) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 3.4046 (2.37) 3.4046 (2.37) 3.4046 (2.37) 0.0000 (1.0) 3.4046 (2.37) 0.0000 (1.0) 0;0 0.2937 (0.42) 1 1
test_sharing-push[3.10.0] 1.8680 (1.30) 1.8680 (1.30) 1.8680 (1.30) 0.0000 (1.0) 1.8680 (1.30) 0.0000 (1.0) 0;0 0.5353 (0.77) 1 1
test_sharing-push[main] 1.4376 (1.0) 1.4376 (1.0) 1.4376 (1.0) 0.0000 (1.0) 1.4376 (1.0) 0.0000 (1.0) 0;0 0.6956 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 430.4890 (1.0) 430.4890 (1.0) 430.4890 (1.0) 0.0000 (1.0) 430.4890 (1.0) 0.0000 (1.0) 0;0 2.3229 (1.0) 1 1
test_sharing-push-noop[3.10.0] 431.3785 (1.00) 431.3785 (1.00) 431.3785 (1.00) 0.0000 (1.0) 431.3785 (1.00) 0.0000 (1.0) 0;0 2.3181 (1.00) 1 1
test_sharing-push-noop[main] 778.4622 (1.81) 778.4622 (1.81) 778.4622 (1.81) 0.0000 (1.0) 778.4622 (1.81) 0.0000 (1.0) 0;0 1.2846 (0.55) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.1888 (1.02) 1.1888 (1.02) 1.1888 (1.02) 0.0000 (1.0) 1.1888 (1.02) 0.0000 (1.0) 0;0 0.8412 (0.98) 1 1
test_status-status[3.10.0] 1.2255 (1.05) 1.2255 (1.05) 1.2255 (1.05) 0.0000 (1.0) 1.2255 (1.05) 0.0000 (1.0) 0;0 0.8160 (0.95) 1 1
test_status-status[main] 1.1623 (1.0) 1.1623 (1.0) 1.1623 (1.0) 0.0000 (1.0) 1.1623 (1.0) 0.0000 (1.0) 0;0 0.8603 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 535.5303 (1.01) 535.5303 (1.01) 535.5303 (1.01) 0.0000 (1.0) 535.5303 (1.01) 0.0000 (1.0) 0;0 1.8673 (0.99) 1 1
test_status-status-changed[3.10.0] 551.4535 (1.04) 551.4535 (1.04) 551.4535 (1.04) 0.0000 (1.0) 551.4535 (1.04) 0.0000 (1.0) 0;0 1.8134 (0.96) 1 1
test_status-status-changed[main] 531.9862 (1.0) 531.9862 (1.0) 531.9862 (1.0) 0.0000 (1.0) 531.9862 (1.0) 0.0000 (1.0) 0;0 1.8797 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 547.1787 (1.04) 547.1787 (1.04) 547.1787 (1.04) 0.0000 (1.0) 547.1787 (1.04) 0.0000 (1.0) 0;0 1.8276 (0.96) 1 1
test_status-status-changed-noop[3.10.0] 548.8783 (1.05) 548.8783 (1.05) 548.8783 (1.05) 0.0000 (1.0) 548.8783 (1.05) 0.0000 (1.0) 0;0 1.8219 (0.96) 1 1
test_status-status-changed-noop[main] 524.2963 (1.0) 524.2963 (1.0) 524.2963 (1.0) 0.0000 (1.0) 524.2963 (1.0) 0.0000 (1.0) 0;0 1.9073 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 548.9677 (1.06) 548.9677 (1.06) 548.9677 (1.06) 0.0000 (1.0) 548.9677 (1.06) 0.0000 (1.0) 0;0 1.8216 (0.95) 1 1
test_status-status-noop[3.10.0] 551.5444 (1.06) 551.5444 (1.06) 551.5444 (1.06) 0.0000 (1.0) 551.5444 (1.06) 0.0000 (1.0) 0;0 1.8131 (0.94) 1 1
test_status-status-noop[main] 519.8497 (1.0) 519.8497 (1.0) 519.8497 (1.0) 0.0000 (1.0) 519.8497 (1.0) 0.0000 (1.0) 0;0 1.9236 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 7.3013 (1.46) 7.3013 (1.46) 7.3013 (1.46) 0.0000 (1.0) 7.3013 (1.46) 0.0000 (1.0) 0;0 0.1370 (0.68) 1 1
test_update-import-url[3.10.0] 7.4499 (1.49) 7.4499 (1.49) 7.4499 (1.49) 0.0000 (1.0) 7.4499 (1.49) 0.0000 (1.0) 0;0 0.1342 (0.67) 1 1
test_update-import-url[main] 4.9930 (1.0) 4.9930 (1.0) 4.9930 (1.0) 0.0000 (1.0) 4.9930 (1.0) 0.0000 (1.0) 0;0 0.2003 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 6.6201 (1.52) 6.6201 (1.52) 6.6201 (1.52) 0.0000 (1.0) 6.6201 (1.52) 0.0000 (1.0) 0;0 0.1511 (0.66) 1 1
test_update-update[3.10.0] 6.7081 (1.54) 6.7081 (1.54) 6.7081 (1.54) 0.0000 (1.0) 6.7081 (1.54) 0.0000 (1.0) 0;0 0.1491 (0.65) 1 1
test_update-update[main] 4.3448 (1.0) 4.3448 (1.0) 4.3448 (1.0) 0.0000 (1.0) 4.3448 (1.0) 0.0000 (1.0) 0;0 0.2302 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 957.9311 (1.01) 957.9311 (1.01) 957.9311 (1.01) 0.0000 (1.0) 957.9311 (1.01) 0.0000 (1.0) 0;0 1.0439 (0.99) 1 1
test_update-update-noop[3.10.0] 979.7724 (1.03) 979.7724 (1.03) 979.7724 (1.03) 0.0000 (1.0) 979.7724 (1.03) 0.0000 (1.0) 0;0 1.0206 (0.97) 1 1
test_update-update-noop[main] 947.4549 (1.0) 947.4549 (1.0) 947.4549 (1.0) 0.0000 (1.0) 947.4549 (1.0) 0.0000 (1.0) 0;0 1.0555 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
updates: