github-actions[bot]
commented
2 months ago
Mon Apr 29 20:01:30 UTC 2024
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2] 3.7204 (1.05) 3.7204 (1.05) 3.7204 (1.05) 0.0000 (1.0) 3.7204 (1.05) 0.0000 (1.0) 0;0 0.2688 (0.95) 1 1
test_add-add[3.10.0] 3.8482 (1.09) 3.8482 (1.09) 3.8482 (1.09) 0.0000 (1.0) 3.8482 (1.09) 0.0000 (1.0) 0;0 0.2599 (0.92) 1 1
test_add-add[main] 3.5403 (1.0) 3.5403 (1.0) 3.5403 (1.0) 0.0000 (1.0) 3.5403 (1.0) 0.0000 (1.0) 0;0 0.2825 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 1.9586 (1.20) 1.9586 (1.20) 1.9586 (1.20) 0.0000 (1.0) 1.9586 (1.20) 0.0000 (1.0) 0;0 0.5106 (0.83) 1 1
test_checkout_copy-checkout[3.10.0] 3.9969 (2.45) 3.9969 (2.45) 3.9969 (2.45) 0.0000 (1.0) 3.9969 (2.45) 0.0000 (1.0) 0;0 0.2502 (0.41) 1 1
test_checkout_copy-checkout[main] 1.6296 (1.0) 1.6296 (1.0) 1.6296 (1.0) 0.0000 (1.0) 1.6296 (1.0) 0.0000 (1.0) 0;0 0.6136 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 571.3704 (1.0) 571.3704 (1.0) 571.3704 (1.0) 0.0000 (1.0) 571.3704 (1.0) 0.0000 (1.0) 0;0 1.7502 (1.0) 1 1
test_checkout_copy-checkout-noop[3.10.0] 621.9547 (1.09) 621.9547 (1.09) 621.9547 (1.09) 0.0000 (1.0) 621.9547 (1.09) 0.0000 (1.0) 0;0 1.6078 (0.92) 1 1
test_checkout_copy-checkout-noop[main] 583.8119 (1.02) 583.8119 (1.02) 583.8119 (1.02) 0.0000 (1.0) 583.8119 (1.02) 0.0000 (1.0) 0;0 1.7129 (0.98) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 713.4559 (1.08) 713.4559 (1.08) 713.4559 (1.08) 0.0000 (1.0) 713.4559 (1.08) 0.0000 (1.0) 0;0 1.4016 (0.93) 1 1
test_checkout_copy-checkout-update[3.10.0] 705.6707 (1.07) 705.6707 (1.07) 705.6707 (1.07) 0.0000 (1.0) 705.6707 (1.07) 0.0000 (1.0) 0;0 1.4171 (0.94) 1 1
test_checkout_copy-checkout-update[main] 662.2481 (1.0) 662.2481 (1.0) 662.2481 (1.0) 0.0000 (1.0) 662.2481 (1.0) 0.0000 (1.0) 0;0 1.5100 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.1905 (1.15) 1.1905 (1.15) 1.1905 (1.15) 0.0000 (1.0) 1.1905 (1.15) 0.0000 (1.0) 0;0 0.8400 (0.87) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.0449 (1.01) 1.0449 (1.01) 1.0449 (1.01) 0.0000 (1.0) 1.0449 (1.01) 0.0000 (1.0) 0;0 0.9570 (0.99) 1 1
test_checkout_hardlink-checkout[main] 1.0337 (1.0) 1.0337 (1.0) 1.0337 (1.0) 0.0000 (1.0) 1.0337 (1.0) 0.0000 (1.0) 0;0 0.9674 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 545.0815 (1.01) 545.0815 (1.01) 545.0815 (1.01) 0.0000 (1.0) 545.0815 (1.01) 0.0000 (1.0) 0;0 1.8346 (0.99) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 562.0552 (1.04) 562.0552 (1.04) 562.0552 (1.04) 0.0000 (1.0) 562.0552 (1.04) 0.0000 (1.0) 0;0 1.7792 (0.96) 1 1
test_checkout_hardlink-checkout-noop[main] 538.1704 (1.0) 538.1704 (1.0) 538.1704 (1.0) 0.0000 (1.0) 538.1704 (1.0) 0.0000 (1.0) 0;0 1.8581 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 678.1897 (1.15) 678.1897 (1.15) 678.1897 (1.15) 0.0000 (1.0) 678.1897 (1.15) 0.0000 (1.0) 0;0 1.4745 (0.87) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 614.0066 (1.04) 614.0066 (1.04) 614.0066 (1.04) 0.0000 (1.0) 614.0066 (1.04) 0.0000 (1.0) 0;0 1.6286 (0.96) 1 1
test_checkout_hardlink-checkout-update[main] 590.2067 (1.0) 590.2067 (1.0) 590.2067 (1.0) 0.0000 (1.0) 590.2067 (1.0) 0.0000 (1.0) 0;0 1.6943 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.3105 (1.14) 1.3105 (1.14) 1.3105 (1.14) 0.0000 (1.0) 1.3105 (1.14) 0.0000 (1.0) 0;0 0.7631 (0.88) 1 1
test_checkout_symlink-checkout[3.10.0] 1.1537 (1.0) 1.1537 (1.0) 1.1537 (1.0) 0.0000 (1.0) 1.1537 (1.0) 0.0000 (1.0) 0;0 0.8668 (1.0) 1 1
test_checkout_symlink-checkout[main] 1.1540 (1.00) 1.1540 (1.00) 1.1540 (1.00) 0.0000 (1.0) 1.1540 (1.00) 0.0000 (1.0) 0;0 0.8666 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 590.3837 (1.0) 590.3837 (1.0) 590.3837 (1.0) 0.0000 (1.0) 590.3837 (1.0) 0.0000 (1.0) 0;0 1.6938 (1.0) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 615.6454 (1.04) 615.6454 (1.04) 615.6454 (1.04) 0.0000 (1.0) 615.6454 (1.04) 0.0000 (1.0) 0;0 1.6243 (0.96) 1 1
test_checkout_symlink-checkout-noop[main] 591.4276 (1.00) 591.4276 (1.00) 591.4276 (1.00) 0.0000 (1.0) 591.4276 (1.00) 0.0000 (1.0) 0;0 1.6908 (1.00) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 774.9631 (1.13) 774.9631 (1.13) 774.9631 (1.13) 0.0000 (1.0) 774.9631 (1.13) 0.0000 (1.0) 0;0 1.2904 (0.88) 1 1
test_checkout_symlink-checkout-update[3.10.0] 698.6078 (1.02) 698.6078 (1.02) 698.6078 (1.02) 0.0000 (1.0) 698.6078 (1.02) 0.0000 (1.0) 0;0 1.4314 (0.98) 1 1
test_checkout_symlink-checkout-update[main] 683.0285 (1.0) 683.0285 (1.0) 683.0285 (1.0) 0.0000 (1.0) 683.0285 (1.0) 0.0000 (1.0) 0;0 1.4641 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 576.0391 (1.03) 576.0391 (1.03) 576.0391 (1.03) 0.0000 (1.0) 576.0391 (1.03) 0.0000 (1.0) 0;0 1.7360 (0.97) 1 1
test_data_status-data-changed[3.10.0] 581.0045 (1.04) 581.0045 (1.04) 581.0045 (1.04) 0.0000 (1.0) 581.0045 (1.04) 0.0000 (1.0) 0;0 1.7212 (0.96) 1 1
test_data_status-data-changed[main] 560.4106 (1.0) 560.4106 (1.0) 560.4106 (1.0) 0.0000 (1.0) 560.4106 (1.0) 0.0000 (1.0) 0;0 1.7844 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 583.9538 (1.04) 583.9538 (1.04) 583.9538 (1.04) 0.0000 (1.0) 583.9538 (1.04) 0.0000 (1.0) 0;0 1.7125 (0.96) 1 1
test_data_status-data-changed-noop[3.10.0] 584.1323 (1.04) 584.1323 (1.04) 584.1323 (1.04) 0.0000 (1.0) 584.1323 (1.04) 0.0000 (1.0) 0;0 1.7119 (0.96) 1 1
test_data_status-data-changed-noop[main] 560.6571 (1.0) 560.6571 (1.0) 560.6571 (1.0) 0.0000 (1.0) 560.6571 (1.0) 0.0000 (1.0) 0;0 1.7836 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.2198 (1.01) 1.2198 (1.01) 1.2198 (1.01) 0.0000 (1.0) 1.2198 (1.01) 0.0000 (1.0) 0;0 0.8198 (0.99) 1 1
test_data_status-data-new[3.10.0] 1.2033 (1.0) 1.2033 (1.0) 1.2033 (1.0) 0.0000 (1.0) 1.2033 (1.0) 0.0000 (1.0) 0;0 0.8310 (1.0) 1 1
test_data_status-data-new[main] 1.2127 (1.01) 1.2127 (1.01) 1.2127 (1.01) 0.0000 (1.0) 1.2127 (1.01) 0.0000 (1.0) 0;0 0.8246 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 581.5949 (1.03) 581.5949 (1.03) 581.5949 (1.03) 0.0000 (1.0) 581.5949 (1.03) 0.0000 (1.0) 0;0 1.7194 (0.97) 1 1
test_data_status-data-noop[3.10.0] 581.4624 (1.03) 581.4624 (1.03) 581.4624 (1.03) 0.0000 (1.0) 581.4624 (1.03) 0.0000 (1.0) 0;0 1.7198 (0.97) 1 1
test_data_status-data-noop[main] 563.9936 (1.0) 563.9936 (1.0) 563.9936 (1.0) 0.0000 (1.0) 563.9936 (1.0) 0.0000 (1.0) 0;0 1.7731 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.0052 (1.01) 1.0052 (1.01) 1.0052 (1.01) 0.0000 (1.0) 1.0052 (1.01) 0.0000 (1.0) 0;0 0.9949 (0.99) 1 1
test_data_status_all_flags-data-changed[3.10.0] 1.0314 (1.04) 1.0314 (1.04) 1.0314 (1.04) 0.0000 (1.0) 1.0314 (1.04) 0.0000 (1.0) 0;0 0.9695 (0.96) 1 1
test_data_status_all_flags-data-changed[main] 0.9915 (1.0) 0.9915 (1.0) 0.9915 (1.0) 0.0000 (1.0) 0.9915 (1.0) 0.0000 (1.0) 0;0 1.0086 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.0108 (1.02) 1.0108 (1.02) 1.0108 (1.02) 0.0000 (1.0) 1.0108 (1.02) 0.0000 (1.0) 0;0 0.9893 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 1.0300 (1.03) 1.0300 (1.03) 1.0300 (1.03) 0.0000 (1.0) 1.0300 (1.03) 0.0000 (1.0) 0;0 0.9708 (0.97) 1 1
test_data_status_all_flags-data-changed-noop[main] 0.9953 (1.0) 0.9953 (1.0) 0.9953 (1.0) 0.0000 (1.0) 0.9953 (1.0) 0.0000 (1.0) 0;0 1.0048 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 1.6985 (1.03) 1.6985 (1.03) 1.6985 (1.03) 0.0000 (1.0) 1.6985 (1.03) 0.0000 (1.0) 0;0 0.5888 (0.97) 1 1
test_data_status_all_flags-data-new[3.10.0] 1.6692 (1.01) 1.6692 (1.01) 1.6692 (1.01) 0.0000 (1.0) 1.6692 (1.01) 0.0000 (1.0) 0;0 0.5991 (0.99) 1 1
test_data_status_all_flags-data-new[main] 1.6560 (1.0) 1.6560 (1.0) 1.6560 (1.0) 0.0000 (1.0) 1.6560 (1.0) 0.0000 (1.0) 0;0 0.6039 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 980.2941 (1.00) 980.2941 (1.00) 980.2941 (1.00) 0.0000 (1.0) 980.2941 (1.00) 0.0000 (1.0) 0;0 1.0201 (1.00) 1 1
test_data_status_all_flags-data-noop[3.10.0] 1,007.5881 (1.03) 1,007.5881 (1.03) 1,007.5881 (1.03) 0.0000 (1.0) 1,007.5881 (1.03) 0.0000 (1.0) 0;0 0.9925 (0.97) 1 1
test_data_status_all_flags-data-noop[main] 978.8133 (1.0) 978.8133 (1.0) 978.8133 (1.0) 0.0000 (1.0) 978.8133 (1.0) 0.0000 (1.0) 0;0 1.0216 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.2053 (1.0) 1.2053 (1.0) 1.2053 (1.0) 0.0000 (1.0) 1.2053 (1.0) 0.0000 (1.0) 0;0 0.8297 (1.0) 1 1
test_diff-diff[3.10.0] 1.2284 (1.02) 1.2284 (1.02) 1.2284 (1.02) 0.0000 (1.0) 1.2284 (1.02) 0.0000 (1.0) 0;0 0.8140 (0.98) 1 1
test_diff-diff[main] 1.2528 (1.04) 1.2528 (1.04) 1.2528 (1.04) 0.0000 (1.0) 1.2528 (1.04) 0.0000 (1.0) 0;0 0.7982 (0.96) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 636.8412 (1.06) 636.8412 (1.06) 636.8412 (1.06) 0.0000 (1.0) 636.8412 (1.06) 0.0000 (1.0) 0;0 1.5703 (0.95) 1 1
test_diff-diff-changed[3.10.0] 660.8101 (1.09) 660.8101 (1.09) 660.8101 (1.09) 0.0000 (1.0) 660.8101 (1.09) 0.0000 (1.0) 0;0 1.5133 (0.91) 1 1
test_diff-diff-changed[main] 603.6139 (1.0) 603.6139 (1.0) 603.6139 (1.0) 0.0000 (1.0) 603.6139 (1.0) 0.0000 (1.0) 0;0 1.6567 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 624.1192 (1.03) 624.1192 (1.03) 624.1192 (1.03) 0.0000 (1.0) 624.1192 (1.03) 0.0000 (1.0) 0;0 1.6023 (0.97) 1 1
test_diff-diff-changed-noop[3.10.0] 637.1390 (1.05) 637.1390 (1.05) 637.1390 (1.05) 0.0000 (1.0) 637.1390 (1.05) 0.0000 (1.0) 0;0 1.5695 (0.95) 1 1
test_diff-diff-changed-noop[main] 604.2433 (1.0) 604.2433 (1.0) 604.2433 (1.0) 0.0000 (1.0) 604.2433 (1.0) 0.0000 (1.0) 0;0 1.6550 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 568.4387 (1.0) 568.4387 (1.0) 568.4387 (1.0) 0.0000 (1.0) 568.4387 (1.0) 0.0000 (1.0) 0;0 1.7592 (1.0) 1 1
test_diff-diff-noop[3.10.0] 590.1799 (1.04) 590.1799 (1.04) 590.1799 (1.04) 0.0000 (1.0) 590.1799 (1.04) 0.0000 (1.0) 0;0 1.6944 (0.96) 1 1
test_diff-diff-noop[main] 597.8657 (1.05) 597.8657 (1.05) 597.8657 (1.05) 0.0000 (1.0) 597.8657 (1.05) 0.0000 (1.0) 0;0 1.6726 (0.95) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 885.8108 (1.0) 885.8108 (1.0) 885.8108 (1.0) 0.0000 (1.0) 885.8108 (1.0) 0.0000 (1.0) 0;0 1.1289 (1.0) 1 1
test_exp_show-exp[3.10.0] 5,311.3653 (6.00) 5,311.3653 (6.00) 5,311.3653 (6.00) 0.0000 (1.0) 5,311.3653 (6.00) 0.0000 (1.0) 0;0 0.1883 (0.17) 1 1
test_exp_show-exp[main] 4,966.9738 (5.61) 4,966.9738 (5.61) 4,966.9738 (5.61) 0.0000 (1.0) 4,966.9738 (5.61) 0.0000 (1.0) 0;0 0.2013 (0.18) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 3.9294 (2.10) 3.9294 (2.10) 3.9294 (2.10) 0.0000 (1.0) 3.9294 (2.10) 0.0000 (1.0) 0;0 0.2545 (0.48) 1 1
test_fetch-fetch[3.10.0] 4.3571 (2.33) 4.3571 (2.33) 4.3571 (2.33) 0.0000 (1.0) 4.3571 (2.33) 0.0000 (1.0) 0;0 0.2295 (0.43) 1 1
test_fetch-fetch[main] 1.8690 (1.0) 1.8690 (1.0) 1.8690 (1.0) 0.0000 (1.0) 1.8690 (1.0) 0.0000 (1.0) 0;0 0.5351 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 486.1368 (1.03) 486.1368 (1.03) 486.1368 (1.03) 0.0000 (1.0) 486.1368 (1.03) 0.0000 (1.0) 0;0 2.0570 (0.98) 1 1
test_gc-gc[3.10.0] 493.9803 (1.04) 493.9803 (1.04) 493.9803 (1.04) 0.0000 (1.0) 493.9803 (1.04) 0.0000 (1.0) 0;0 2.0244 (0.96) 1 1
test_gc-gc[main] 474.1680 (1.0) 474.1680 (1.0) 474.1680 (1.0) 0.0000 (1.0) 474.1680 (1.0) 0.0000 (1.0) 0;0 2.1090 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 6.0637 (1.13) 6.0637 (1.13) 6.0637 (1.13) 0.0000 (1.0) 6.0637 (1.13) 0.0000 (1.0) 0;0 0.1649 (0.89) 1 1
test_get-get[3.10.0] 7.1976 (1.34) 7.1976 (1.34) 7.1976 (1.34) 0.0000 (1.0) 7.1976 (1.34) 0.0000 (1.0) 0;0 0.1389 (0.75) 1 1
test_get-get[main] 5.3702 (1.0) 5.3702 (1.0) 5.3702 (1.0) 0.0000 (1.0) 5.3702 (1.0) 0.0000 (1.0) 0;0 0.1862 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 3.0738 (3.33) 3.0738 (3.33) 3.0738 (3.33) 0.0000 (1.0) 3.0738 (3.33) 0.0000 (1.0) 0;0 0.3253 (0.30) 1 1
test_get_url-get-url[3.10.0] 3.1779 (3.45) 3.1779 (3.45) 3.1779 (3.45) 0.0000 (1.0) 3.1779 (3.45) 0.0000 (1.0) 0;0 0.3147 (0.29) 1 1
test_get_url-get-url[main] 0.9218 (1.0) 0.9218 (1.0) 0.9218 (1.0) 0.0000 (1.0) 0.9218 (1.0) 0.0000 (1.0) 0;0 1.0849 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 124.9554 (1.03) 131.4965 (1.05) 126.1787 (1.02) 0.8945 (1.41) 126.1015 (1.02) 0.6798 (1.0) 15;3 7.9253 (0.98) 100 1
test_help---help[3.10.0] 121.9011 (1.0) 124.9686 (1.0) 123.1972 (1.0) 0.6334 (1.0) 123.1076 (1.0) 0.8459 (1.24) 28;2 8.1171 (1.0) 100 1
test_help---help[main] 123.6330 (1.01) 140.2392 (1.12) 125.3270 (1.02) 1.9989 (3.16) 125.0039 (1.02) 0.8437 (1.24) 3;6 7.9791 (0.98) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 9.3056 (1.10) 9.3056 (1.10) 9.3056 (1.10) 0.0000 (1.0) 9.3056 (1.10) 0.0000 (1.0) 0;0 0.1075 (0.91) 1 1
test_import-import[3.10.0] 10.5070 (1.24) 10.5070 (1.24) 10.5070 (1.24) 0.0000 (1.0) 10.5070 (1.24) 0.0000 (1.0) 0;0 0.0952 (0.81) 1 1
test_import-import[main] 8.4746 (1.0) 8.4746 (1.0) 8.4746 (1.0) 0.0000 (1.0) 8.4746 (1.0) 0.0000 (1.0) 0;0 0.1180 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 7.5178 (1.49) 7.5178 (1.49) 7.5178 (1.49) 0.0000 (1.0) 7.5178 (1.49) 0.0000 (1.0) 0;0 0.1330 (0.67) 1 1
test_import_url-import-url[3.10.0] 7.4837 (1.48) 7.4837 (1.48) 7.4837 (1.48) 0.0000 (1.0) 7.4837 (1.48) 0.0000 (1.0) 0;0 0.1336 (0.67) 1 1
test_import_url-import-url[main] 5.0457 (1.0) 5.0457 (1.0) 5.0457 (1.0) 0.0000 (1.0) 5.0457 (1.0) 0.0000 (1.0) 0;0 0.1982 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 360.2809 (1.0) 393.8379 (1.0) 372.6100 (1.0) 6.1632 (1.0) 371.9622 (1.0) 7.5923 (1.0) 31;2 2.6838 (1.0) 100 1
test_init-init[3.10.0] 366.5856 (1.02) 422.0045 (1.07) 383.3164 (1.03) 10.6382 (1.73) 383.0582 (1.03) 13.7317 (1.81) 28;3 2.6088 (0.97) 100 1
test_init-init[main] 366.3654 (1.02) 409.4658 (1.04) 382.8963 (1.03) 7.1567 (1.16) 382.2277 (1.03) 9.0315 (1.19) 21;3 2.6117 (0.97) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 447.1868 (1.14) 447.1868 (1.14) 447.1868 (1.14) 0.0000 (1.0) 447.1868 (1.14) 0.0000 (1.0) 0;0 2.2362 (0.88) 1 1
test_list-list[3.10.0] 406.0333 (1.04) 406.0333 (1.04) 406.0333 (1.04) 0.0000 (1.0) 406.0333 (1.04) 0.0000 (1.0) 0;0 2.4629 (0.97) 1 1
test_list-list[main] 391.9330 (1.0) 391.9330 (1.0) 391.9330 (1.0) 0.0000 (1.0) 391.9330 (1.0) 0.0000 (1.0) 0;0 2.5515 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 388.4075 (1.0) 388.4075 (1.0) 388.4075 (1.0) 0.0000 (1.0) 388.4075 (1.0) 0.0000 (1.0) 0;0 2.5746 (1.0) 1 1
test_list-list-dvc-only[3.10.0] 392.3354 (1.01) 392.3354 (1.01) 392.3354 (1.01) 0.0000 (1.0) 392.3354 (1.01) 0.0000 (1.0) 0;0 2.5488 (0.99) 1 1
test_list-list-dvc-only[main] 391.6531 (1.01) 391.6531 (1.01) 391.6531 (1.01) 0.0000 (1.0) 391.6531 (1.01) 0.0000 (1.0) 0;0 2.5533 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 480.9170 (1.04) 480.9170 (1.04) 480.9170 (1.04) 0.0000 (1.0) 480.9170 (1.04) 0.0000 (1.0) 0;0 2.0794 (0.97) 1 1
test_list-list-recursive[3.10.0] 476.6686 (1.03) 476.6686 (1.03) 476.6686 (1.03) 0.0000 (1.0) 476.6686 (1.03) 0.0000 (1.0) 0;0 2.0979 (0.97) 1 1
test_list-list-recursive[main] 464.3608 (1.0) 464.3608 (1.0) 464.3608 (1.0) 0.0000 (1.0) 464.3608 (1.0) 0.0000 (1.0) 0;0 2.1535 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 400.6623 (1.06) 400.6623 (1.06) 400.6623 (1.06) 0.0000 (1.0) 400.6623 (1.06) 0.0000 (1.0) 0;0 2.4959 (0.94) 1 1
test_list-list-shallow[3.10.0] 391.0483 (1.04) 391.0483 (1.04) 391.0483 (1.04) 0.0000 (1.0) 391.0483 (1.04) 0.0000 (1.0) 0;0 2.5572 (0.96) 1 1
test_list-list-shallow[main] 376.4596 (1.0) 376.4596 (1.0) 376.4596 (1.0) 0.0000 (1.0) 376.4596 (1.0) 0.0000 (1.0) 0;0 2.6563 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.0657 (1.08) 2.0657 (1.08) 2.0657 (1.08) 0.0000 (1.0) 2.0657 (1.08) 0.0000 (1.0) 0;0 0.4841 (0.93) 1 1
test_partial_add-add[3.10.0] 2.0457 (1.07) 2.0457 (1.07) 2.0457 (1.07) 0.0000 (1.0) 2.0457 (1.07) 0.0000 (1.0) 0;0 0.4888 (0.94) 1 1
test_partial_add-add[main] 1.9187 (1.0) 1.9187 (1.0) 1.9187 (1.0) 0.0000 (1.0) 1.9187 (1.0) 0.0000 (1.0) 0;0 0.5212 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 3.0542 (1.07) 3.0542 (1.07) 3.0542 (1.07) 0.0000 (1.0) 3.0542 (1.07) 0.0000 (1.0) 0;0 0.3274 (0.93) 1 1
test_partial_add-add-partial[3.10.0] 3.0683 (1.08) 3.0683 (1.08) 3.0683 (1.08) 0.0000 (1.0) 3.0683 (1.08) 0.0000 (1.0) 0;0 0.3259 (0.93) 1 1
test_partial_add-add-partial[main] 2.8499 (1.0) 2.8499 (1.0) 2.8499 (1.0) 0.0000 (1.0) 2.8499 (1.0) 0.0000 (1.0) 0;0 0.3509 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 560.7597 (1.0) 560.7597 (1.0) 560.7597 (1.0) 0.0000 (1.0) 560.7597 (1.0) 0.0000 (1.0) 0;0 1.7833 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 635.8746 (1.13) 635.8746 (1.13) 635.8746 (1.13) 0.0000 (1.0) 635.8746 (1.13) 0.0000 (1.0) 0;0 1.5726 (0.88) 1 1
test_partial_add-gc-cloud-noop[main] 670.5472 (1.20) 670.5472 (1.20) 670.5472 (1.20) 0.0000 (1.0) 670.5472 (1.20) 0.0000 (1.0) 0;0 1.4913 (0.84) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 474.9822 (1.0) 474.9822 (1.0) 474.9822 (1.0) 0.0000 (1.0) 474.9822 (1.0) 0.0000 (1.0) 0;0 2.1053 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 552.8788 (1.16) 552.8788 (1.16) 552.8788 (1.16) 0.0000 (1.0) 552.8788 (1.16) 0.0000 (1.0) 0;0 1.8087 (0.86) 1 1
test_partial_add-gc-noop[main] 549.7139 (1.16) 549.7139 (1.16) 549.7139 (1.16) 0.0000 (1.0) 549.7139 (1.16) 0.0000 (1.0) 0;0 1.8191 (0.86) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 1.9280 (1.73) 1.9280 (1.73) 1.9280 (1.73) 0.0000 (1.0) 1.9280 (1.73) 0.0000 (1.0) 0;0 0.5187 (0.58) 1 1
test_partial_add-push[3.10.0] 1.1712 (1.05) 1.1712 (1.05) 1.1712 (1.05) 0.0000 (1.0) 1.1712 (1.05) 0.0000 (1.0) 0;0 0.8538 (0.95) 1 1
test_partial_add-push[main] 1.1157 (1.0) 1.1157 (1.0) 1.1157 (1.0) 0.0000 (1.0) 1.1157 (1.0) 0.0000 (1.0) 0;0 0.8963 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 1.9781 (1.63) 1.9781 (1.63) 1.9781 (1.63) 0.0000 (1.0) 1.9781 (1.63) 0.0000 (1.0) 0;0 0.5055 (0.61) 1 1
test_partial_add-push-partial[3.10.0] 1.2145 (1.0) 1.2145 (1.0) 1.2145 (1.0) 0.0000 (1.0) 1.2145 (1.0) 0.0000 (1.0) 0;0 0.8234 (1.0) 1 1
test_partial_add-push-partial[main] 1.2584 (1.04) 1.2584 (1.04) 1.2584 (1.04) 0.0000 (1.0) 1.2584 (1.04) 0.0000 (1.0) 0;0 0.7946 (0.97) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.5342 (1.04) 3.5342 (1.04) 3.5342 (1.04) 0.0000 (1.0) 3.5342 (1.04) 0.0000 (1.0) 0;0 0.2830 (0.96) 1 1
test_partial_remove-add[3.10.0] 3.6754 (1.08) 3.6754 (1.08) 3.6754 (1.08) 0.0000 (1.0) 3.6754 (1.08) 0.0000 (1.0) 0;0 0.2721 (0.92) 1 1
test_partial_remove-add[main] 3.3977 (1.0) 3.3977 (1.0) 3.3977 (1.0) 0.0000 (1.0) 3.3977 (1.0) 0.0000 (1.0) 0;0 0.2943 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.5224 (1.08) 1.5224 (1.08) 1.5224 (1.08) 0.0000 (1.0) 1.5224 (1.08) 0.0000 (1.0) 0;0 0.6569 (0.93) 1 1
test_partial_remove-add-update[3.10.0] 1.5310 (1.08) 1.5310 (1.08) 1.5310 (1.08) 0.0000 (1.0) 1.5310 (1.08) 0.0000 (1.0) 0;0 0.6532 (0.92) 1 1
test_partial_remove-add-update[main] 1.4114 (1.0) 1.4114 (1.0) 1.4114 (1.0) 0.0000 (1.0) 1.4114 (1.0) 0.0000 (1.0) 0;0 0.7085 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 489.9183 (1.0) 489.9183 (1.0) 489.9183 (1.0) 0.0000 (1.0) 489.9183 (1.0) 0.0000 (1.0) 0;0 2.0412 (1.0) 1 1
test_partial_remove-gc[3.10.0] 540.0427 (1.10) 540.0427 (1.10) 540.0427 (1.10) 0.0000 (1.0) 540.0427 (1.10) 0.0000 (1.0) 0;0 1.8517 (0.91) 1 1
test_partial_remove-gc[main] 530.7072 (1.08) 530.7072 (1.08) 530.7072 (1.08) 0.0000 (1.0) 530.7072 (1.08) 0.0000 (1.0) 0;0 1.8843 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 569.7743 (1.0) 569.7743 (1.0) 569.7743 (1.0) 0.0000 (1.0) 569.7743 (1.0) 0.0000 (1.0) 0;0 1.7551 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 613.8157 (1.08) 613.8157 (1.08) 613.8157 (1.08) 0.0000 (1.0) 613.8157 (1.08) 0.0000 (1.0) 0;0 1.6292 (0.93) 1 1
test_partial_remove-gc-cloud[main] 619.5003 (1.09) 619.5003 (1.09) 619.5003 (1.09) 0.0000 (1.0) 619.5003 (1.09) 0.0000 (1.0) 0;0 1.6142 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 3.4157 (2.31) 3.4157 (2.31) 3.4157 (2.31) 0.0000 (1.0) 3.4157 (2.31) 0.0000 (1.0) 0;0 0.2928 (0.43) 1 1
test_partial_remove-push[3.10.0] 1.9059 (1.29) 1.9059 (1.29) 1.9059 (1.29) 0.0000 (1.0) 1.9059 (1.29) 0.0000 (1.0) 0;0 0.5247 (0.78) 1 1
test_partial_remove-push[main] 1.4779 (1.0) 1.4779 (1.0) 1.4779 (1.0) 0.0000 (1.0) 1.4779 (1.0) 0.0000 (1.0) 0;0 0.6767 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 481.9081 (1.02) 481.9081 (1.02) 481.9081 (1.02) 0.0000 (1.0) 481.9081 (1.02) 0.0000 (1.0) 0;0 2.0751 (0.98) 1 1
test_partial_remove-push-update[3.10.0] 473.4320 (1.0) 473.4320 (1.0) 473.4320 (1.0) 0.0000 (1.0) 473.4320 (1.0) 0.0000 (1.0) 0;0 2.1122 (1.0) 1 1
test_partial_remove-push-update[main] 774.5360 (1.64) 774.5360 (1.64) 774.5360 (1.64) 0.0000 (1.0) 774.5360 (1.64) 0.0000 (1.0) 0;0 1.2911 (0.61) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 421.0752 (1.0) 434.8813 (1.0) 427.5439 (1.0) 6.0787 (1.0) 427.2616 (1.0) 11.0904 (1.0) 2;0 2.3389 (1.0) 5 3
test_plots-plots-diff[3.10.0] 909.9014 (2.16) 934.2798 (2.15) 920.5084 (2.15) 10.4686 (1.72) 920.6340 (2.15) 18.2241 (1.64) 2;0 1.0864 (0.46) 5 3
test_plots-plots-diff[main] 863.2507 (2.05) 880.2629 (2.02) 872.6288 (2.04) 6.9342 (1.14) 872.4160 (2.04) 11.3003 (1.02) 2;0 1.1460 (0.49) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 428.1408 (1.0) 455.7695 (1.0) 440.9159 (1.0) 9.8360 (1.0) 440.1585 (1.0) 8.2958 (1.0) 2;0 2.2680 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,201.0211 (2.81) 1,232.0090 (2.70) 1,211.0558 (2.75) 12.6397 (1.29) 1,207.5176 (2.74) 15.9327 (1.92) 1;0 0.8257 (0.36) 5 3
test_plots-plots-diff-json[main] 952.1847 (2.22) 978.3494 (2.15) 966.5633 (2.19) 11.4743 (1.17) 963.8230 (2.19) 19.9264 (2.40) 3;0 1.0346 (0.46) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 388.4123 (1.0) 400.8437 (1.0) 394.3420 (1.0) 5.8330 (1.0) 394.2976 (1.0) 11.2217 (1.04) 2;0 2.5359 (1.0) 5 3
test_plots-plots-show[3.10.0] 754.2736 (1.94) 800.1204 (2.00) 769.2995 (1.95) 17.9436 (3.08) 765.8260 (1.94) 16.6812 (1.55) 1;1 1.2999 (0.51) 5 3
test_plots-plots-show[main] 737.7902 (1.90) 751.9133 (1.88) 744.2557 (1.89) 6.0763 (1.04) 743.6881 (1.89) 10.7813 (1.0) 2;0 1.3436 (0.53) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 390.6167 (1.0) 398.2404 (1.0) 394.8535 (1.0) 2.9402 (1.0) 394.8831 (1.0) 4.2347 (1.0) 2;0 2.5326 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 916.9351 (2.35) 951.1928 (2.39) 933.7042 (2.36) 15.4657 (5.26) 938.2603 (2.38) 27.9785 (6.61) 3;0 1.0710 (0.42) 5 3
test_plots-plots-show-json[main] 784.6047 (2.01) 800.0752 (2.01) 791.3264 (2.00) 6.0934 (2.07) 789.1623 (2.00) 8.8543 (2.09) 2;0 1.2637 (0.50) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 3.4176 (2.44) 3.4176 (2.44) 3.4176 (2.44) 0.0000 (1.0) 3.4176 (2.44) 0.0000 (1.0) 0;0 0.2926 (0.41) 1 1
test_push-push[3.10.0] 1.9024 (1.36) 1.9024 (1.36) 1.9024 (1.36) 0.0000 (1.0) 1.9024 (1.36) 0.0000 (1.0) 0;0 0.5256 (0.74) 1 1
test_push-push[main] 1.4010 (1.0) 1.4010 (1.0) 1.4010 (1.0) 0.0000 (1.0) 1.4010 (1.0) 0.0000 (1.0) 0;0 0.7138 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2] 3.6185 (1.07) 3.6185 (1.07) 3.6185 (1.07) 0.0000 (1.0) 3.6185 (1.07) 0.0000 (1.0) 0;0 0.2764 (0.93) 1 1
test_sharing-add[3.10.0] 3.5639 (1.06) 3.5639 (1.06) 3.5639 (1.06) 0.0000 (1.0) 3.5639 (1.06) 0.0000 (1.0) 0;0 0.2806 (0.95) 1 1
test_sharing-add[main] 3.3685 (1.0) 3.3685 (1.0) 3.3685 (1.0) 0.0000 (1.0) 3.3685 (1.0) 0.0000 (1.0) 0;0 0.2969 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2] 2.4673 (1.10) 2.4673 (1.10) 2.4673 (1.10) 0.0000 (1.0) 2.4673 (1.10) 0.0000 (1.0) 0;0 0.4053 (0.91) 1 1
test_sharing-add-noop[3.10.0] 2.4209 (1.08) 2.4209 (1.08) 2.4209 (1.08) 0.0000 (1.0) 2.4209 (1.08) 0.0000 (1.0) 0;0 0.4131 (0.93) 1 1
test_sharing-add-noop[main] 2.2394 (1.0) 2.2394 (1.0) 2.2394 (1.0) 0.0000 (1.0) 2.2394 (1.0) 0.0000 (1.0) 0;0 0.4465 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2] 1.7433 (1.27) 1.7433 (1.27) 1.7433 (1.27) 0.0000 (1.0) 1.7433 (1.27) 0.0000 (1.0) 0;0 0.5736 (0.79) 1 1
test_sharing-checkout[3.10.0] 3.7065 (2.70) 3.7065 (2.70) 3.7065 (2.70) 0.0000 (1.0) 3.7065 (2.70) 0.0000 (1.0) 0;0 0.2698 (0.37) 1 1
test_sharing-checkout[main] 1.3750 (1.0) 1.3750 (1.0) 1.3750 (1.0) 0.0000 (1.0) 1.3750 (1.0) 0.0000 (1.0) 0;0 0.7273 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2] 562.7895 (1.02) 562.7895 (1.02) 562.7895 (1.02) 0.0000 (1.0) 562.7895 (1.02) 0.0000 (1.0) 0;0 1.7769 (0.98) 1 1
test_sharing-checkout-noop[3.10.0] 564.8650 (1.03) 564.8650 (1.03) 564.8650 (1.03) 0.0000 (1.0) 564.8650 (1.03) 0.0000 (1.0) 0;0 1.7703 (0.97) 1 1
test_sharing-checkout-noop[main] 549.1490 (1.0) 549.1490 (1.0) 549.1490 (1.0) 0.0000 (1.0) 549.1490 (1.0) 0.0000 (1.0) 0;0 1.8210 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 3.9042 (2.13) 3.9042 (2.13) 3.9042 (2.13) 0.0000 (1.0) 3.9042 (2.13) 0.0000 (1.0) 0;0 0.2561 (0.47) 1 1
test_sharing-fetch[3.10.0] 4.2796 (2.33) 4.2796 (2.33) 4.2796 (2.33) 0.0000 (1.0) 4.2796 (2.33) 0.0000 (1.0) 0;0 0.2337 (0.43) 1 1
test_sharing-fetch[main] 1.8360 (1.0) 1.8360 (1.0) 1.8360 (1.0) 0.0000 (1.0) 1.8360 (1.0) 0.0000 (1.0) 0;0 0.5447 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 427.7256 (1.0) 427.7256 (1.0) 427.7256 (1.0) 0.0000 (1.0) 427.7256 (1.0) 0.0000 (1.0) 0;0 2.3379 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 503.4886 (1.18) 503.4886 (1.18) 503.4886 (1.18) 0.0000 (1.0) 503.4886 (1.18) 0.0000 (1.0) 0;0 1.9861 (0.85) 1 1
test_sharing-fetch-noop[main] 817.9454 (1.91) 817.9454 (1.91) 817.9454 (1.91) 0.0000 (1.0) 817.9454 (1.91) 0.0000 (1.0) 0;0 1.2226 (0.52) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 3.4214 (2.37) 3.4214 (2.37) 3.4214 (2.37) 0.0000 (1.0) 3.4214 (2.37) 0.0000 (1.0) 0;0 0.2923 (0.42) 1 1
test_sharing-push[3.10.0] 1.9187 (1.33) 1.9187 (1.33) 1.9187 (1.33) 0.0000 (1.0) 1.9187 (1.33) 0.0000 (1.0) 0;0 0.5212 (0.75) 1 1
test_sharing-push[main] 1.4440 (1.0) 1.4440 (1.0) 1.4440 (1.0) 0.0000 (1.0) 1.4440 (1.0) 0.0000 (1.0) 0;0 0.6925 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 446.4129 (1.04) 446.4129 (1.04) 446.4129 (1.04) 0.0000 (1.0) 446.4129 (1.04) 0.0000 (1.0) 0;0 2.2401 (0.96) 1 1
test_sharing-push-noop[3.10.0] 429.7007 (1.0) 429.7007 (1.0) 429.7007 (1.0) 0.0000 (1.0) 429.7007 (1.0) 0.0000 (1.0) 0;0 2.3272 (1.0) 1 1
test_sharing-push-noop[main] 802.3540 (1.87) 802.3540 (1.87) 802.3540 (1.87) 0.0000 (1.0) 802.3540 (1.87) 0.0000 (1.0) 0;0 1.2463 (0.54) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.2727 (1.08) 1.2727 (1.08) 1.2727 (1.08) 0.0000 (1.0) 1.2727 (1.08) 0.0000 (1.0) 0;0 0.7858 (0.92) 1 1
test_status-status[3.10.0] 1.2063 (1.03) 1.2063 (1.03) 1.2063 (1.03) 0.0000 (1.0) 1.2063 (1.03) 0.0000 (1.0) 0;0 0.8290 (0.97) 1 1
test_status-status[main] 1.1749 (1.0) 1.1749 (1.0) 1.1749 (1.0) 0.0000 (1.0) 1.1749 (1.0) 0.0000 (1.0) 0;0 0.8511 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 537.0325 (1.02) 537.0325 (1.02) 537.0325 (1.02) 0.0000 (1.0) 537.0325 (1.02) 0.0000 (1.0) 0;0 1.8621 (0.98) 1 1
test_status-status-changed[3.10.0] 537.7211 (1.02) 537.7211 (1.02) 537.7211 (1.02) 0.0000 (1.0) 537.7211 (1.02) 0.0000 (1.0) 0;0 1.8597 (0.98) 1 1
test_status-status-changed[main] 528.1449 (1.0) 528.1449 (1.0) 528.1449 (1.0) 0.0000 (1.0) 528.1449 (1.0) 0.0000 (1.0) 0;0 1.8934 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 528.3366 (1.00) 528.3366 (1.00) 528.3366 (1.00) 0.0000 (1.0) 528.3366 (1.00) 0.0000 (1.0) 0;0 1.8927 (1.00) 1 1
test_status-status-changed-noop[3.10.0] 538.1415 (1.02) 538.1415 (1.02) 538.1415 (1.02) 0.0000 (1.0) 538.1415 (1.02) 0.0000 (1.0) 0;0 1.8582 (0.98) 1 1
test_status-status-changed-noop[main] 527.7370 (1.0) 527.7370 (1.0) 527.7370 (1.0) 0.0000 (1.0) 527.7370 (1.0) 0.0000 (1.0) 0;0 1.8949 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 528.9466 (1.01) 528.9466 (1.01) 528.9466 (1.01) 0.0000 (1.0) 528.9466 (1.01) 0.0000 (1.0) 0;0 1.8906 (0.99) 1 1
test_status-status-noop[3.10.0] 539.8959 (1.03) 539.8959 (1.03) 539.8959 (1.03) 0.0000 (1.0) 539.8959 (1.03) 0.0000 (1.0) 0;0 1.8522 (0.97) 1 1
test_status-status-noop[main] 526.1958 (1.0) 526.1958 (1.0) 526.1958 (1.0) 0.0000 (1.0) 526.1958 (1.0) 0.0000 (1.0) 0;0 1.9004 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 7.5219 (1.44) 7.5219 (1.44) 7.5219 (1.44) 0.0000 (1.0) 7.5219 (1.44) 0.0000 (1.0) 0;0 0.1329 (0.69) 1 1
test_update-import-url[3.10.0] 7.8035 (1.50) 7.8035 (1.50) 7.8035 (1.50) 0.0000 (1.0) 7.8035 (1.50) 0.0000 (1.0) 0;0 0.1281 (0.67) 1 1
test_update-import-url[main] 5.2135 (1.0) 5.2135 (1.0) 5.2135 (1.0) 0.0000 (1.0) 5.2135 (1.0) 0.0000 (1.0) 0;0 0.1918 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 6.7392 (1.51) 6.7392 (1.51) 6.7392 (1.51) 0.0000 (1.0) 6.7392 (1.51) 0.0000 (1.0) 0;0 0.1484 (0.66) 1 1
test_update-update[3.10.0] 6.9284 (1.55) 6.9284 (1.55) 6.9284 (1.55) 0.0000 (1.0) 6.9284 (1.55) 0.0000 (1.0) 0;0 0.1443 (0.64) 1 1
test_update-update[main] 4.4595 (1.0) 4.4595 (1.0) 4.4595 (1.0) 0.0000 (1.0) 4.4595 (1.0) 0.0000 (1.0) 0;0 0.2242 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 971.7396 (1.0) 971.7396 (1.0) 971.7396 (1.0) 0.0000 (1.0) 971.7396 (1.0) 0.0000 (1.0) 0;0 1.0291 (1.0) 1 1
test_update-update-noop[3.10.0] 1,031.2892 (1.06) 1,031.2892 (1.06) 1,031.2892 (1.06) 0.0000 (1.0) 1,031.2892 (1.06) 0.0000 (1.0) 0;0 0.9697 (0.94) 1 1
test_update-update-noop[main] 1,000.6608 (1.03) 1,000.6608 (1.03) 1,000.6608 (1.03) 0.0000 (1.0) 1,000.6608 (1.03) 0.0000 (1.0) 0;0 0.9993 (0.97) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
updates: