github-actions[bot]
commented
3 months ago
Mon Aug 5 20:24:29 UTC 2024
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2] 3.6119 (1.05) 3.6119 (1.05) 3.6119 (1.05) 0.0000 (1.0) 3.6119 (1.05) 0.0000 (1.0) 0;0 0.2769 (0.95) 1 1
test_add-add[3.10.0] 3.6583 (1.06) 3.6583 (1.06) 3.6583 (1.06) 0.0000 (1.0) 3.6583 (1.06) 0.0000 (1.0) 0;0 0.2733 (0.94) 1 1
test_add-add[main] 3.4431 (1.0) 3.4431 (1.0) 3.4431 (1.0) 0.0000 (1.0) 3.4431 (1.0) 0.0000 (1.0) 0;0 0.2904 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 1.9380 (1.20) 1.9380 (1.20) 1.9380 (1.20) 0.0000 (1.0) 1.9380 (1.20) 0.0000 (1.0) 0;0 0.5160 (0.83) 1 1
test_checkout_copy-checkout[3.10.0] 3.9528 (2.45) 3.9528 (2.45) 3.9528 (2.45) 0.0000 (1.0) 3.9528 (2.45) 0.0000 (1.0) 0;0 0.2530 (0.41) 1 1
test_checkout_copy-checkout[main] 1.6166 (1.0) 1.6166 (1.0) 1.6166 (1.0) 0.0000 (1.0) 1.6166 (1.0) 0.0000 (1.0) 0;0 0.6186 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 595.6159 (1.06) 595.6159 (1.06) 595.6159 (1.06) 0.0000 (1.0) 595.6159 (1.06) 0.0000 (1.0) 0;0 1.6789 (0.95) 1 1
test_checkout_copy-checkout-noop[3.10.0] 595.5216 (1.06) 595.5216 (1.06) 595.5216 (1.06) 0.0000 (1.0) 595.5216 (1.06) 0.0000 (1.0) 0;0 1.6792 (0.95) 1 1
test_checkout_copy-checkout-noop[main] 564.0503 (1.0) 564.0503 (1.0) 564.0503 (1.0) 0.0000 (1.0) 564.0503 (1.0) 0.0000 (1.0) 0;0 1.7729 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 727.2776 (1.15) 727.2776 (1.15) 727.2776 (1.15) 0.0000 (1.0) 727.2776 (1.15) 0.0000 (1.0) 0;0 1.3750 (0.87) 1 1
test_checkout_copy-checkout-update[3.10.0] 656.1884 (1.04) 656.1884 (1.04) 656.1884 (1.04) 0.0000 (1.0) 656.1884 (1.04) 0.0000 (1.0) 0;0 1.5240 (0.96) 1 1
test_checkout_copy-checkout-update[main] 632.0988 (1.0) 632.0988 (1.0) 632.0988 (1.0) 0.0000 (1.0) 632.0988 (1.0) 0.0000 (1.0) 0;0 1.5820 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.2715 (1.21) 1.2715 (1.21) 1.2715 (1.21) 0.0000 (1.0) 1.2715 (1.21) 0.0000 (1.0) 0;0 0.7865 (0.82) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.1324 (1.08) 1.1324 (1.08) 1.1324 (1.08) 0.0000 (1.0) 1.1324 (1.08) 0.0000 (1.0) 0;0 0.8830 (0.92) 1 1
test_checkout_hardlink-checkout[main] 1.0473 (1.0) 1.0473 (1.0) 1.0473 (1.0) 0.0000 (1.0) 1.0473 (1.0) 0.0000 (1.0) 0;0 0.9548 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 579.8738 (1.03) 579.8738 (1.03) 579.8738 (1.03) 0.0000 (1.0) 579.8738 (1.03) 0.0000 (1.0) 0;0 1.7245 (0.97) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 598.4197 (1.06) 598.4197 (1.06) 598.4197 (1.06) 0.0000 (1.0) 598.4197 (1.06) 0.0000 (1.0) 0;0 1.6711 (0.94) 1 1
test_checkout_hardlink-checkout-noop[main] 563.9209 (1.0) 563.9209 (1.0) 563.9209 (1.0) 0.0000 (1.0) 563.9209 (1.0) 0.0000 (1.0) 0;0 1.7733 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 731.5911 (1.15) 731.5911 (1.15) 731.5911 (1.15) 0.0000 (1.0) 731.5911 (1.15) 0.0000 (1.0) 0;0 1.3669 (0.87) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 660.3296 (1.04) 660.3296 (1.04) 660.3296 (1.04) 0.0000 (1.0) 660.3296 (1.04) 0.0000 (1.0) 0;0 1.5144 (0.96) 1 1
test_checkout_hardlink-checkout-update[main] 634.9502 (1.0) 634.9502 (1.0) 634.9502 (1.0) 0.0000 (1.0) 634.9502 (1.0) 0.0000 (1.0) 0;0 1.5749 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.3638 (1.17) 1.3638 (1.17) 1.3638 (1.17) 0.0000 (1.0) 1.3638 (1.17) 0.0000 (1.0) 0;0 0.7332 (0.85) 1 1
test_checkout_symlink-checkout[3.10.0] 1.1878 (1.02) 1.1878 (1.02) 1.1878 (1.02) 0.0000 (1.0) 1.1878 (1.02) 0.0000 (1.0) 0;0 0.8419 (0.98) 1 1
test_checkout_symlink-checkout[main] 1.1636 (1.0) 1.1636 (1.0) 1.1636 (1.0) 0.0000 (1.0) 1.1636 (1.0) 0.0000 (1.0) 0;0 0.8594 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 591.2392 (1.0) 591.2392 (1.0) 591.2392 (1.0) 0.0000 (1.0) 591.2392 (1.0) 0.0000 (1.0) 0;0 1.6914 (1.0) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 614.5899 (1.04) 614.5899 (1.04) 614.5899 (1.04) 0.0000 (1.0) 614.5899 (1.04) 0.0000 (1.0) 0;0 1.6271 (0.96) 1 1
test_checkout_symlink-checkout-noop[main] 597.1520 (1.01) 597.1520 (1.01) 597.1520 (1.01) 0.0000 (1.0) 597.1520 (1.01) 0.0000 (1.0) 0;0 1.6746 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 767.9576 (1.11) 767.9576 (1.11) 767.9576 (1.11) 0.0000 (1.0) 767.9576 (1.11) 0.0000 (1.0) 0;0 1.3022 (0.90) 1 1
test_checkout_symlink-checkout-update[3.10.0] 694.6763 (1.0) 694.6763 (1.0) 694.6763 (1.0) 0.0000 (1.0) 694.6763 (1.0) 0.0000 (1.0) 0;0 1.4395 (1.0) 1 1
test_checkout_symlink-checkout-update[main] 698.0442 (1.00) 698.0442 (1.00) 698.0442 (1.00) 0.0000 (1.0) 698.0442 (1.00) 0.0000 (1.0) 0;0 1.4326 (1.00) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 594.0291 (1.04) 594.0291 (1.04) 594.0291 (1.04) 0.0000 (1.0) 594.0291 (1.04) 0.0000 (1.0) 0;0 1.6834 (0.96) 1 1
test_data_status-data-changed[3.10.0] 589.5839 (1.03) 589.5839 (1.03) 589.5839 (1.03) 0.0000 (1.0) 589.5839 (1.03) 0.0000 (1.0) 0;0 1.6961 (0.97) 1 1
test_data_status-data-changed[main] 573.1578 (1.0) 573.1578 (1.0) 573.1578 (1.0) 0.0000 (1.0) 573.1578 (1.0) 0.0000 (1.0) 0;0 1.7447 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 606.5449 (1.05) 606.5449 (1.05) 606.5449 (1.05) 0.0000 (1.0) 606.5449 (1.05) 0.0000 (1.0) 0;0 1.6487 (0.95) 1 1
test_data_status-data-changed-noop[3.10.0] 575.5681 (1.0) 575.5681 (1.0) 575.5681 (1.0) 0.0000 (1.0) 575.5681 (1.0) 0.0000 (1.0) 0;0 1.7374 (1.0) 1 1
test_data_status-data-changed-noop[main] 576.7837 (1.00) 576.7837 (1.00) 576.7837 (1.00) 0.0000 (1.0) 576.7837 (1.00) 0.0000 (1.0) 0;0 1.7338 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.2751 (1.05) 1.2751 (1.05) 1.2751 (1.05) 0.0000 (1.0) 1.2751 (1.05) 0.0000 (1.0) 0;0 0.7843 (0.96) 1 1
test_data_status-data-new[3.10.0] 1.3011 (1.07) 1.3011 (1.07) 1.3011 (1.07) 0.0000 (1.0) 1.3011 (1.07) 0.0000 (1.0) 0;0 0.7686 (0.94) 1 1
test_data_status-data-new[main] 1.2186 (1.0) 1.2186 (1.0) 1.2186 (1.0) 0.0000 (1.0) 1.2186 (1.0) 0.0000 (1.0) 0;0 0.8206 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 642.3750 (1.13) 642.3750 (1.13) 642.3750 (1.13) 0.0000 (1.0) 642.3750 (1.13) 0.0000 (1.0) 0;0 1.5567 (0.89) 1 1
test_data_status-data-noop[3.10.0] 589.7925 (1.04) 589.7925 (1.04) 589.7925 (1.04) 0.0000 (1.0) 589.7925 (1.04) 0.0000 (1.0) 0;0 1.6955 (0.97) 1 1
test_data_status-data-noop[main] 569.5753 (1.0) 569.5753 (1.0) 569.5753 (1.0) 0.0000 (1.0) 569.5753 (1.0) 0.0000 (1.0) 0;0 1.7557 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.2126 (1.09) 1.2126 (1.09) 1.2126 (1.09) 0.0000 (1.0) 1.2126 (1.09) 0.0000 (1.0) 0;0 0.8247 (0.92) 1 1
test_data_status_all_flags-data-changed[3.10.0] 1.1183 (1.01) 1.1183 (1.01) 1.1183 (1.01) 0.0000 (1.0) 1.1183 (1.01) 0.0000 (1.0) 0;0 0.8942 (0.99) 1 1
test_data_status_all_flags-data-changed[main] 1.1126 (1.0) 1.1126 (1.0) 1.1126 (1.0) 0.0000 (1.0) 1.1126 (1.0) 0.0000 (1.0) 0;0 0.8988 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.1608 (1.04) 1.1608 (1.04) 1.1608 (1.04) 0.0000 (1.0) 1.1608 (1.04) 0.0000 (1.0) 0;0 0.8614 (0.96) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 1.1871 (1.07) 1.1871 (1.07) 1.1871 (1.07) 0.0000 (1.0) 1.1871 (1.07) 0.0000 (1.0) 0;0 0.8424 (0.94) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.1118 (1.0) 1.1118 (1.0) 1.1118 (1.0) 0.0000 (1.0) 1.1118 (1.0) 0.0000 (1.0) 0;0 0.8995 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 1.8038 (1.00) 1.8038 (1.00) 1.8038 (1.00) 0.0000 (1.0) 1.8038 (1.00) 0.0000 (1.0) 0;0 0.5544 (1.00) 1 1
test_data_status_all_flags-data-new[3.10.0] 1.8133 (1.01) 1.8133 (1.01) 1.8133 (1.01) 0.0000 (1.0) 1.8133 (1.01) 0.0000 (1.0) 0;0 0.5515 (0.99) 1 1
test_data_status_all_flags-data-new[main] 1.7987 (1.0) 1.7987 (1.0) 1.7987 (1.0) 0.0000 (1.0) 1.7987 (1.0) 0.0000 (1.0) 0;0 0.5560 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 1.0955 (1.00) 1.0955 (1.00) 1.0955 (1.00) 0.0000 (1.0) 1.0955 (1.00) 0.0000 (1.0) 0;0 0.9129 (1.00) 1 1
test_data_status_all_flags-data-noop[3.10.0] 1.0926 (1.0) 1.0926 (1.0) 1.0926 (1.0) 0.0000 (1.0) 1.0926 (1.0) 0.0000 (1.0) 0;0 0.9152 (1.0) 1 1
test_data_status_all_flags-data-noop[main] 1.0938 (1.00) 1.0938 (1.00) 1.0938 (1.00) 0.0000 (1.0) 1.0938 (1.00) 0.0000 (1.0) 0;0 0.9142 (1.00) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.2446 (1.0) 1.2446 (1.0) 1.2446 (1.0) 0.0000 (1.0) 1.2446 (1.0) 0.0000 (1.0) 0;0 0.8035 (1.0) 1 1
test_diff-diff[3.10.0] 1.2712 (1.02) 1.2712 (1.02) 1.2712 (1.02) 0.0000 (1.0) 1.2712 (1.02) 0.0000 (1.0) 0;0 0.7867 (0.98) 1 1
test_diff-diff[main] 1.3140 (1.06) 1.3140 (1.06) 1.3140 (1.06) 0.0000 (1.0) 1.3140 (1.06) 0.0000 (1.0) 0;0 0.7610 (0.95) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 653.3058 (1.03) 653.3058 (1.03) 653.3058 (1.03) 0.0000 (1.0) 653.3058 (1.03) 0.0000 (1.0) 0;0 1.5307 (0.98) 1 1
test_diff-diff-changed[3.10.0] 689.9542 (1.08) 689.9542 (1.08) 689.9542 (1.08) 0.0000 (1.0) 689.9542 (1.08) 0.0000 (1.0) 0;0 1.4494 (0.92) 1 1
test_diff-diff-changed[main] 637.2099 (1.0) 637.2099 (1.0) 637.2099 (1.0) 0.0000 (1.0) 637.2099 (1.0) 0.0000 (1.0) 0;0 1.5693 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 627.8686 (1.01) 627.8686 (1.01) 627.8686 (1.01) 0.0000 (1.0) 627.8686 (1.01) 0.0000 (1.0) 0;0 1.5927 (0.99) 1 1
test_diff-diff-changed-noop[3.10.0] 660.1608 (1.06) 660.1608 (1.06) 660.1608 (1.06) 0.0000 (1.0) 660.1608 (1.06) 0.0000 (1.0) 0;0 1.5148 (0.94) 1 1
test_diff-diff-changed-noop[main] 623.7074 (1.0) 623.7074 (1.0) 623.7074 (1.0) 0.0000 (1.0) 623.7074 (1.0) 0.0000 (1.0) 0;0 1.6033 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 589.7745 (1.0) 589.7745 (1.0) 589.7745 (1.0) 0.0000 (1.0) 589.7745 (1.0) 0.0000 (1.0) 0;0 1.6956 (1.0) 1 1
test_diff-diff-noop[3.10.0] 625.0929 (1.06) 625.0929 (1.06) 625.0929 (1.06) 0.0000 (1.0) 625.0929 (1.06) 0.0000 (1.0) 0;0 1.5998 (0.94) 1 1
test_diff-diff-noop[main] 629.8112 (1.07) 629.8112 (1.07) 629.8112 (1.07) 0.0000 (1.0) 629.8112 (1.07) 0.0000 (1.0) 0;0 1.5878 (0.94) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 911.4679 (1.0) 911.4679 (1.0) 911.4679 (1.0) 0.0000 (1.0) 911.4679 (1.0) 0.0000 (1.0) 0;0 1.0971 (1.0) 1 1
test_exp_show-exp[3.10.0] 7,706.8460 (8.46) 7,706.8460 (8.46) 7,706.8460 (8.46) 0.0000 (1.0) 7,706.8460 (8.46) 0.0000 (1.0) 0;0 0.1298 (0.12) 1 1
test_exp_show-exp[main] 6,232.9476 (6.84) 6,232.9476 (6.84) 6,232.9476 (6.84) 0.0000 (1.0) 6,232.9476 (6.84) 0.0000 (1.0) 0;0 0.1604 (0.15) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 3.8976 (2.10) 3.8976 (2.10) 3.8976 (2.10) 0.0000 (1.0) 3.8976 (2.10) 0.0000 (1.0) 0;0 0.2566 (0.48) 1 1
test_fetch-fetch[3.10.0] 4.3172 (2.33) 4.3172 (2.33) 4.3172 (2.33) 0.0000 (1.0) 4.3172 (2.33) 0.0000 (1.0) 0;0 0.2316 (0.43) 1 1
test_fetch-fetch[main] 1.8523 (1.0) 1.8523 (1.0) 1.8523 (1.0) 0.0000 (1.0) 1.8523 (1.0) 0.0000 (1.0) 0;0 0.5399 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 525.1164 (1.02) 525.1164 (1.02) 525.1164 (1.02) 0.0000 (1.0) 525.1164 (1.02) 0.0000 (1.0) 0;0 1.9043 (0.98) 1 1
test_gc-gc[3.10.0] 543.8090 (1.05) 543.8090 (1.05) 543.8090 (1.05) 0.0000 (1.0) 543.8090 (1.05) 0.0000 (1.0) 0;0 1.8389 (0.95) 1 1
test_gc-gc[main] 516.2826 (1.0) 516.2826 (1.0) 516.2826 (1.0) 0.0000 (1.0) 516.2826 (1.0) 0.0000 (1.0) 0;0 1.9369 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 5.9438 (1.14) 5.9438 (1.14) 5.9438 (1.14) 0.0000 (1.0) 5.9438 (1.14) 0.0000 (1.0) 0;0 0.1682 (0.88) 1 1
test_get-get[3.10.0] 6.9976 (1.34) 6.9976 (1.34) 6.9976 (1.34) 0.0000 (1.0) 6.9976 (1.34) 0.0000 (1.0) 0;0 0.1429 (0.74) 1 1
test_get-get[main] 5.2132 (1.0) 5.2132 (1.0) 5.2132 (1.0) 0.0000 (1.0) 5.2132 (1.0) 0.0000 (1.0) 0;0 0.1918 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 3.0859 (3.26) 3.0859 (3.26) 3.0859 (3.26) 0.0000 (1.0) 3.0859 (3.26) 0.0000 (1.0) 0;0 0.3240 (0.31) 1 1
test_get_url-get-url[3.10.0] 3.1812 (3.36) 3.1812 (3.36) 3.1812 (3.36) 0.0000 (1.0) 3.1812 (3.36) 0.0000 (1.0) 0;0 0.3144 (0.30) 1 1
test_get_url-get-url[main] 0.9479 (1.0) 0.9479 (1.0) 0.9479 (1.0) 0.0000 (1.0) 0.9479 (1.0) 0.0000 (1.0) 0;0 1.0550 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 127.5991 (1.02) 137.2665 (1.02) 131.1680 (1.02) 2.0095 (1.02) 130.9120 (1.02) 2.8773 (1.17) 34;1 7.6238 (0.98) 100 1
test_help---help[3.10.0] 124.8453 (1.0) 134.3917 (1.0) 128.3513 (1.0) 1.9617 (1.0) 127.8336 (1.0) 2.8966 (1.17) 32;1 7.7911 (1.0) 100 1
test_help---help[main] 127.2678 (1.02) 144.5095 (1.08) 130.7858 (1.02) 2.3269 (1.19) 130.5329 (1.02) 2.4684 (1.0) 24;2 7.6461 (0.98) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 9.3396 (1.0) 9.3396 (1.0) 9.3396 (1.0) 0.0000 (1.0) 9.3396 (1.0) 0.0000 (1.0) 0;0 0.1071 (1.0) 1 1
test_import-import[3.10.0] 10.7711 (1.15) 10.7711 (1.15) 10.7711 (1.15) 0.0000 (1.0) 10.7711 (1.15) 0.0000 (1.0) 0;0 0.0928 (0.87) 1 1
test_import-import[main] 13.7968 (1.48) 13.7968 (1.48) 13.7968 (1.48) 0.0000 (1.0) 13.7968 (1.48) 0.0000 (1.0) 0;0 0.0725 (0.68) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 7.6452 (1.46) 7.6452 (1.46) 7.6452 (1.46) 0.0000 (1.0) 7.6452 (1.46) 0.0000 (1.0) 0;0 0.1308 (0.68) 1 1
test_import_url-import-url[3.10.0] 8.5643 (1.64) 8.5643 (1.64) 8.5643 (1.64) 0.0000 (1.0) 8.5643 (1.64) 0.0000 (1.0) 0;0 0.1168 (0.61) 1 1
test_import_url-import-url[main] 5.2230 (1.0) 5.2230 (1.0) 5.2230 (1.0) 0.0000 (1.0) 5.2230 (1.0) 0.0000 (1.0) 0;0 0.1915 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 357.8650 (1.0) 391.1987 (1.0) 364.0047 (1.0) 4.9196 (1.0) 362.7669 (1.0) 3.7855 (1.0) 14;9 2.7472 (1.0) 100 1
test_init-init[3.10.0] 365.4249 (1.02) 408.9060 (1.05) 376.1172 (1.03) 10.0813 (2.05) 373.1747 (1.03) 9.6995 (2.56) 17;7 2.6587 (0.97) 100 1
test_init-init[main] 366.5424 (1.02) 450.2373 (1.15) 373.5761 (1.03) 9.7345 (1.98) 371.4035 (1.02) 4.6319 (1.22) 6;6 2.6768 (0.97) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 456.9079 (1.09) 456.9079 (1.09) 456.9079 (1.09) 0.0000 (1.0) 456.9079 (1.09) 0.0000 (1.0) 0;0 2.1886 (0.92) 1 1
test_list-list[3.10.0] 446.1019 (1.06) 446.1019 (1.06) 446.1019 (1.06) 0.0000 (1.0) 446.1019 (1.06) 0.0000 (1.0) 0;0 2.2416 (0.94) 1 1
test_list-list[main] 420.9532 (1.0) 420.9532 (1.0) 420.9532 (1.0) 0.0000 (1.0) 420.9532 (1.0) 0.0000 (1.0) 0;0 2.3756 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 441.3802 (1.10) 441.3802 (1.10) 441.3802 (1.10) 0.0000 (1.0) 441.3802 (1.10) 0.0000 (1.0) 0;0 2.2656 (0.91) 1 1
test_list-list-dvc-only[3.10.0] 406.4344 (1.02) 406.4344 (1.02) 406.4344 (1.02) 0.0000 (1.0) 406.4344 (1.02) 0.0000 (1.0) 0;0 2.4604 (0.98) 1 1
test_list-list-dvc-only[main] 400.1374 (1.0) 400.1374 (1.0) 400.1374 (1.0) 0.0000 (1.0) 400.1374 (1.0) 0.0000 (1.0) 0;0 2.4991 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 597.8568 (1.20) 597.8568 (1.20) 597.8568 (1.20) 0.0000 (1.0) 597.8568 (1.20) 0.0000 (1.0) 0;0 1.6726 (0.83) 1 1
test_list-list-recursive[3.10.0] 497.8820 (1.0) 497.8820 (1.0) 497.8820 (1.0) 0.0000 (1.0) 497.8820 (1.0) 0.0000 (1.0) 0;0 2.0085 (1.0) 1 1
test_list-list-recursive[main] 504.4381 (1.01) 504.4381 (1.01) 504.4381 (1.01) 0.0000 (1.0) 504.4381 (1.01) 0.0000 (1.0) 0;0 1.9824 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 417.9232 (1.03) 417.9232 (1.03) 417.9232 (1.03) 0.0000 (1.0) 417.9232 (1.03) 0.0000 (1.0) 0;0 2.3928 (0.97) 1 1
test_list-list-shallow[3.10.0] 404.5299 (1.0) 404.5299 (1.0) 404.5299 (1.0) 0.0000 (1.0) 404.5299 (1.0) 0.0000 (1.0) 0;0 2.4720 (1.0) 1 1
test_list-list-shallow[main] 414.7380 (1.03) 414.7380 (1.03) 414.7380 (1.03) 0.0000 (1.0) 414.7380 (1.03) 0.0000 (1.0) 0;0 2.4112 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.1293 (1.04) 2.1293 (1.04) 2.1293 (1.04) 0.0000 (1.0) 2.1293 (1.04) 0.0000 (1.0) 0;0 0.4696 (0.96) 1 1
test_partial_add-add[3.10.0] 2.1305 (1.04) 2.1305 (1.04) 2.1305 (1.04) 0.0000 (1.0) 2.1305 (1.04) 0.0000 (1.0) 0;0 0.4694 (0.96) 1 1
test_partial_add-add[main] 2.0536 (1.0) 2.0536 (1.0) 2.0536 (1.0) 0.0000 (1.0) 2.0536 (1.0) 0.0000 (1.0) 0;0 0.4870 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 3.0788 (1.06) 3.0788 (1.06) 3.0788 (1.06) 0.0000 (1.0) 3.0788 (1.06) 0.0000 (1.0) 0;0 0.3248 (0.95) 1 1
test_partial_add-add-partial[3.10.0] 3.0743 (1.05) 3.0743 (1.05) 3.0743 (1.05) 0.0000 (1.0) 3.0743 (1.05) 0.0000 (1.0) 0;0 0.3253 (0.95) 1 1
test_partial_add-add-partial[main] 2.9174 (1.0) 2.9174 (1.0) 2.9174 (1.0) 0.0000 (1.0) 2.9174 (1.0) 0.0000 (1.0) 0;0 0.3428 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 580.8524 (1.0) 580.8524 (1.0) 580.8524 (1.0) 0.0000 (1.0) 580.8524 (1.0) 0.0000 (1.0) 0;0 1.7216 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 685.9116 (1.18) 685.9116 (1.18) 685.9116 (1.18) 0.0000 (1.0) 685.9116 (1.18) 0.0000 (1.0) 0;0 1.4579 (0.85) 1 1
test_partial_add-gc-cloud-noop[main] 707.8137 (1.22) 707.8137 (1.22) 707.8137 (1.22) 0.0000 (1.0) 707.8137 (1.22) 0.0000 (1.0) 0;0 1.4128 (0.82) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 495.1024 (1.0) 495.1024 (1.0) 495.1024 (1.0) 0.0000 (1.0) 495.1024 (1.0) 0.0000 (1.0) 0;0 2.0198 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 577.3271 (1.17) 577.3271 (1.17) 577.3271 (1.17) 0.0000 (1.0) 577.3271 (1.17) 0.0000 (1.0) 0;0 1.7321 (0.86) 1 1
test_partial_add-gc-noop[main] 580.1484 (1.17) 580.1484 (1.17) 580.1484 (1.17) 0.0000 (1.0) 580.1484 (1.17) 0.0000 (1.0) 0;0 1.7237 (0.85) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 1.9761 (1.80) 1.9761 (1.80) 1.9761 (1.80) 0.0000 (1.0) 1.9761 (1.80) 0.0000 (1.0) 0;0 0.5060 (0.56) 1 1
test_partial_add-push[3.10.0] 1.2392 (1.13) 1.2392 (1.13) 1.2392 (1.13) 0.0000 (1.0) 1.2392 (1.13) 0.0000 (1.0) 0;0 0.8070 (0.89) 1 1
test_partial_add-push[main] 1.0972 (1.0) 1.0972 (1.0) 1.0972 (1.0) 0.0000 (1.0) 1.0972 (1.0) 0.0000 (1.0) 0;0 0.9114 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 2.0285 (1.68) 2.0285 (1.68) 2.0285 (1.68) 0.0000 (1.0) 2.0285 (1.68) 0.0000 (1.0) 0;0 0.4930 (0.60) 1 1
test_partial_add-push-partial[3.10.0] 1.2451 (1.03) 1.2451 (1.03) 1.2451 (1.03) 0.0000 (1.0) 1.2451 (1.03) 0.0000 (1.0) 0;0 0.8032 (0.97) 1 1
test_partial_add-push-partial[main] 1.2075 (1.0) 1.2075 (1.0) 1.2075 (1.0) 0.0000 (1.0) 1.2075 (1.0) 0.0000 (1.0) 0;0 0.8282 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.5752 (1.05) 3.5752 (1.05) 3.5752 (1.05) 0.0000 (1.0) 3.5752 (1.05) 0.0000 (1.0) 0;0 0.2797 (0.95) 1 1
test_partial_remove-add[3.10.0] 3.5846 (1.06) 3.5846 (1.06) 3.5846 (1.06) 0.0000 (1.0) 3.5846 (1.06) 0.0000 (1.0) 0;0 0.2790 (0.95) 1 1
test_partial_remove-add[main] 3.3899 (1.0) 3.3899 (1.0) 3.3899 (1.0) 0.0000 (1.0) 3.3899 (1.0) 0.0000 (1.0) 0;0 0.2950 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.4666 (1.05) 1.4666 (1.05) 1.4666 (1.05) 0.0000 (1.0) 1.4666 (1.05) 0.0000 (1.0) 0;0 0.6819 (0.95) 1 1
test_partial_remove-add-update[3.10.0] 1.5032 (1.07) 1.5032 (1.07) 1.5032 (1.07) 0.0000 (1.0) 1.5032 (1.07) 0.0000 (1.0) 0;0 0.6652 (0.93) 1 1
test_partial_remove-add-update[main] 1.3994 (1.0) 1.3994 (1.0) 1.3994 (1.0) 0.0000 (1.0) 1.3994 (1.0) 0.0000 (1.0) 0;0 0.7146 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 485.4798 (1.0) 485.4798 (1.0) 485.4798 (1.0) 0.0000 (1.0) 485.4798 (1.0) 0.0000 (1.0) 0;0 2.0598 (1.0) 1 1
test_partial_remove-gc[3.10.0] 542.2340 (1.12) 542.2340 (1.12) 542.2340 (1.12) 0.0000 (1.0) 542.2340 (1.12) 0.0000 (1.0) 0;0 1.8442 (0.90) 1 1
test_partial_remove-gc[main] 533.2915 (1.10) 533.2915 (1.10) 533.2915 (1.10) 0.0000 (1.0) 533.2915 (1.10) 0.0000 (1.0) 0;0 1.8751 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 562.0011 (1.0) 562.0011 (1.0) 562.0011 (1.0) 0.0000 (1.0) 562.0011 (1.0) 0.0000 (1.0) 0;0 1.7794 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 612.6710 (1.09) 612.6710 (1.09) 612.6710 (1.09) 0.0000 (1.0) 612.6710 (1.09) 0.0000 (1.0) 0;0 1.6322 (0.92) 1 1
test_partial_remove-gc-cloud[main] 616.7131 (1.10) 616.7131 (1.10) 616.7131 (1.10) 0.0000 (1.0) 616.7131 (1.10) 0.0000 (1.0) 0;0 1.6215 (0.91) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 3.4574 (2.33) 3.4574 (2.33) 3.4574 (2.33) 0.0000 (1.0) 3.4574 (2.33) 0.0000 (1.0) 0;0 0.2892 (0.43) 1 1
test_partial_remove-push[3.10.0] 1.9196 (1.30) 1.9196 (1.30) 1.9196 (1.30) 0.0000 (1.0) 1.9196 (1.30) 0.0000 (1.0) 0;0 0.5209 (0.77) 1 1
test_partial_remove-push[main] 1.4811 (1.0) 1.4811 (1.0) 1.4811 (1.0) 0.0000 (1.0) 1.4811 (1.0) 0.0000 (1.0) 0;0 0.6752 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 477.3001 (1.02) 477.3001 (1.02) 477.3001 (1.02) 0.0000 (1.0) 477.3001 (1.02) 0.0000 (1.0) 0;0 2.0951 (0.98) 1 1
test_partial_remove-push-update[3.10.0] 468.8410 (1.0) 468.8410 (1.0) 468.8410 (1.0) 0.0000 (1.0) 468.8410 (1.0) 0.0000 (1.0) 0;0 2.1329 (1.0) 1 1
test_partial_remove-push-update[main] 840.4354 (1.79) 840.4354 (1.79) 840.4354 (1.79) 0.0000 (1.0) 840.4354 (1.79) 0.0000 (1.0) 0;0 1.1899 (0.56) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 418.5362 (1.0) 429.2966 (1.0) 421.6219 (1.0) 4.4249 (2.85) 420.7362 (1.0) 4.2830 (1.55) 1;0 2.3718 (1.0) 5 3
test_plots-plots-diff[3.10.0] 777.3619 (1.86) 780.8616 (1.82) 778.9970 (1.85) 1.5533 (1.0) 779.3689 (1.85) 2.7668 (1.0) 3;0 1.2837 (0.54) 5 3
test_plots-plots-diff[main] 739.5033 (1.77) 746.6174 (1.74) 743.7372 (1.76) 2.6790 (1.72) 744.3721 (1.77) 3.2115 (1.16) 2;0 1.3446 (0.57) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 435.3211 (1.0) 452.4631 (1.0) 439.9581 (1.0) 7.0994 (3.29) 436.7988 (1.0) 6.0162 (1.77) 1;1 2.2729 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,033.1703 (2.37) 1,056.1387 (2.33) 1,040.2970 (2.36) 9.3706 (4.35) 1,038.1153 (2.38) 10.8711 (3.21) 1;0 0.9613 (0.42) 5 3
test_plots-plots-diff-json[main] 816.0894 (1.87) 821.5183 (1.82) 818.8837 (1.86) 2.1556 (1.0) 818.6188 (1.87) 3.3911 (1.0) 2;0 1.2212 (0.54) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 382.3905 (1.0) 385.4903 (1.0) 384.5555 (1.0) 1.2505 (1.0) 384.8200 (1.0) 1.1961 (1.0) 1;0 2.6004 (1.0) 5 3
test_plots-plots-show[3.10.0] 641.6694 (1.68) 647.5582 (1.68) 644.8206 (1.68) 2.4293 (1.94) 644.6803 (1.68) 4.0720 (3.40) 2;0 1.5508 (0.60) 5 3
test_plots-plots-show[main] 628.1752 (1.64) 633.2427 (1.64) 629.6549 (1.64) 2.1219 (1.70) 628.5304 (1.63) 2.4289 (2.03) 1;0 1.5882 (0.61) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 398.3529 (1.0) 403.6082 (1.0) 400.6220 (1.0) 1.9741 (1.0) 400.7559 (1.0) 2.4469 (1.0) 2;0 2.4961 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 789.7007 (1.98) 797.7182 (1.98) 792.5416 (1.98) 3.1496 (1.60) 791.3318 (1.97) 3.7522 (1.53) 1;0 1.2618 (0.51) 5 3
test_plots-plots-show-json[main] 675.6112 (1.70) 685.0141 (1.70) 679.6193 (1.70) 3.4847 (1.77) 679.8141 (1.70) 3.8936 (1.59) 2;0 1.4714 (0.59) 5 3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 3.4766 (2.33) 3.4766 (2.33) 3.4766 (2.33) 0.0000 (1.0) 3.4766 (2.33) 0.0000 (1.0) 0;0 0.2876 (0.43) 1 1
test_push-push[3.10.0] 1.9358 (1.30) 1.9358 (1.30) 1.9358 (1.30) 0.0000 (1.0) 1.9358 (1.30) 0.0000 (1.0) 0;0 0.5166 (0.77) 1 1
test_push-push[main] 1.4929 (1.0) 1.4929 (1.0) 1.4929 (1.0) 0.0000 (1.0) 1.4929 (1.0) 0.0000 (1.0) 0;0 0.6698 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2] 3.7563 (1.08) 3.7563 (1.08) 3.7563 (1.08) 0.0000 (1.0) 3.7563 (1.08) 0.0000 (1.0) 0;0 0.2662 (0.92) 1 1
test_sharing-add[3.10.0] 3.7805 (1.09) 3.7805 (1.09) 3.7805 (1.09) 0.0000 (1.0) 3.7805 (1.09) 0.0000 (1.0) 0;0 0.2645 (0.92) 1 1
test_sharing-add[main] 3.4678 (1.0) 3.4678 (1.0) 3.4678 (1.0) 0.0000 (1.0) 3.4678 (1.0) 0.0000 (1.0) 0;0 0.2884 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2] 2.5337 (1.10) 2.5337 (1.10) 2.5337 (1.10) 0.0000 (1.0) 2.5337 (1.10) 0.0000 (1.0) 0;0 0.3947 (0.91) 1 1
test_sharing-add-noop[3.10.0] 2.5561 (1.11) 2.5561 (1.11) 2.5561 (1.11) 0.0000 (1.0) 2.5561 (1.11) 0.0000 (1.0) 0;0 0.3912 (0.90) 1 1
test_sharing-add-noop[main] 2.3018 (1.0) 2.3018 (1.0) 2.3018 (1.0) 0.0000 (1.0) 2.3018 (1.0) 0.0000 (1.0) 0;0 0.4344 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2] 1.8520 (1.33) 1.8520 (1.33) 1.8520 (1.33) 0.0000 (1.0) 1.8520 (1.33) 0.0000 (1.0) 0;0 0.5400 (0.75) 1 1
test_sharing-checkout[3.10.0] 3.8417 (2.75) 3.8417 (2.75) 3.8417 (2.75) 0.0000 (1.0) 3.8417 (2.75) 0.0000 (1.0) 0;0 0.2603 (0.36) 1 1
test_sharing-checkout[main] 1.3946 (1.0) 1.3946 (1.0) 1.3946 (1.0) 0.0000 (1.0) 1.3946 (1.0) 0.0000 (1.0) 0;0 0.7171 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2] 619.0230 (1.05) 619.0230 (1.05) 619.0230 (1.05) 0.0000 (1.0) 619.0230 (1.05) 0.0000 (1.0) 0;0 1.6154 (0.95) 1 1
test_sharing-checkout-noop[3.10.0] 625.5785 (1.06) 625.5785 (1.06) 625.5785 (1.06) 0.0000 (1.0) 625.5785 (1.06) 0.0000 (1.0) 0;0 1.5985 (0.94) 1 1
test_sharing-checkout-noop[main] 589.9857 (1.0) 589.9857 (1.0) 589.9857 (1.0) 0.0000 (1.0) 589.9857 (1.0) 0.0000 (1.0) 0;0 1.6950 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 4.2454 (2.29) 4.2454 (2.29) 4.2454 (2.29) 0.0000 (1.0) 4.2454 (2.29) 0.0000 (1.0) 0;0 0.2356 (0.44) 1 1
test_sharing-fetch[3.10.0] 4.4643 (2.41) 4.4643 (2.41) 4.4643 (2.41) 0.0000 (1.0) 4.4643 (2.41) 0.0000 (1.0) 0;0 0.2240 (0.41) 1 1
test_sharing-fetch[main] 1.8521 (1.0) 1.8521 (1.0) 1.8521 (1.0) 0.0000 (1.0) 1.8521 (1.0) 0.0000 (1.0) 0;0 0.5399 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 473.2878 (1.0) 473.2878 (1.0) 473.2878 (1.0) 0.0000 (1.0) 473.2878 (1.0) 0.0000 (1.0) 0;0 2.1129 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 529.9839 (1.12) 529.9839 (1.12) 529.9839 (1.12) 0.0000 (1.0) 529.9839 (1.12) 0.0000 (1.0) 0;0 1.8868 (0.89) 1 1
test_sharing-fetch-noop[main] 820.5618 (1.73) 820.5618 (1.73) 820.5618 (1.73) 0.0000 (1.0) 820.5618 (1.73) 0.0000 (1.0) 0;0 1.2187 (0.58) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 3.5999 (2.33) 3.5999 (2.33) 3.5999 (2.33) 0.0000 (1.0) 3.5999 (2.33) 0.0000 (1.0) 0;0 0.2778 (0.43) 1 1
test_sharing-push[3.10.0] 2.0204 (1.31) 2.0204 (1.31) 2.0204 (1.31) 0.0000 (1.0) 2.0204 (1.31) 0.0000 (1.0) 0;0 0.4949 (0.77) 1 1
test_sharing-push[main] 1.5459 (1.0) 1.5459 (1.0) 1.5459 (1.0) 0.0000 (1.0) 1.5459 (1.0) 0.0000 (1.0) 0;0 0.6469 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 504.4430 (1.00) 504.4430 (1.00) 504.4430 (1.00) 0.0000 (1.0) 504.4430 (1.00) 0.0000 (1.0) 0;0 1.9824 (1.00) 1 1
test_sharing-push-noop[3.10.0] 502.9070 (1.0) 502.9070 (1.0) 502.9070 (1.0) 0.0000 (1.0) 502.9070 (1.0) 0.0000 (1.0) 0;0 1.9884 (1.0) 1 1
test_sharing-push-noop[main] 817.1539 (1.62) 817.1539 (1.62) 817.1539 (1.62) 0.0000 (1.0) 817.1539 (1.62) 0.0000 (1.0) 0;0 1.2238 (0.62) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.1919 (1.00) 1.1919 (1.00) 1.1919 (1.00) 0.0000 (1.0) 1.1919 (1.00) 0.0000 (1.0) 0;0 0.8390 (1.00) 1 1
test_status-status[3.10.0] 1.2108 (1.02) 1.2108 (1.02) 1.2108 (1.02) 0.0000 (1.0) 1.2108 (1.02) 0.0000 (1.0) 0;0 0.8259 (0.98) 1 1
test_status-status[main] 1.1881 (1.0) 1.1881 (1.0) 1.1881 (1.0) 0.0000 (1.0) 1.1881 (1.0) 0.0000 (1.0) 0;0 0.8417 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 558.6370 (1.04) 558.6370 (1.04) 558.6370 (1.04) 0.0000 (1.0) 558.6370 (1.04) 0.0000 (1.0) 0;0 1.7901 (0.96) 1 1
test_status-status-changed[3.10.0] 541.6964 (1.01) 541.6964 (1.01) 541.6964 (1.01) 0.0000 (1.0) 541.6964 (1.01) 0.0000 (1.0) 0;0 1.8461 (0.99) 1 1
test_status-status-changed[main] 537.9742 (1.0) 537.9742 (1.0) 537.9742 (1.0) 0.0000 (1.0) 537.9742 (1.0) 0.0000 (1.0) 0;0 1.8588 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 530.1045 (1.0) 530.1045 (1.0) 530.1045 (1.0) 0.0000 (1.0) 530.1045 (1.0) 0.0000 (1.0) 0;0 1.8864 (1.0) 1 1
test_status-status-changed-noop[3.10.0] 547.8868 (1.03) 547.8868 (1.03) 547.8868 (1.03) 0.0000 (1.0) 547.8868 (1.03) 0.0000 (1.0) 0;0 1.8252 (0.97) 1 1
test_status-status-changed-noop[main] 539.6142 (1.02) 539.6142 (1.02) 539.6142 (1.02) 0.0000 (1.0) 539.6142 (1.02) 0.0000 (1.0) 0;0 1.8532 (0.98) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 532.6278 (1.0) 532.6278 (1.0) 532.6278 (1.0) 0.0000 (1.0) 532.6278 (1.0) 0.0000 (1.0) 0;0 1.8775 (1.0) 1 1
test_status-status-noop[3.10.0] 548.4457 (1.03) 548.4457 (1.03) 548.4457 (1.03) 0.0000 (1.0) 548.4457 (1.03) 0.0000 (1.0) 0;0 1.8233 (0.97) 1 1
test_status-status-noop[main] 536.2095 (1.01) 536.2095 (1.01) 536.2095 (1.01) 0.0000 (1.0) 536.2095 (1.01) 0.0000 (1.0) 0;0 1.8649 (0.99) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 7.4905 (1.47) 7.4905 (1.47) 7.4905 (1.47) 0.0000 (1.0) 7.4905 (1.47) 0.0000 (1.0) 0;0 0.1335 (0.68) 1 1
test_update-import-url[3.10.0] 7.5062 (1.47) 7.5062 (1.47) 7.5062 (1.47) 0.0000 (1.0) 7.5062 (1.47) 0.0000 (1.0) 0;0 0.1332 (0.68) 1 1
test_update-import-url[main] 5.0954 (1.0) 5.0954 (1.0) 5.0954 (1.0) 0.0000 (1.0) 5.0954 (1.0) 0.0000 (1.0) 0;0 0.1963 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 6.5878 (1.47) 6.5878 (1.47) 6.5878 (1.47) 0.0000 (1.0) 6.5878 (1.47) 0.0000 (1.0) 0;0 0.1518 (0.68) 1 1
test_update-update[3.10.0] 6.8201 (1.52) 6.8201 (1.52) 6.8201 (1.52) 0.0000 (1.0) 6.8201 (1.52) 0.0000 (1.0) 0;0 0.1466 (0.66) 1 1
test_update-update[main] 4.4949 (1.0) 4.4949 (1.0) 4.4949 (1.0) 0.0000 (1.0) 4.4949 (1.0) 0.0000 (1.0) 0;0 0.2225 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 965.6332 (1.01) 965.6332 (1.01) 965.6332 (1.01) 0.0000 (1.0) 965.6332 (1.01) 0.0000 (1.0) 0;0 1.0356 (0.99) 1 1
test_update-update-noop[3.10.0] 999.6769 (1.05) 999.6769 (1.05) 999.6769 (1.05) 0.0000 (1.0) 999.6769 (1.05) 0.0000 (1.0) 0;0 1.0003 (0.95) 1 1
test_update-update-noop[main] 952.3678 (1.0) 952.3678 (1.0) 952.3678 (1.0) 0.0000 (1.0) 952.3678 (1.0) 0.0000 (1.0) 0;0 1.0500 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
updates: