Closed dependabot[bot] closed 4 months ago
Wed Dec 20 09:16:14 UTC 2023
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2] 3.6422 (1.06) 3.6422 (1.06) 3.6422 (1.06) 0.0000 (1.0) 3.6422 (1.06) 0.0000 (1.0) 0;0 0.2746 (0.94) 1 1
test_add-add[3.10.0] 3.6238 (1.06) 3.6238 (1.06) 3.6238 (1.06) 0.0000 (1.0) 3.6238 (1.06) 0.0000 (1.0) 0;0 0.2760 (0.95) 1 1
test_add-add[main] 3.4315 (1.0) 3.4315 (1.0) 3.4315 (1.0) 0.0000 (1.0) 3.4315 (1.0) 0.0000 (1.0) 0;0 0.2914 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 1.8950 (1.20) 1.8950 (1.20) 1.8950 (1.20) 0.0000 (1.0) 1.8950 (1.20) 0.0000 (1.0) 0;0 0.5277 (0.83) 1 1
test_checkout_copy-checkout[3.10.0] 3.8217 (2.42) 3.8217 (2.42) 3.8217 (2.42) 0.0000 (1.0) 3.8217 (2.42) 0.0000 (1.0) 0;0 0.2617 (0.41) 1 1
test_checkout_copy-checkout[main] 1.5761 (1.0) 1.5761 (1.0) 1.5761 (1.0) 0.0000 (1.0) 1.5761 (1.0) 0.0000 (1.0) 0;0 0.6345 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 551.8632 (1.0) 551.8632 (1.0) 551.8632 (1.0) 0.0000 (1.0) 551.8632 (1.0) 0.0000 (1.0) 0;0 1.8120 (1.0) 1 1
test_checkout_copy-checkout-noop[3.10.0] 573.3123 (1.04) 573.3123 (1.04) 573.3123 (1.04) 0.0000 (1.0) 573.3123 (1.04) 0.0000 (1.0) 0;0 1.7443 (0.96) 1 1
test_checkout_copy-checkout-noop[main] 562.3939 (1.02) 562.3939 (1.02) 562.3939 (1.02) 0.0000 (1.0) 562.3939 (1.02) 0.0000 (1.0) 0;0 1.7781 (0.98) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 685.8551 (1.13) 685.8551 (1.13) 685.8551 (1.13) 0.0000 (1.0) 685.8551 (1.13) 0.0000 (1.0) 0;0 1.4580 (0.89) 1 1
test_checkout_copy-checkout-update[3.10.0] 622.3623 (1.02) 622.3623 (1.02) 622.3623 (1.02) 0.0000 (1.0) 622.3623 (1.02) 0.0000 (1.0) 0;0 1.6068 (0.98) 1 1
test_checkout_copy-checkout-update[main] 608.9691 (1.0) 608.9691 (1.0) 608.9691 (1.0) 0.0000 (1.0) 608.9691 (1.0) 0.0000 (1.0) 0;0 1.6421 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.2323 (1.17) 1.2323 (1.17) 1.2323 (1.17) 0.0000 (1.0) 1.2323 (1.17) 0.0000 (1.0) 0;0 0.8115 (0.85) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.0885 (1.04) 1.0885 (1.04) 1.0885 (1.04) 0.0000 (1.0) 1.0885 (1.04) 0.0000 (1.0) 0;0 0.9187 (0.96) 1 1
test_checkout_hardlink-checkout[main] 1.0495 (1.0) 1.0495 (1.0) 1.0495 (1.0) 0.0000 (1.0) 1.0495 (1.0) 0.0000 (1.0) 0;0 0.9528 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 546.7706 (1.0) 546.7706 (1.0) 546.7706 (1.0) 0.0000 (1.0) 546.7706 (1.0) 0.0000 (1.0) 0;0 1.8289 (1.0) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 571.2488 (1.04) 571.2488 (1.04) 571.2488 (1.04) 0.0000 (1.0) 571.2488 (1.04) 0.0000 (1.0) 0;0 1.7506 (0.96) 1 1
test_checkout_hardlink-checkout-noop[main] 554.2256 (1.01) 554.2256 (1.01) 554.2256 (1.01) 0.0000 (1.0) 554.2256 (1.01) 0.0000 (1.0) 0;0 1.8043 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 693.2858 (1.16) 693.2858 (1.16) 693.2858 (1.16) 0.0000 (1.0) 693.2858 (1.16) 0.0000 (1.0) 0;0 1.4424 (0.86) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 637.3953 (1.06) 637.3953 (1.06) 637.3953 (1.06) 0.0000 (1.0) 637.3953 (1.06) 0.0000 (1.0) 0;0 1.5689 (0.94) 1 1
test_checkout_hardlink-checkout-update[main] 599.5773 (1.0) 599.5773 (1.0) 599.5773 (1.0) 0.0000 (1.0) 599.5773 (1.0) 0.0000 (1.0) 0;0 1.6678 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.3241 (1.13) 1.3241 (1.13) 1.3241 (1.13) 0.0000 (1.0) 1.3241 (1.13) 0.0000 (1.0) 0;0 0.7552 (0.88) 1 1
test_checkout_symlink-checkout[3.10.0] 1.2423 (1.06) 1.2423 (1.06) 1.2423 (1.06) 0.0000 (1.0) 1.2423 (1.06) 0.0000 (1.0) 0;0 0.8050 (0.94) 1 1
test_checkout_symlink-checkout[main] 1.1716 (1.0) 1.1716 (1.0) 1.1716 (1.0) 0.0000 (1.0) 1.1716 (1.0) 0.0000 (1.0) 0;0 0.8535 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 600.2245 (1.0) 600.2245 (1.0) 600.2245 (1.0) 0.0000 (1.0) 600.2245 (1.0) 0.0000 (1.0) 0;0 1.6660 (1.0) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 641.1920 (1.07) 641.1920 (1.07) 641.1920 (1.07) 0.0000 (1.0) 641.1920 (1.07) 0.0000 (1.0) 0;0 1.5596 (0.94) 1 1
test_checkout_symlink-checkout-noop[main] 600.5903 (1.00) 600.5903 (1.00) 600.5903 (1.00) 0.0000 (1.0) 600.5903 (1.00) 0.0000 (1.0) 0;0 1.6650 (1.00) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 782.8085 (1.13) 782.8085 (1.13) 782.8085 (1.13) 0.0000 (1.0) 782.8085 (1.13) 0.0000 (1.0) 0;0 1.2775 (0.89) 1 1
test_checkout_symlink-checkout-update[3.10.0] 726.7985 (1.05) 726.7985 (1.05) 726.7985 (1.05) 0.0000 (1.0) 726.7985 (1.05) 0.0000 (1.0) 0;0 1.3759 (0.95) 1 1
test_checkout_symlink-checkout-update[main] 693.7201 (1.0) 693.7201 (1.0) 693.7201 (1.0) 0.0000 (1.0) 693.7201 (1.0) 0.0000 (1.0) 0;0 1.4415 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 576.2192 (1.04) 576.2192 (1.04) 576.2192 (1.04) 0.0000 (1.0) 576.2192 (1.04) 0.0000 (1.0) 0;0 1.7355 (0.97) 1 1
test_data_status-data-changed[3.10.0] 563.3615 (1.01) 563.3615 (1.01) 563.3615 (1.01) 0.0000 (1.0) 563.3615 (1.01) 0.0000 (1.0) 0;0 1.7751 (0.99) 1 1
test_data_status-data-changed[main] 556.1210 (1.0) 556.1210 (1.0) 556.1210 (1.0) 0.0000 (1.0) 556.1210 (1.0) 0.0000 (1.0) 0;0 1.7982 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 587.3643 (1.05) 587.3643 (1.05) 587.3643 (1.05) 0.0000 (1.0) 587.3643 (1.05) 0.0000 (1.0) 0;0 1.7025 (0.95) 1 1
test_data_status-data-changed-noop[3.10.0] 568.6839 (1.02) 568.6839 (1.02) 568.6839 (1.02) 0.0000 (1.0) 568.6839 (1.02) 0.0000 (1.0) 0;0 1.7584 (0.98) 1 1
test_data_status-data-changed-noop[main] 559.2321 (1.0) 559.2321 (1.0) 559.2321 (1.0) 0.0000 (1.0) 559.2321 (1.0) 0.0000 (1.0) 0;0 1.7882 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.2453 (1.04) 1.2453 (1.04) 1.2453 (1.04) 0.0000 (1.0) 1.2453 (1.04) 0.0000 (1.0) 0;0 0.8030 (0.96) 1 1
test_data_status-data-new[3.10.0] 1.2471 (1.04) 1.2471 (1.04) 1.2471 (1.04) 0.0000 (1.0) 1.2471 (1.04) 0.0000 (1.0) 0;0 0.8019 (0.96) 1 1
test_data_status-data-new[main] 1.1986 (1.0) 1.1986 (1.0) 1.1986 (1.0) 0.0000 (1.0) 1.1986 (1.0) 0.0000 (1.0) 0;0 0.8343 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 585.6928 (1.05) 585.6928 (1.05) 585.6928 (1.05) 0.0000 (1.0) 585.6928 (1.05) 0.0000 (1.0) 0;0 1.7074 (0.96) 1 1
test_data_status-data-noop[3.10.0] 573.0231 (1.02) 573.0231 (1.02) 573.0231 (1.02) 0.0000 (1.0) 573.0231 (1.02) 0.0000 (1.0) 0;0 1.7451 (0.98) 1 1
test_data_status-data-noop[main] 559.5328 (1.0) 559.5328 (1.0) 559.5328 (1.0) 0.0000 (1.0) 559.5328 (1.0) 0.0000 (1.0) 0;0 1.7872 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.0666 (1.03) 1.0666 (1.03) 1.0666 (1.03) 0.0000 (1.0) 1.0666 (1.03) 0.0000 (1.0) 0;0 0.9375 (0.97) 1 1
test_data_status_all_flags-data-changed[3.10.0] 1.0843 (1.05) 1.0843 (1.05) 1.0843 (1.05) 0.0000 (1.0) 1.0843 (1.05) 0.0000 (1.0) 0;0 0.9223 (0.95) 1 1
test_data_status_all_flags-data-changed[main] 1.0326 (1.0) 1.0326 (1.0) 1.0326 (1.0) 0.0000 (1.0) 1.0326 (1.0) 0.0000 (1.0) 0;0 0.9685 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.0942 (1.06) 1.0942 (1.06) 1.0942 (1.06) 0.0000 (1.0) 1.0942 (1.06) 0.0000 (1.0) 0;0 0.9139 (0.94) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 1.0521 (1.02) 1.0521 (1.02) 1.0521 (1.02) 0.0000 (1.0) 1.0521 (1.02) 0.0000 (1.0) 0;0 0.9505 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.0318 (1.0) 1.0318 (1.0) 1.0318 (1.0) 0.0000 (1.0) 1.0318 (1.0) 0.0000 (1.0) 0;0 0.9692 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 1.7029 (1.00) 1.7029 (1.00) 1.7029 (1.00) 0.0000 (1.0) 1.7029 (1.00) 0.0000 (1.0) 0;0 0.5872 (1.00) 1 1
test_data_status_all_flags-data-new[3.10.0] 1.8137 (1.07) 1.8137 (1.07) 1.8137 (1.07) 0.0000 (1.0) 1.8137 (1.07) 0.0000 (1.0) 0;0 0.5514 (0.94) 1 1
test_data_status_all_flags-data-new[main] 1.6969 (1.0) 1.6969 (1.0) 1.6969 (1.0) 0.0000 (1.0) 1.6969 (1.0) 0.0000 (1.0) 0;0 0.5893 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 1.0151 (1.01) 1.0151 (1.01) 1.0151 (1.01) 0.0000 (1.0) 1.0151 (1.01) 0.0000 (1.0) 0;0 0.9852 (0.99) 1 1
test_data_status_all_flags-data-noop[3.10.0] 1.0347 (1.03) 1.0347 (1.03) 1.0347 (1.03) 0.0000 (1.0) 1.0347 (1.03) 0.0000 (1.0) 0;0 0.9665 (0.98) 1 1
test_data_status_all_flags-data-noop[main] 1.0092 (1.0) 1.0092 (1.0) 1.0092 (1.0) 0.0000 (1.0) 1.0092 (1.0) 0.0000 (1.0) 0;0 0.9908 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.2062 (1.0) 1.2062 (1.0) 1.2062 (1.0) 0.0000 (1.0) 1.2062 (1.0) 0.0000 (1.0) 0;0 0.8291 (1.0) 1 1
test_diff-diff[3.10.0] 1.2548 (1.04) 1.2548 (1.04) 1.2548 (1.04) 0.0000 (1.0) 1.2548 (1.04) 0.0000 (1.0) 0;0 0.7969 (0.96) 1 1
test_diff-diff[main] 1.2532 (1.04) 1.2532 (1.04) 1.2532 (1.04) 0.0000 (1.0) 1.2532 (1.04) 0.0000 (1.0) 0;0 0.7979 (0.96) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 634.5361 (1.04) 634.5361 (1.04) 634.5361 (1.04) 0.0000 (1.0) 634.5361 (1.04) 0.0000 (1.0) 0;0 1.5760 (0.96) 1 1
test_diff-diff-changed[3.10.0] 657.2509 (1.08) 657.2509 (1.08) 657.2509 (1.08) 0.0000 (1.0) 657.2509 (1.08) 0.0000 (1.0) 0;0 1.5215 (0.93) 1 1
test_diff-diff-changed[main] 608.9075 (1.0) 608.9075 (1.0) 608.9075 (1.0) 0.0000 (1.0) 608.9075 (1.0) 0.0000 (1.0) 0;0 1.6423 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 602.0699 (1.00) 602.0699 (1.00) 602.0699 (1.00) 0.0000 (1.0) 602.0699 (1.00) 0.0000 (1.0) 0;0 1.6609 (1.00) 1 1
test_diff-diff-changed-noop[3.10.0] 636.9879 (1.06) 636.9879 (1.06) 636.9879 (1.06) 0.0000 (1.0) 636.9879 (1.06) 0.0000 (1.0) 0;0 1.5699 (0.95) 1 1
test_diff-diff-changed-noop[main] 601.9632 (1.0) 601.9632 (1.0) 601.9632 (1.0) 0.0000 (1.0) 601.9632 (1.0) 0.0000 (1.0) 0;0 1.6612 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 578.1698 (1.0) 578.1698 (1.0) 578.1698 (1.0) 0.0000 (1.0) 578.1698 (1.0) 0.0000 (1.0) 0;0 1.7296 (1.0) 1 1
test_diff-diff-noop[3.10.0] 592.6052 (1.02) 592.6052 (1.02) 592.6052 (1.02) 0.0000 (1.0) 592.6052 (1.02) 0.0000 (1.0) 0;0 1.6875 (0.98) 1 1
test_diff-diff-noop[main] 595.6648 (1.03) 595.6648 (1.03) 595.6648 (1.03) 0.0000 (1.0) 595.6648 (1.03) 0.0000 (1.0) 0;0 1.6788 (0.97) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 852.7428 (1.0) 852.7428 (1.0) 852.7428 (1.0) 0.0000 (1.0) 852.7428 (1.0) 0.0000 (1.0) 0;0 1.1727 (1.0) 1 1
test_exp_show-exp[3.10.0] 4,672.6904 (5.48) 4,672.6904 (5.48) 4,672.6904 (5.48) 0.0000 (1.0) 4,672.6904 (5.48) 0.0000 (1.0) 0;0 0.2140 (0.18) 1 1
test_exp_show-exp[main] 4,249.2868 (4.98) 4,249.2868 (4.98) 4,249.2868 (4.98) 0.0000 (1.0) 4,249.2868 (4.98) 0.0000 (1.0) 0;0 0.2353 (0.20) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 3.9540 (2.15) 3.9540 (2.15) 3.9540 (2.15) 0.0000 (1.0) 3.9540 (2.15) 0.0000 (1.0) 0;0 0.2529 (0.47) 1 1
test_fetch-fetch[3.10.0] 4.3918 (2.38) 4.3918 (2.38) 4.3918 (2.38) 0.0000 (1.0) 4.3918 (2.38) 0.0000 (1.0) 0;0 0.2277 (0.42) 1 1
test_fetch-fetch[main] 1.8425 (1.0) 1.8425 (1.0) 1.8425 (1.0) 0.0000 (1.0) 1.8425 (1.0) 0.0000 (1.0) 0;0 0.5427 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 482.0328 (1.05) 482.0328 (1.05) 482.0328 (1.05) 0.0000 (1.0) 482.0328 (1.05) 0.0000 (1.0) 0;0 2.0745 (0.95) 1 1
test_gc-gc[3.10.0] 525.1255 (1.14) 525.1255 (1.14) 525.1255 (1.14) 0.0000 (1.0) 525.1255 (1.14) 0.0000 (1.0) 0;0 1.9043 (0.87) 1 1
test_gc-gc[main] 459.2626 (1.0) 459.2626 (1.0) 459.2626 (1.0) 0.0000 (1.0) 459.2626 (1.0) 0.0000 (1.0) 0;0 2.1774 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 5.9576 (1.09) 5.9576 (1.09) 5.9576 (1.09) 0.0000 (1.0) 5.9576 (1.09) 0.0000 (1.0) 0;0 0.1679 (0.92) 1 1
test_get-get[3.10.0] 7.0401 (1.29) 7.0401 (1.29) 7.0401 (1.29) 0.0000 (1.0) 7.0401 (1.29) 0.0000 (1.0) 0;0 0.1420 (0.77) 1 1
test_get-get[main] 5.4550 (1.0) 5.4550 (1.0) 5.4550 (1.0) 0.0000 (1.0) 5.4550 (1.0) 0.0000 (1.0) 0;0 0.1833 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 3.0689 (3.18) 3.0689 (3.18) 3.0689 (3.18) 0.0000 (1.0) 3.0689 (3.18) 0.0000 (1.0) 0;0 0.3259 (0.31) 1 1
test_get_url-get-url[3.10.0] 3.1263 (3.24) 3.1263 (3.24) 3.1263 (3.24) 0.0000 (1.0) 3.1263 (3.24) 0.0000 (1.0) 0;0 0.3199 (0.31) 1 1
test_get_url-get-url[main] 0.9662 (1.0) 0.9662 (1.0) 0.9662 (1.0) 0.0000 (1.0) 0.9662 (1.0) 0.0000 (1.0) 0;0 1.0350 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 127.2765 (1.02) 150.1385 (1.12) 128.9226 (1.02) 2.4015 (1.75) 128.4515 (1.02) 1.1654 (1.0) 5;5 7.7566 (0.98) 100 1
test_help---help[3.10.0] 124.5010 (1.0) 134.1342 (1.0) 126.2764 (1.0) 1.3754 (1.0) 125.9822 (1.0) 1.2438 (1.07) 20;8 7.9191 (1.0) 100 1
test_help---help[main] 126.2189 (1.01) 135.0974 (1.01) 128.2916 (1.02) 1.5712 (1.14) 127.8176 (1.01) 2.0588 (1.77) 27;1 7.7947 (0.98) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 9.4931 (1.07) 9.4931 (1.07) 9.4931 (1.07) 0.0000 (1.0) 9.4931 (1.07) 0.0000 (1.0) 0;0 0.1053 (0.94) 1 1
test_import-import[3.10.0] 10.5803 (1.19) 10.5803 (1.19) 10.5803 (1.19) 0.0000 (1.0) 10.5803 (1.19) 0.0000 (1.0) 0;0 0.0945 (0.84) 1 1
test_import-import[main] 8.8911 (1.0) 8.8911 (1.0) 8.8911 (1.0) 0.0000 (1.0) 8.8911 (1.0) 0.0000 (1.0) 0;0 0.1125 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 7.4871 (1.45) 7.4871 (1.45) 7.4871 (1.45) 0.0000 (1.0) 7.4871 (1.45) 0.0000 (1.0) 0;0 0.1336 (0.69) 1 1
test_import_url-import-url[3.10.0] 7.5342 (1.46) 7.5342 (1.46) 7.5342 (1.46) 0.0000 (1.0) 7.5342 (1.46) 0.0000 (1.0) 0;0 0.1327 (0.68) 1 1
test_import_url-import-url[main] 5.1556 (1.0) 5.1556 (1.0) 5.1556 (1.0) 0.0000 (1.0) 5.1556 (1.0) 0.0000 (1.0) 0;0 0.1940 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 359.3836 (1.00) 386.1808 (1.01) 365.0214 (1.00) 4.5126 (1.0) 363.8195 (1.00) 3.4206 (1.0) 15;8 2.7396 (1.00) 100 1
test_init-init[3.10.0] 365.8841 (1.02) 417.6429 (1.09) 372.5096 (1.02) 5.9436 (1.32) 371.2578 (1.02) 5.0747 (1.48) 8;2 2.6845 (0.98) 100 1
test_init-init[main] 357.9063 (1.0) 382.9040 (1.0) 364.2564 (1.0) 4.7246 (1.05) 363.4508 (1.0) 4.1560 (1.22) 20;6 2.7453 (1.0) 100 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 426.1726 (1.10) 426.1726 (1.10) 426.1726 (1.10) 0.0000 (1.0) 426.1726 (1.10) 0.0000 (1.0) 0;0 2.3465 (0.91) 1 1
test_list-list[3.10.0] 402.2934 (1.04) 402.2934 (1.04) 402.2934 (1.04) 0.0000 (1.0) 402.2934 (1.04) 0.0000 (1.0) 0;0 2.4857 (0.96) 1 1
test_list-list[main] 385.9034 (1.0) 385.9034 (1.0) 385.9034 (1.0) 0.0000 (1.0) 385.9034 (1.0) 0.0000 (1.0) 0;0 2.5913 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 408.2569 (1.10) 408.2569 (1.10) 408.2569 (1.10) 0.0000 (1.0) 408.2569 (1.10) 0.0000 (1.0) 0;0 2.4494 (0.91) 1 1
test_list-list-dvc-only[3.10.0] 386.2856 (1.04) 386.2856 (1.04) 386.2856 (1.04) 0.0000 (1.0) 386.2856 (1.04) 0.0000 (1.0) 0;0 2.5888 (0.96) 1 1
test_list-list-dvc-only[main] 371.4564 (1.0) 371.4564 (1.0) 371.4564 (1.0) 0.0000 (1.0) 371.4564 (1.0) 0.0000 (1.0) 0;0 2.6921 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 477.8847 (1.05) 477.8847 (1.05) 477.8847 (1.05) 0.0000 (1.0) 477.8847 (1.05) 0.0000 (1.0) 0;0 2.0926 (0.95) 1 1
test_list-list-recursive[3.10.0] 474.9598 (1.04) 474.9598 (1.04) 474.9598 (1.04) 0.0000 (1.0) 474.9598 (1.04) 0.0000 (1.0) 0;0 2.1054 (0.96) 1 1
test_list-list-recursive[main] 455.2072 (1.0) 455.2072 (1.0) 455.2072 (1.0) 0.0000 (1.0) 455.2072 (1.0) 0.0000 (1.0) 0;0 2.1968 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 396.3598 (1.06) 396.3598 (1.06) 396.3598 (1.06) 0.0000 (1.0) 396.3598 (1.06) 0.0000 (1.0) 0;0 2.5230 (0.94) 1 1
test_list-list-shallow[3.10.0] 388.8658 (1.04) 388.8658 (1.04) 388.8658 (1.04) 0.0000 (1.0) 388.8658 (1.04) 0.0000 (1.0) 0;0 2.5716 (0.96) 1 1
test_list-list-shallow[main] 374.5587 (1.0) 374.5587 (1.0) 374.5587 (1.0) 0.0000 (1.0) 374.5587 (1.0) 0.0000 (1.0) 0;0 2.6698 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.2547 (1.08) 2.2547 (1.08) 2.2547 (1.08) 0.0000 (1.0) 2.2547 (1.08) 0.0000 (1.0) 0;0 0.4435 (0.93) 1 1
test_partial_add-add[3.10.0] 2.1823 (1.05) 2.1823 (1.05) 2.1823 (1.05) 0.0000 (1.0) 2.1823 (1.05) 0.0000 (1.0) 0;0 0.4582 (0.96) 1 1
test_partial_add-add[main] 2.0859 (1.0) 2.0859 (1.0) 2.0859 (1.0) 0.0000 (1.0) 2.0859 (1.0) 0.0000 (1.0) 0;0 0.4794 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 3.2360 (1.06) 3.2360 (1.06) 3.2360 (1.06) 0.0000 (1.0) 3.2360 (1.06) 0.0000 (1.0) 0;0 0.3090 (0.94) 1 1
test_partial_add-add-partial[3.10.0] 3.1384 (1.03) 3.1384 (1.03) 3.1384 (1.03) 0.0000 (1.0) 3.1384 (1.03) 0.0000 (1.0) 0;0 0.3186 (0.97) 1 1
test_partial_add-add-partial[main] 3.0432 (1.0) 3.0432 (1.0) 3.0432 (1.0) 0.0000 (1.0) 3.0432 (1.0) 0.0000 (1.0) 0;0 0.3286 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 609.7649 (1.0) 609.7649 (1.0) 609.7649 (1.0) 0.0000 (1.0) 609.7649 (1.0) 0.0000 (1.0) 0;0 1.6400 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 685.5193 (1.12) 685.5193 (1.12) 685.5193 (1.12) 0.0000 (1.0) 685.5193 (1.12) 0.0000 (1.0) 0;0 1.4587 (0.89) 1 1
test_partial_add-gc-cloud-noop[main] 706.6763 (1.16) 706.6763 (1.16) 706.6763 (1.16) 0.0000 (1.0) 706.6763 (1.16) 0.0000 (1.0) 0;0 1.4151 (0.86) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 528.4123 (1.0) 528.4123 (1.0) 528.4123 (1.0) 0.0000 (1.0) 528.4123 (1.0) 0.0000 (1.0) 0;0 1.8925 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 613.4824 (1.16) 613.4824 (1.16) 613.4824 (1.16) 0.0000 (1.0) 613.4824 (1.16) 0.0000 (1.0) 0;0 1.6300 (0.86) 1 1
test_partial_add-gc-noop[main] 589.6249 (1.12) 589.6249 (1.12) 589.6249 (1.12) 0.0000 (1.0) 589.6249 (1.12) 0.0000 (1.0) 0;0 1.6960 (0.90) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 2.0204 (1.78) 2.0204 (1.78) 2.0204 (1.78) 0.0000 (1.0) 2.0204 (1.78) 0.0000 (1.0) 0;0 0.4950 (0.56) 1 1
test_partial_add-push[3.10.0] 1.2045 (1.06) 1.2045 (1.06) 1.2045 (1.06) 0.0000 (1.0) 1.2045 (1.06) 0.0000 (1.0) 0;0 0.8302 (0.94) 1 1
test_partial_add-push[main] 1.1332 (1.0) 1.1332 (1.0) 1.1332 (1.0) 0.0000 (1.0) 1.1332 (1.0) 0.0000 (1.0) 0;0 0.8825 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 2.0716 (1.65) 2.0716 (1.65) 2.0716 (1.65) 0.0000 (1.0) 2.0716 (1.65) 0.0000 (1.0) 0;0 0.4827 (0.61) 1 1
test_partial_add-push-partial[3.10.0] 1.2949 (1.03) 1.2949 (1.03) 1.2949 (1.03) 0.0000 (1.0) 1.2949 (1.03) 0.0000 (1.0) 0;0 0.7722 (0.97) 1 1
test_partial_add-push-partial[main] 1.2538 (1.0) 1.2538 (1.0) 1.2538 (1.0) 0.0000 (1.0) 1.2538 (1.0) 0.0000 (1.0) 0;0 0.7976 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.5510 (1.04) 3.5510 (1.04) 3.5510 (1.04) 0.0000 (1.0) 3.5510 (1.04) 0.0000 (1.0) 0;0 0.2816 (0.96) 1 1
test_partial_remove-add[3.10.0] 3.5980 (1.05) 3.5980 (1.05) 3.5980 (1.05) 0.0000 (1.0) 3.5980 (1.05) 0.0000 (1.0) 0;0 0.2779 (0.95) 1 1
test_partial_remove-add[main] 3.4164 (1.0) 3.4164 (1.0) 3.4164 (1.0) 0.0000 (1.0) 3.4164 (1.0) 0.0000 (1.0) 0;0 0.2927 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.4297 (1.05) 1.4297 (1.05) 1.4297 (1.05) 0.0000 (1.0) 1.4297 (1.05) 0.0000 (1.0) 0;0 0.6995 (0.95) 1 1
test_partial_remove-add-update[3.10.0] 1.4484 (1.06) 1.4484 (1.06) 1.4484 (1.06) 0.0000 (1.0) 1.4484 (1.06) 0.0000 (1.0) 0;0 0.6904 (0.94) 1 1
test_partial_remove-add-update[main] 1.3611 (1.0) 1.3611 (1.0) 1.3611 (1.0) 0.0000 (1.0) 1.3611 (1.0) 0.0000 (1.0) 0;0 0.7347 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 487.4588 (1.0) 487.4588 (1.0) 487.4588 (1.0) 0.0000 (1.0) 487.4588 (1.0) 0.0000 (1.0) 0;0 2.0515 (1.0) 1 1
test_partial_remove-gc[3.10.0] 536.1419 (1.10) 536.1419 (1.10) 536.1419 (1.10) 0.0000 (1.0) 536.1419 (1.10) 0.0000 (1.0) 0;0 1.8652 (0.91) 1 1
test_partial_remove-gc[main] 520.8903 (1.07) 520.8903 (1.07) 520.8903 (1.07) 0.0000 (1.0) 520.8903 (1.07) 0.0000 (1.0) 0;0 1.9198 (0.94) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 546.5490 (1.0) 546.5490 (1.0) 546.5490 (1.0) 0.0000 (1.0) 546.5490 (1.0) 0.0000 (1.0) 0;0 1.8297 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 598.0431 (1.09) 598.0431 (1.09) 598.0431 (1.09) 0.0000 (1.0) 598.0431 (1.09) 0.0000 (1.0) 0;0 1.6721 (0.91) 1 1
test_partial_remove-gc-cloud[main] 621.0571 (1.14) 621.0571 (1.14) 621.0571 (1.14) 0.0000 (1.0) 621.0571 (1.14) 0.0000 (1.0) 0;0 1.6102 (0.88) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 3.3584 (2.28) 3.3584 (2.28) 3.3584 (2.28) 0.0000 (1.0) 3.3584 (2.28) 0.0000 (1.0) 0;0 0.2978 (0.44) 1 1
test_partial_remove-push[3.10.0] 1.8595 (1.26) 1.8595 (1.26) 1.8595 (1.26) 0.0000 (1.0) 1.8595 (1.26) 0.0000 (1.0) 0;0 0.5378 (0.79) 1 1
test_partial_remove-push[main] 1.4751 (1.0) 1.4751 (1.0) 1.4751 (1.0) 0.0000 (1.0) 1.4751 (1.0) 0.0000 (1.0) 0;0 0.6779 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 515.4562 (1.09) 515.4562 (1.09) 515.4562 (1.09) 0.0000 (1.0) 515.4562 (1.09) 0.0000 (1.0) 0;0 1.9400 (0.92) 1 1
test_partial_remove-push-update[3.10.0] 471.9009 (1.0) 471.9009 (1.0) 471.9009 (1.0) 0.0000 (1.0) 471.9009 (1.0) 0.0000 (1.0) 0;0 2.1191 (1.0) 1 1
test_partial_remove-push-update[main] 793.8418 (1.68) 793.8418 (1.68) 793.8418 (1.68) 0.0000 (1.0) 793.8418 (1.68) 0.0000 (1.0) 0;0 1.2597 (0.59) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 419.8581 (1.0) 430.0220 (1.0) 423.9250 (1.0) 3.9039 (1.37) 423.5226 (1.0) 5.0872 (1.73) 2;0 2.3589 (1.0) 5 3
test_plots-plots-diff[3.10.0] 770.1509 (1.83) 777.8920 (1.81) 773.3804 (1.82) 2.8442 (1.0) 773.2295 (1.83) 2.9482 (1.0) 2;0 1.2930 (0.55) 5 3
test_plots-plots-diff[main] 724.6464 (1.73) 759.4189 (1.77) 737.2361 (1.74) 16.1480 (5.68) 727.0995 (1.72) 26.7418 (9.07) 1;0 1.3564 (0.58) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 431.1735 (1.0) 443.9880 (1.0) 437.7159 (1.0) 5.3231 (1.22) 436.2819 (1.0) 8.7852 (1.52) 2;0 2.2846 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,028.9941 (2.39) 1,040.5100 (2.34) 1,034.0662 (2.36) 4.3742 (1.0) 1,032.7449 (2.37) 5.7915 (1.0) 2;0 0.9671 (0.42) 5 3
test_plots-plots-diff-json[main] 804.0702 (1.86) 816.3322 (1.84) 808.3440 (1.85) 5.1608 (1.18) 806.1990 (1.85) 7.6430 (1.32) 1;0 1.2371 (0.54) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 390.1588 (1.0) 412.4819 (1.0) 398.3906 (1.0) 9.5827 (3.39) 392.6582 (1.0) 14.3348 (2.93) 1;0 2.5101 (1.0) 5 3
test_plots-plots-show[3.10.0] 638.6234 (1.64) 657.3164 (1.59) 644.7806 (1.62) 7.3841 (2.61) 643.6060 (1.64) 7.6960 (1.57) 1;0 1.5509 (0.62) 5 3
test_plots-plots-show[main] 615.5803 (1.58) 622.2099 (1.51) 619.1102 (1.55) 2.8243 (1.0) 619.8363 (1.58) 4.8865 (1.0) 2;0 1.6152 (0.64) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 402.2881 (1.0) 416.5716 (1.0) 407.9985 (1.0) 6.2081 (2.27) 404.9165 (1.0) 10.1549 (2.53) 1;0 2.4510 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 786.5391 (1.96) 793.3576 (1.90) 789.4419 (1.93) 2.7353 (1.0) 788.2434 (1.95) 4.0078 (1.0) 2;0 1.2667 (0.52) 5 3
test_plots-plots-show-json[main] 661.7270 (1.64) 669.6613 (1.61) 665.6695 (1.63) 3.6582 (1.34) 666.9146 (1.65) 6.6869 (1.67) 3;0 1.5022 (0.61) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 3.4391 (2.22) 3.4391 (2.22) 3.4391 (2.22) 0.0000 (1.0) 3.4391 (2.22) 0.0000 (1.0) 0;0 0.2908 (0.45) 1 1
test_push-push[3.10.0] 1.8859 (1.22) 1.8859 (1.22) 1.8859 (1.22) 0.0000 (1.0) 1.8859 (1.22) 0.0000 (1.0) 0;0 0.5302 (0.82) 1 1
test_push-push[main] 1.5505 (1.0) 1.5505 (1.0) 1.5505 (1.0) 0.0000 (1.0) 1.5505 (1.0) 0.0000 (1.0) 0;0 0.6450 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2] 3.6387 (1.06) 3.6387 (1.06) 3.6387 (1.06) 0.0000 (1.0) 3.6387 (1.06) 0.0000 (1.0) 0;0 0.2748 (0.94) 1 1
test_sharing-add[3.10.0] 3.5593 (1.04) 3.5593 (1.04) 3.5593 (1.04) 0.0000 (1.0) 3.5593 (1.04) 0.0000 (1.0) 0;0 0.2810 (0.97) 1 1
test_sharing-add[main] 3.4353 (1.0) 3.4353 (1.0) 3.4353 (1.0) 0.0000 (1.0) 3.4353 (1.0) 0.0000 (1.0) 0;0 0.2911 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2] 2.4056 (1.03) 2.4056 (1.03) 2.4056 (1.03) 0.0000 (1.0) 2.4056 (1.03) 0.0000 (1.0) 0;0 0.4157 (0.97) 1 1
test_sharing-add-noop[3.10.0] 2.4686 (1.05) 2.4686 (1.05) 2.4686 (1.05) 0.0000 (1.0) 2.4686 (1.05) 0.0000 (1.0) 0;0 0.4051 (0.95) 1 1
test_sharing-add-noop[main] 2.3428 (1.0) 2.3428 (1.0) 2.3428 (1.0) 0.0000 (1.0) 2.3428 (1.0) 0.0000 (1.0) 0;0 0.4268 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2] 1.7505 (1.24) 1.7505 (1.24) 1.7505 (1.24) 0.0000 (1.0) 1.7505 (1.24) 0.0000 (1.0) 0;0 0.5713 (0.80) 1 1
test_sharing-checkout[3.10.0] 3.6786 (2.61) 3.6786 (2.61) 3.6786 (2.61) 0.0000 (1.0) 3.6786 (2.61) 0.0000 (1.0) 0;0 0.2718 (0.38) 1 1
test_sharing-checkout[main] 1.4089 (1.0) 1.4089 (1.0) 1.4089 (1.0) 0.0000 (1.0) 1.4089 (1.0) 0.0000 (1.0) 0;0 0.7098 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2] 579.2683 (1.04) 579.2683 (1.04) 579.2683 (1.04) 0.0000 (1.0) 579.2683 (1.04) 0.0000 (1.0) 0;0 1.7263 (0.96) 1 1
test_sharing-checkout-noop[3.10.0] 574.9631 (1.03) 574.9631 (1.03) 574.9631 (1.03) 0.0000 (1.0) 574.9631 (1.03) 0.0000 (1.0) 0;0 1.7392 (0.97) 1 1
test_sharing-checkout-noop[main] 556.5078 (1.0) 556.5078 (1.0) 556.5078 (1.0) 0.0000 (1.0) 556.5078 (1.0) 0.0000 (1.0) 0;0 1.7969 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 3.8295 (2.04) 3.8295 (2.04) 3.8295 (2.04) 0.0000 (1.0) 3.8295 (2.04) 0.0000 (1.0) 0;0 0.2611 (0.49) 1 1
test_sharing-fetch[3.10.0] 4.2882 (2.28) 4.2882 (2.28) 4.2882 (2.28) 0.0000 (1.0) 4.2882 (2.28) 0.0000 (1.0) 0;0 0.2332 (0.44) 1 1
test_sharing-fetch[main] 1.8768 (1.0) 1.8768 (1.0) 1.8768 (1.0) 0.0000 (1.0) 1.8768 (1.0) 0.0000 (1.0) 0;0 0.5328 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 439.2282 (1.0) 439.2282 (1.0) 439.2282 (1.0) 0.0000 (1.0) 439.2282 (1.0) 0.0000 (1.0) 0;0 2.2767 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 503.1894 (1.15) 503.1894 (1.15) 503.1894 (1.15) 0.0000 (1.0) 503.1894 (1.15) 0.0000 (1.0) 0;0 1.9873 (0.87) 1 1
test_sharing-fetch-noop[main] 799.0982 (1.82) 799.0982 (1.82) 799.0982 (1.82) 0.0000 (1.0) 799.0982 (1.82) 0.0000 (1.0) 0;0 1.2514 (0.55) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 3.3880 (2.25) 3.3880 (2.25) 3.3880 (2.25) 0.0000 (1.0) 3.3880 (2.25) 0.0000 (1.0) 0;0 0.2952 (0.44) 1 1
test_sharing-push[3.10.0] 1.8847 (1.25) 1.8847 (1.25) 1.8847 (1.25) 0.0000 (1.0) 1.8847 (1.25) 0.0000 (1.0) 0;0 0.5306 (0.80) 1 1
test_sharing-push[main] 1.5032 (1.0) 1.5032 (1.0) 1.5032 (1.0) 0.0000 (1.0) 1.5032 (1.0) 0.0000 (1.0) 0;0 0.6652 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 448.9480 (1.03) 448.9480 (1.03) 448.9480 (1.03) 0.0000 (1.0) 448.9480 (1.03) 0.0000 (1.0) 0;0 2.2274 (0.97) 1 1
test_sharing-push-noop[3.10.0] 436.5034 (1.0) 436.5034 (1.0) 436.5034 (1.0) 0.0000 (1.0) 436.5034 (1.0) 0.0000 (1.0) 0;0 2.2909 (1.0) 1 1
test_sharing-push-noop[main] 836.9806 (1.92) 836.9806 (1.92) 836.9806 (1.92) 0.0000 (1.0) 836.9806 (1.92) 0.0000 (1.0) 0;0 1.1948 (0.52) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.1987 (1.00) 1.1987 (1.00) 1.1987 (1.00) 0.0000 (1.0) 1.1987 (1.00) 0.0000 (1.0) 0;0 0.8343 (1.00) 1 1
test_status-status[3.10.0] 1.2187 (1.02) 1.2187 (1.02) 1.2187 (1.02) 0.0000 (1.0) 1.2187 (1.02) 0.0000 (1.0) 0;0 0.8205 (0.98) 1 1
test_status-status[main] 1.1971 (1.0) 1.1971 (1.0) 1.1971 (1.0) 0.0000 (1.0) 1.1971 (1.0) 0.0000 (1.0) 0;0 0.8353 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 529.1568 (1.0) 529.1568 (1.0) 529.1568 (1.0) 0.0000 (1.0) 529.1568 (1.0) 0.0000 (1.0) 0;0 1.8898 (1.0) 1 1
test_status-status-changed[3.10.0] 558.5229 (1.06) 558.5229 (1.06) 558.5229 (1.06) 0.0000 (1.0) 558.5229 (1.06) 0.0000 (1.0) 0;0 1.7904 (0.95) 1 1
test_status-status-changed[main] 535.7195 (1.01) 535.7195 (1.01) 535.7195 (1.01) 0.0000 (1.0) 535.7195 (1.01) 0.0000 (1.0) 0;0 1.8666 (0.99) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 538.7677 (1.03) 538.7677 (1.03) 538.7677 (1.03) 0.0000 (1.0) 538.7677 (1.03) 0.0000 (1.0) 0;0 1.8561 (0.97) 1 1
test_status-status-changed-noop[3.10.0] 557.0436 (1.07) 557.0436 (1.07) 557.0436 (1.07) 0.0000 (1.0) 557.0436 (1.07) 0.0000 (1.0) 0;0 1.7952 (0.94) 1 1
test_status-status-changed-noop[main] 522.9308 (1.0) 522.9308 (1.0) 522.9308 (1.0) 0.0000 (1.0) 522.9308 (1.0) 0.0000 (1.0) 0;0 1.9123 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 537.1845 (1.01) 537.1845 (1.01) 537.1845 (1.01) 0.0000 (1.0) 537.1845 (1.01) 0.0000 (1.0) 0;0 1.8616 (0.99) 1 1
test_status-status-noop[3.10.0] 555.7470 (1.04) 555.7470 (1.04) 555.7470 (1.04) 0.0000 (1.0) 555.7470 (1.04) 0.0000 (1.0) 0;0 1.7994 (0.96) 1 1
test_status-status-noop[main] 534.4877 (1.0) 534.4877 (1.0) 534.4877 (1.0) 0.0000 (1.0) 534.4877 (1.0) 0.0000 (1.0) 0;0 1.8710 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 7.3846 (1.44) 7.3846 (1.44) 7.3846 (1.44) 0.0000 (1.0) 7.3846 (1.44) 0.0000 (1.0) 0;0 0.1354 (0.69) 1 1
test_update-import-url[3.10.0] 7.5109 (1.47) 7.5109 (1.47) 7.5109 (1.47) 0.0000 (1.0) 7.5109 (1.47) 0.0000 (1.0) 0;0 0.1331 (0.68) 1 1
test_update-import-url[main] 5.1118 (1.0) 5.1118 (1.0) 5.1118 (1.0) 0.0000 (1.0) 5.1118 (1.0) 0.0000 (1.0) 0;0 0.1956 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 6.5653 (1.49) 6.5653 (1.49) 6.5653 (1.49) 0.0000 (1.0) 6.5653 (1.49) 0.0000 (1.0) 0;0 0.1523 (0.67) 1 1
test_update-update[3.10.0] 6.8275 (1.55) 6.8275 (1.55) 6.8275 (1.55) 0.0000 (1.0) 6.8275 (1.55) 0.0000 (1.0) 0;0 0.1465 (0.65) 1 1
test_update-update[main] 4.4145 (1.0) 4.4145 (1.0) 4.4145 (1.0) 0.0000 (1.0) 4.4145 (1.0) 0.0000 (1.0) 0;0 0.2265 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 978.6964 (1.01) 978.6964 (1.01) 978.6964 (1.01) 0.0000 (1.0) 978.6964 (1.01) 0.0000 (1.0) 0;0 1.0218 (0.99) 1 1
test_update-update-noop[3.10.0] 1,012.5790 (1.05) 1,012.5790 (1.05) 1,012.5790 (1.05) 0.0000 (1.0) 1,012.5790 (1.05) 0.0000 (1.0) 0;0 0.9876 (0.95) 1 1
test_update-update-noop[main] 966.8281 (1.0) 966.8281 (1.0) 966.8281 (1.0) 0.0000 (1.0) 966.8281 (1.0) 0.0000 (1.0) 0;0 1.0343 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
Bumps actions/upload-pages-artifact from 2 to 3.
Release notes
Sourced from actions/upload-pages-artifact's releases.
Commits
0252fc4
Merge pull request #81 from actions/artifacts-next2a5c144
Use actions/download-artifact@v4 in test7e3f6bb
Merge pull request #80 from robherley/patch-1257e666
Usev4
upload-artifact tag0313a19
Merge pull request #78 from konradpabjan/main1228e65
Update action.ymleb31309
Update artifact names in tests241a975
Correct artifact name during downloadef95519
Unique artifact name per jobecdd3ed
Switch to using download@v4-betaYou can trigger a rebase of this PR by commenting
@dependabot rebase
.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show