github-actions[bot]
commented
5 months ago
Mon Apr 15 19:58:08 UTC 2024
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add[2.58.2] 4.0288 (1.02) 4.0288 (1.02) 4.0288 (1.02) 0.0000 (1.0) 4.0288 (1.02) 0.0000 (1.0) 0;0 0.2482 (0.98) 1 1
test_add-add[3.10.0] 4.3415 (1.10) 4.3415 (1.10) 4.3415 (1.10) 0.0000 (1.0) 4.3415 (1.10) 0.0000 (1.0) 0;0 0.2303 (0.91) 1 1
test_add-add[main] 3.9320 (1.0) 3.9320 (1.0) 3.9320 (1.0) 0.0000 (1.0) 3.9320 (1.0) 0.0000 (1.0) 0;0 0.2543 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 1.9043 (1.21) 1.9043 (1.21) 1.9043 (1.21) 0.0000 (1.0) 1.9043 (1.21) 0.0000 (1.0) 0;0 0.5251 (0.82) 1 1
test_checkout_copy-checkout[3.10.0] 3.8784 (2.47) 3.8784 (2.47) 3.8784 (2.47) 0.0000 (1.0) 3.8784 (2.47) 0.0000 (1.0) 0;0 0.2578 (0.40) 1 1
test_checkout_copy-checkout[main] 1.5682 (1.0) 1.5682 (1.0) 1.5682 (1.0) 0.0000 (1.0) 1.5682 (1.0) 0.0000 (1.0) 0;0 0.6377 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 558.7128 (1.01) 558.7128 (1.01) 558.7128 (1.01) 0.0000 (1.0) 558.7128 (1.01) 0.0000 (1.0) 0;0 1.7898 (0.99) 1 1
test_checkout_copy-checkout-noop[3.10.0] 577.3104 (1.04) 577.3104 (1.04) 577.3104 (1.04) 0.0000 (1.0) 577.3104 (1.04) 0.0000 (1.0) 0;0 1.7322 (0.96) 1 1
test_checkout_copy-checkout-noop[main] 552.5920 (1.0) 552.5920 (1.0) 552.5920 (1.0) 0.0000 (1.0) 552.5920 (1.0) 0.0000 (1.0) 0;0 1.8097 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 713.3383 (1.14) 713.3383 (1.14) 713.3383 (1.14) 0.0000 (1.0) 713.3383 (1.14) 0.0000 (1.0) 0;0 1.4019 (0.88) 1 1
test_checkout_copy-checkout-update[3.10.0] 647.6236 (1.04) 647.6236 (1.04) 647.6236 (1.04) 0.0000 (1.0) 647.6236 (1.04) 0.0000 (1.0) 0;0 1.5441 (0.97) 1 1
test_checkout_copy-checkout-update[main] 625.0484 (1.0) 625.0484 (1.0) 625.0484 (1.0) 0.0000 (1.0) 625.0484 (1.0) 0.0000 (1.0) 0;0 1.5999 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.2581 (1.13) 1.2581 (1.13) 1.2581 (1.13) 0.0000 (1.0) 1.2581 (1.13) 0.0000 (1.0) 0;0 0.7949 (0.88) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.1227 (1.01) 1.1227 (1.01) 1.1227 (1.01) 0.0000 (1.0) 1.1227 (1.01) 0.0000 (1.0) 0;0 0.8907 (0.99) 1 1
test_checkout_hardlink-checkout[main] 1.1098 (1.0) 1.1098 (1.0) 1.1098 (1.0) 0.0000 (1.0) 1.1098 (1.0) 0.0000 (1.0) 0;0 0.9011 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 578.7983 (1.0) 578.7983 (1.0) 578.7983 (1.0) 0.0000 (1.0) 578.7983 (1.0) 0.0000 (1.0) 0;0 1.7277 (1.0) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 610.1997 (1.05) 610.1997 (1.05) 610.1997 (1.05) 0.0000 (1.0) 610.1997 (1.05) 0.0000 (1.0) 0;0 1.6388 (0.95) 1 1
test_checkout_hardlink-checkout-noop[main] 584.5895 (1.01) 584.5895 (1.01) 584.5895 (1.01) 0.0000 (1.0) 584.5895 (1.01) 0.0000 (1.0) 0;0 1.7106 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 724.8898 (1.12) 724.8898 (1.12) 724.8898 (1.12) 0.0000 (1.0) 724.8898 (1.12) 0.0000 (1.0) 0;0 1.3795 (0.89) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 650.8420 (1.00) 650.8420 (1.00) 650.8420 (1.00) 0.0000 (1.0) 650.8420 (1.00) 0.0000 (1.0) 0;0 1.5365 (1.00) 1 1
test_checkout_hardlink-checkout-update[main] 647.8585 (1.0) 647.8585 (1.0) 647.8585 (1.0) 0.0000 (1.0) 647.8585 (1.0) 0.0000 (1.0) 0;0 1.5435 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.3460 (1.17) 1.3460 (1.17) 1.3460 (1.17) 0.0000 (1.0) 1.3460 (1.17) 0.0000 (1.0) 0;0 0.7430 (0.85) 1 1
test_checkout_symlink-checkout[3.10.0] 1.2739 (1.11) 1.2739 (1.11) 1.2739 (1.11) 0.0000 (1.0) 1.2739 (1.11) 0.0000 (1.0) 0;0 0.7850 (0.90) 1 1
test_checkout_symlink-checkout[main] 1.1496 (1.0) 1.1496 (1.0) 1.1496 (1.0) 0.0000 (1.0) 1.1496 (1.0) 0.0000 (1.0) 0;0 0.8699 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 638.2936 (1.09) 638.2936 (1.09) 638.2936 (1.09) 0.0000 (1.0) 638.2936 (1.09) 0.0000 (1.0) 0;0 1.5667 (0.92) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 615.0158 (1.05) 615.0158 (1.05) 615.0158 (1.05) 0.0000 (1.0) 615.0158 (1.05) 0.0000 (1.0) 0;0 1.6260 (0.95) 1 1
test_checkout_symlink-checkout-noop[main] 585.6001 (1.0) 585.6001 (1.0) 585.6001 (1.0) 0.0000 (1.0) 585.6001 (1.0) 0.0000 (1.0) 0;0 1.7076 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 758.7424 (1.11) 758.7424 (1.11) 758.7424 (1.11) 0.0000 (1.0) 758.7424 (1.11) 0.0000 (1.0) 0;0 1.3180 (0.90) 1 1
test_checkout_symlink-checkout-update[3.10.0] 712.7705 (1.04) 712.7705 (1.04) 712.7705 (1.04) 0.0000 (1.0) 712.7705 (1.04) 0.0000 (1.0) 0;0 1.4030 (0.96) 1 1
test_checkout_symlink-checkout-update[main] 685.2120 (1.0) 685.2120 (1.0) 685.2120 (1.0) 0.0000 (1.0) 685.2120 (1.0) 0.0000 (1.0) 0;0 1.4594 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 636.5373 (1.11) 636.5373 (1.11) 636.5373 (1.11) 0.0000 (1.0) 636.5373 (1.11) 0.0000 (1.0) 0;0 1.5710 (0.90) 1 1
test_data_status-data-changed[3.10.0] 600.7688 (1.04) 600.7688 (1.04) 600.7688 (1.04) 0.0000 (1.0) 600.7688 (1.04) 0.0000 (1.0) 0;0 1.6645 (0.96) 1 1
test_data_status-data-changed[main] 575.0027 (1.0) 575.0027 (1.0) 575.0027 (1.0) 0.0000 (1.0) 575.0027 (1.0) 0.0000 (1.0) 0;0 1.7391 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 611.7151 (1.08) 611.7151 (1.08) 611.7151 (1.08) 0.0000 (1.0) 611.7151 (1.08) 0.0000 (1.0) 0;0 1.6347 (0.93) 1 1
test_data_status-data-changed-noop[3.10.0] 613.1988 (1.08) 613.1988 (1.08) 613.1988 (1.08) 0.0000 (1.0) 613.1988 (1.08) 0.0000 (1.0) 0;0 1.6308 (0.93) 1 1
test_data_status-data-changed-noop[main] 567.9304 (1.0) 567.9304 (1.0) 567.9304 (1.0) 0.0000 (1.0) 567.9304 (1.0) 0.0000 (1.0) 0;0 1.7608 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.2548 (1.02) 1.2548 (1.02) 1.2548 (1.02) 0.0000 (1.0) 1.2548 (1.02) 0.0000 (1.0) 0;0 0.7970 (0.98) 1 1
test_data_status-data-new[3.10.0] 1.2760 (1.04) 1.2760 (1.04) 1.2760 (1.04) 0.0000 (1.0) 1.2760 (1.04) 0.0000 (1.0) 0;0 0.7837 (0.97) 1 1
test_data_status-data-new[main] 1.2324 (1.0) 1.2324 (1.0) 1.2324 (1.0) 0.0000 (1.0) 1.2324 (1.0) 0.0000 (1.0) 0;0 0.8114 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 598.8407 (1.02) 598.8407 (1.02) 598.8407 (1.02) 0.0000 (1.0) 598.8407 (1.02) 0.0000 (1.0) 0;0 1.6699 (0.98) 1 1
test_data_status-data-noop[3.10.0] 603.4742 (1.03) 603.4742 (1.03) 603.4742 (1.03) 0.0000 (1.0) 603.4742 (1.03) 0.0000 (1.0) 0;0 1.6571 (0.97) 1 1
test_data_status-data-noop[main] 587.2930 (1.0) 587.2930 (1.0) 587.2930 (1.0) 0.0000 (1.0) 587.2930 (1.0) 0.0000 (1.0) 0;0 1.7027 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.0213 (1.01) 1.0213 (1.01) 1.0213 (1.01) 0.0000 (1.0) 1.0213 (1.01) 0.0000 (1.0) 0;0 0.9791 (0.99) 1 1
test_data_status_all_flags-data-changed[3.10.0] 1.0173 (1.00) 1.0173 (1.00) 1.0173 (1.00) 0.0000 (1.0) 1.0173 (1.00) 0.0000 (1.0) 0;0 0.9830 (1.00) 1 1
test_data_status_all_flags-data-changed[main] 1.0137 (1.0) 1.0137 (1.0) 1.0137 (1.0) 0.0000 (1.0) 1.0137 (1.0) 0.0000 (1.0) 0;0 0.9864 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.0595 (1.04) 1.0595 (1.04) 1.0595 (1.04) 0.0000 (1.0) 1.0595 (1.04) 0.0000 (1.0) 0;0 0.9438 (0.96) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 1.0153 (1.00) 1.0153 (1.00) 1.0153 (1.00) 0.0000 (1.0) 1.0153 (1.00) 0.0000 (1.0) 0;0 0.9850 (1.00) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.0148 (1.0) 1.0148 (1.0) 1.0148 (1.0) 0.0000 (1.0) 1.0148 (1.0) 0.0000 (1.0) 0;0 0.9854 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 1.6723 (1.0) 1.6723 (1.0) 1.6723 (1.0) 0.0000 (1.0) 1.6723 (1.0) 0.0000 (1.0) 0;0 0.5980 (1.0) 1 1
test_data_status_all_flags-data-new[3.10.0] 1.6735 (1.00) 1.6735 (1.00) 1.6735 (1.00) 0.0000 (1.0) 1.6735 (1.00) 0.0000 (1.0) 0;0 0.5975 (1.00) 1 1
test_data_status_all_flags-data-new[main] 1.6771 (1.00) 1.6771 (1.00) 1.6771 (1.00) 0.0000 (1.0) 1.6771 (1.00) 0.0000 (1.0) 0;0 0.5963 (1.00) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status_all_flags-data-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 981.3373 (1.0) 981.3373 (1.0) 981.3373 (1.0) 0.0000 (1.0) 981.3373 (1.0) 0.0000 (1.0) 0;0 1.0190 (1.0) 1 1
test_data_status_all_flags-data-noop[3.10.0] 996.5842 (1.02) 996.5842 (1.02) 996.5842 (1.02) 0.0000 (1.0) 996.5842 (1.02) 0.0000 (1.0) 0;0 1.0034 (0.98) 1 1
test_data_status_all_flags-data-noop[main] 993.7909 (1.01) 993.7909 (1.01) 993.7909 (1.01) 0.0000 (1.0) 993.7909 (1.01) 0.0000 (1.0) 0;0 1.0062 (0.99) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.3219 (1.02) 1.3219 (1.02) 1.3219 (1.02) 0.0000 (1.0) 1.3219 (1.02) 0.0000 (1.0) 0;0 0.7565 (0.98) 1 1
test_diff-diff[3.10.0] 1.3014 (1.0) 1.3014 (1.0) 1.3014 (1.0) 0.0000 (1.0) 1.3014 (1.0) 0.0000 (1.0) 0;0 0.7684 (1.0) 1 1
test_diff-diff[main] 1.3045 (1.00) 1.3045 (1.00) 1.3045 (1.00) 0.0000 (1.0) 1.3045 (1.00) 0.0000 (1.0) 0;0 0.7666 (1.00) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 676.9926 (1.07) 676.9926 (1.07) 676.9926 (1.07) 0.0000 (1.0) 676.9926 (1.07) 0.0000 (1.0) 0;0 1.4771 (0.94) 1 1
test_diff-diff-changed[3.10.0] 690.4542 (1.09) 690.4542 (1.09) 690.4542 (1.09) 0.0000 (1.0) 690.4542 (1.09) 0.0000 (1.0) 0;0 1.4483 (0.92) 1 1
test_diff-diff-changed[main] 635.1178 (1.0) 635.1178 (1.0) 635.1178 (1.0) 0.0000 (1.0) 635.1178 (1.0) 0.0000 (1.0) 0;0 1.5745 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 643.2237 (1.02) 643.2237 (1.02) 643.2237 (1.02) 0.0000 (1.0) 643.2237 (1.02) 0.0000 (1.0) 0;0 1.5547 (0.98) 1 1
test_diff-diff-changed-noop[3.10.0] 656.6568 (1.04) 656.6568 (1.04) 656.6568 (1.04) 0.0000 (1.0) 656.6568 (1.04) 0.0000 (1.0) 0;0 1.5229 (0.96) 1 1
test_diff-diff-changed-noop[main] 629.2235 (1.0) 629.2235 (1.0) 629.2235 (1.0) 0.0000 (1.0) 629.2235 (1.0) 0.0000 (1.0) 0;0 1.5893 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 665.1118 (1.05) 665.1118 (1.05) 665.1118 (1.05) 0.0000 (1.0) 665.1118 (1.05) 0.0000 (1.0) 0;0 1.5035 (0.95) 1 1
test_diff-diff-noop[3.10.0] 639.3913 (1.01) 639.3913 (1.01) 639.3913 (1.01) 0.0000 (1.0) 639.3913 (1.01) 0.0000 (1.0) 0;0 1.5640 (0.99) 1 1
test_diff-diff-noop[main] 632.1634 (1.0) 632.1634 (1.0) 632.1634 (1.0) 0.0000 (1.0) 632.1634 (1.0) 0.0000 (1.0) 0;0 1.5819 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 873.2806 (1.0) 873.2806 (1.0) 873.2806 (1.0) 0.0000 (1.0) 873.2806 (1.0) 0.0000 (1.0) 0;0 1.1451 (1.0) 1 1
test_exp_show-exp[3.10.0] 5,404.3376 (6.19) 5,404.3376 (6.19) 5,404.3376 (6.19) 0.0000 (1.0) 5,404.3376 (6.19) 0.0000 (1.0) 0;0 0.1850 (0.16) 1 1
test_exp_show-exp[main] 4,949.5857 (5.67) 4,949.5857 (5.67) 4,949.5857 (5.67) 0.0000 (1.0) 4,949.5857 (5.67) 0.0000 (1.0) 0;0 0.2020 (0.18) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 3.8873 (2.12) 3.8873 (2.12) 3.8873 (2.12) 0.0000 (1.0) 3.8873 (2.12) 0.0000 (1.0) 0;0 0.2572 (0.47) 1 1
test_fetch-fetch[3.10.0] 4.2387 (2.31) 4.2387 (2.31) 4.2387 (2.31) 0.0000 (1.0) 4.2387 (2.31) 0.0000 (1.0) 0;0 0.2359 (0.43) 1 1
test_fetch-fetch[main] 1.8317 (1.0) 1.8317 (1.0) 1.8317 (1.0) 0.0000 (1.0) 1.8317 (1.0) 0.0000 (1.0) 0;0 0.5459 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 501.7960 (1.05) 501.7960 (1.05) 501.7960 (1.05) 0.0000 (1.0) 501.7960 (1.05) 0.0000 (1.0) 0;0 1.9928 (0.95) 1 1
test_gc-gc[3.10.0] 507.5583 (1.06) 507.5583 (1.06) 507.5583 (1.06) 0.0000 (1.0) 507.5583 (1.06) 0.0000 (1.0) 0;0 1.9702 (0.94) 1 1
test_gc-gc[main] 479.0760 (1.0) 479.0760 (1.0) 479.0760 (1.0) 0.0000 (1.0) 479.0760 (1.0) 0.0000 (1.0) 0;0 2.0874 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 5.8905 (1.13) 5.8905 (1.13) 5.8905 (1.13) 0.0000 (1.0) 5.8905 (1.13) 0.0000 (1.0) 0;0 0.1698 (0.89) 1 1
test_get-get[3.10.0] 7.0462 (1.35) 7.0462 (1.35) 7.0462 (1.35) 0.0000 (1.0) 7.0462 (1.35) 0.0000 (1.0) 0;0 0.1419 (0.74) 1 1
test_get-get[main] 5.2330 (1.0) 5.2330 (1.0) 5.2330 (1.0) 0.0000 (1.0) 5.2330 (1.0) 0.0000 (1.0) 0;0 0.1911 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 3.0985 (3.35) 3.0985 (3.35) 3.0985 (3.35) 0.0000 (1.0) 3.0985 (3.35) 0.0000 (1.0) 0;0 0.3227 (0.30) 1 1
test_get_url-get-url[3.10.0] 3.2033 (3.47) 3.2033 (3.47) 3.2033 (3.47) 0.0000 (1.0) 3.2033 (3.47) 0.0000 (1.0) 0;0 0.3122 (0.29) 1 1
test_get_url-get-url[main] 0.9242 (1.0) 0.9242 (1.0) 0.9242 (1.0) 0.0000 (1.0) 0.9242 (1.0) 0.0000 (1.0) 0;0 1.0821 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 127.7743 (1.02) 134.2934 (1.00) 130.9971 (1.02) 1.4143 (1.05) 131.0490 (1.02) 1.8699 (1.17) 29;0 7.6338 (0.98) 100 1
test_help---help[3.10.0] 125.6016 (1.0) 134.0791 (1.0) 128.7719 (1.0) 1.3922 (1.03) 128.7152 (1.0) 1.6952 (1.06) 27;2 7.7657 (1.0) 100 1
test_help---help[main] 127.6822 (1.02) 136.4096 (1.02) 130.8025 (1.02) 1.3457 (1.0) 130.6659 (1.02) 1.5944 (1.0) 24;3 7.6451 (0.98) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 9.2016 (1.10) 9.2016 (1.10) 9.2016 (1.10) 0.0000 (1.0) 9.2016 (1.10) 0.0000 (1.0) 0;0 0.1087 (0.91) 1 1
test_import-import[3.10.0] 10.4895 (1.25) 10.4895 (1.25) 10.4895 (1.25) 0.0000 (1.0) 10.4895 (1.25) 0.0000 (1.0) 0;0 0.0953 (0.80) 1 1
test_import-import[main] 8.3963 (1.0) 8.3963 (1.0) 8.3963 (1.0) 0.0000 (1.0) 8.3963 (1.0) 0.0000 (1.0) 0;0 0.1191 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 7.5314 (1.47) 7.5314 (1.47) 7.5314 (1.47) 0.0000 (1.0) 7.5314 (1.47) 0.0000 (1.0) 0;0 0.1328 (0.68) 1 1
test_import_url-import-url[3.10.0] 7.9445 (1.55) 7.9445 (1.55) 7.9445 (1.55) 0.0000 (1.0) 7.9445 (1.55) 0.0000 (1.0) 0;0 0.1259 (0.64) 1 1
test_import_url-import-url[main] 5.1223 (1.0) 5.1223 (1.0) 5.1223 (1.0) 0.0000 (1.0) 5.1223 (1.0) 0.0000 (1.0) 0;0 0.1952 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_init-init': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 372.9531 (1.0) 440.9591 (1.05) 387.2078 (1.0) 11.4444 (1.50) 383.8884 (1.0) 9.2909 (1.20) 13;8 2.5826 (1.0) 100 1
test_init-init[3.10.0] 378.2811 (1.01) 445.9510 (1.06) 391.6051 (1.01) 7.7215 (1.01) 390.6598 (1.02) 7.7732 (1.0) 16;2 2.5536 (0.99) 100 1
test_init-init[main] 385.5333 (1.03) 421.5476 (1.0) 397.5820 (1.03) 7.6319 (1.0) 395.9682 (1.03) 10.1861 (1.31) 31;2 2.5152 (0.97) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 450.5017 (1.08) 450.5017 (1.08) 450.5017 (1.08) 0.0000 (1.0) 450.5017 (1.08) 0.0000 (1.0) 0;0 2.2197 (0.93) 1 1
test_list-list[3.10.0] 442.5781 (1.06) 442.5781 (1.06) 442.5781 (1.06) 0.0000 (1.0) 442.5781 (1.06) 0.0000 (1.0) 0;0 2.2595 (0.94) 1 1
test_list-list[main] 416.7259 (1.0) 416.7259 (1.0) 416.7259 (1.0) 0.0000 (1.0) 416.7259 (1.0) 0.0000 (1.0) 0;0 2.3997 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 413.1198 (1.02) 413.1198 (1.02) 413.1198 (1.02) 0.0000 (1.0) 413.1198 (1.02) 0.0000 (1.0) 0;0 2.4206 (0.98) 1 1
test_list-list-dvc-only[3.10.0] 418.8681 (1.04) 418.8681 (1.04) 418.8681 (1.04) 0.0000 (1.0) 418.8681 (1.04) 0.0000 (1.0) 0;0 2.3874 (0.96) 1 1
test_list-list-dvc-only[main] 403.4009 (1.0) 403.4009 (1.0) 403.4009 (1.0) 0.0000 (1.0) 403.4009 (1.0) 0.0000 (1.0) 0;0 2.4789 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 496.8540 (1.0) 496.8540 (1.0) 496.8540 (1.0) 0.0000 (1.0) 496.8540 (1.0) 0.0000 (1.0) 0;0 2.0127 (1.0) 1 1
test_list-list-recursive[3.10.0] 511.6118 (1.03) 511.6118 (1.03) 511.6118 (1.03) 0.0000 (1.0) 511.6118 (1.03) 0.0000 (1.0) 0;0 1.9546 (0.97) 1 1
test_list-list-recursive[main] 510.1009 (1.03) 510.1009 (1.03) 510.1009 (1.03) 0.0000 (1.0) 510.1009 (1.03) 0.0000 (1.0) 0;0 1.9604 (0.97) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 426.6603 (1.04) 426.6603 (1.04) 426.6603 (1.04) 0.0000 (1.0) 426.6603 (1.04) 0.0000 (1.0) 0;0 2.3438 (0.96) 1 1
test_list-list-shallow[3.10.0] 410.3825 (1.0) 410.3825 (1.0) 410.3825 (1.0) 0.0000 (1.0) 410.3825 (1.0) 0.0000 (1.0) 0;0 2.4368 (1.0) 1 1
test_list-list-shallow[main] 413.8852 (1.01) 413.8852 (1.01) 413.8852 (1.01) 0.0000 (1.0) 413.8852 (1.01) 0.0000 (1.0) 0;0 2.4161 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.0686 (1.06) 2.0686 (1.06) 2.0686 (1.06) 0.0000 (1.0) 2.0686 (1.06) 0.0000 (1.0) 0;0 0.4834 (0.94) 1 1
test_partial_add-add[3.10.0] 2.3660 (1.21) 2.3660 (1.21) 2.3660 (1.21) 0.0000 (1.0) 2.3660 (1.21) 0.0000 (1.0) 0;0 0.4227 (0.83) 1 1
test_partial_add-add[main] 1.9542 (1.0) 1.9542 (1.0) 1.9542 (1.0) 0.0000 (1.0) 1.9542 (1.0) 0.0000 (1.0) 0;0 0.5117 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 3.1361 (1.05) 3.1361 (1.05) 3.1361 (1.05) 0.0000 (1.0) 3.1361 (1.05) 0.0000 (1.0) 0;0 0.3189 (0.95) 1 1
test_partial_add-add-partial[3.10.0] 3.1094 (1.04) 3.1094 (1.04) 3.1094 (1.04) 0.0000 (1.0) 3.1094 (1.04) 0.0000 (1.0) 0;0 0.3216 (0.96) 1 1
test_partial_add-add-partial[main] 2.9929 (1.0) 2.9929 (1.0) 2.9929 (1.0) 0.0000 (1.0) 2.9929 (1.0) 0.0000 (1.0) 0;0 0.3341 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 568.0692 (1.0) 568.0692 (1.0) 568.0692 (1.0) 0.0000 (1.0) 568.0692 (1.0) 0.0000 (1.0) 0;0 1.7603 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 641.3864 (1.13) 641.3864 (1.13) 641.3864 (1.13) 0.0000 (1.0) 641.3864 (1.13) 0.0000 (1.0) 0;0 1.5591 (0.89) 1 1
test_partial_add-gc-cloud-noop[main] 678.9594 (1.20) 678.9594 (1.20) 678.9594 (1.20) 0.0000 (1.0) 678.9594 (1.20) 0.0000 (1.0) 0;0 1.4728 (0.84) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 477.5377 (1.0) 477.5377 (1.0) 477.5377 (1.0) 0.0000 (1.0) 477.5377 (1.0) 0.0000 (1.0) 0;0 2.0941 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 565.7619 (1.18) 565.7619 (1.18) 565.7619 (1.18) 0.0000 (1.0) 565.7619 (1.18) 0.0000 (1.0) 0;0 1.7675 (0.84) 1 1
test_partial_add-gc-noop[main] 545.3335 (1.14) 545.3335 (1.14) 545.3335 (1.14) 0.0000 (1.0) 545.3335 (1.14) 0.0000 (1.0) 0;0 1.8337 (0.88) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 1.9261 (1.83) 1.9261 (1.83) 1.9261 (1.83) 0.0000 (1.0) 1.9261 (1.83) 0.0000 (1.0) 0;0 0.5192 (0.55) 1 1
test_partial_add-push[3.10.0] 1.1540 (1.09) 1.1540 (1.09) 1.1540 (1.09) 0.0000 (1.0) 1.1540 (1.09) 0.0000 (1.0) 0;0 0.8665 (0.91) 1 1
test_partial_add-push[main] 1.0551 (1.0) 1.0551 (1.0) 1.0551 (1.0) 0.0000 (1.0) 1.0551 (1.0) 0.0000 (1.0) 0;0 0.9478 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 1.9866 (1.69) 1.9866 (1.69) 1.9866 (1.69) 0.0000 (1.0) 1.9866 (1.69) 0.0000 (1.0) 0;0 0.5034 (0.59) 1 1
test_partial_add-push-partial[3.10.0] 1.2166 (1.03) 1.2166 (1.03) 1.2166 (1.03) 0.0000 (1.0) 1.2166 (1.03) 0.0000 (1.0) 0;0 0.8219 (0.97) 1 1
test_partial_add-push-partial[main] 1.1764 (1.0) 1.1764 (1.0) 1.1764 (1.0) 0.0000 (1.0) 1.1764 (1.0) 0.0000 (1.0) 0;0 0.8500 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.6404 (1.05) 3.6404 (1.05) 3.6404 (1.05) 0.0000 (1.0) 3.6404 (1.05) 0.0000 (1.0) 0;0 0.2747 (0.95) 1 1
test_partial_remove-add[3.10.0] 3.7801 (1.09) 3.7801 (1.09) 3.7801 (1.09) 0.0000 (1.0) 3.7801 (1.09) 0.0000 (1.0) 0;0 0.2645 (0.92) 1 1
test_partial_remove-add[main] 3.4608 (1.0) 3.4608 (1.0) 3.4608 (1.0) 0.0000 (1.0) 3.4608 (1.0) 0.0000 (1.0) 0;0 0.2890 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.5957 (1.10) 1.5957 (1.10) 1.5957 (1.10) 0.0000 (1.0) 1.5957 (1.10) 0.0000 (1.0) 0;0 0.6267 (0.91) 1 1
test_partial_remove-add-update[3.10.0] 1.6183 (1.11) 1.6183 (1.11) 1.6183 (1.11) 0.0000 (1.0) 1.6183 (1.11) 0.0000 (1.0) 0;0 0.6179 (0.90) 1 1
test_partial_remove-add-update[main] 1.4517 (1.0) 1.4517 (1.0) 1.4517 (1.0) 0.0000 (1.0) 1.4517 (1.0) 0.0000 (1.0) 0;0 0.6889 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 507.3755 (1.0) 507.3755 (1.0) 507.3755 (1.0) 0.0000 (1.0) 507.3755 (1.0) 0.0000 (1.0) 0;0 1.9709 (1.0) 1 1
test_partial_remove-gc[3.10.0] 555.6181 (1.10) 555.6181 (1.10) 555.6181 (1.10) 0.0000 (1.0) 555.6181 (1.10) 0.0000 (1.0) 0;0 1.7998 (0.91) 1 1
test_partial_remove-gc[main] 544.5808 (1.07) 544.5808 (1.07) 544.5808 (1.07) 0.0000 (1.0) 544.5808 (1.07) 0.0000 (1.0) 0;0 1.8363 (0.93) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 603.7271 (1.0) 603.7271 (1.0) 603.7271 (1.0) 0.0000 (1.0) 603.7271 (1.0) 0.0000 (1.0) 0;0 1.6564 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 688.0869 (1.14) 688.0869 (1.14) 688.0869 (1.14) 0.0000 (1.0) 688.0869 (1.14) 0.0000 (1.0) 0;0 1.4533 (0.88) 1 1
test_partial_remove-gc-cloud[main] 627.5495 (1.04) 627.5495 (1.04) 627.5495 (1.04) 0.0000 (1.0) 627.5495 (1.04) 0.0000 (1.0) 0;0 1.5935 (0.96) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 3.4692 (2.27) 3.4692 (2.27) 3.4692 (2.27) 0.0000 (1.0) 3.4692 (2.27) 0.0000 (1.0) 0;0 0.2883 (0.44) 1 1
test_partial_remove-push[3.10.0] 1.9592 (1.28) 1.9592 (1.28) 1.9592 (1.28) 0.0000 (1.0) 1.9592 (1.28) 0.0000 (1.0) 0;0 0.5104 (0.78) 1 1
test_partial_remove-push[main] 1.5282 (1.0) 1.5282 (1.0) 1.5282 (1.0) 0.0000 (1.0) 1.5282 (1.0) 0.0000 (1.0) 0;0 0.6544 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 497.6866 (1.01) 497.6866 (1.01) 497.6866 (1.01) 0.0000 (1.0) 497.6866 (1.01) 0.0000 (1.0) 0;0 2.0093 (0.99) 1 1
test_partial_remove-push-update[3.10.0] 493.3342 (1.0) 493.3342 (1.0) 493.3342 (1.0) 0.0000 (1.0) 493.3342 (1.0) 0.0000 (1.0) 0;0 2.0270 (1.0) 1 1
test_partial_remove-push-update[main] 785.4005 (1.59) 785.4005 (1.59) 785.4005 (1.59) 0.0000 (1.0) 785.4005 (1.59) 0.0000 (1.0) 0;0 1.2732 (0.63) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 421.9833 (1.0) 426.3696 (1.0) 424.7994 (1.0) 1.7259 (1.0) 425.0099 (1.0) 2.1242 (1.0) 1;0 2.3541 (1.0) 5 3
test_plots-plots-diff[3.10.0] 786.9934 (1.86) 796.2394 (1.87) 790.3975 (1.86) 3.6662 (2.12) 789.8356 (1.86) 4.9039 (2.31) 1;0 1.2652 (0.54) 5 3
test_plots-plots-diff[main] 750.2596 (1.78) 762.5457 (1.79) 755.6704 (1.78) 4.7642 (2.76) 753.9384 (1.77) 6.6227 (3.12) 2;0 1.3233 (0.56) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 438.6672 (1.0) 443.8209 (1.0) 440.3296 (1.0) 2.0973 (1.53) 439.7333 (1.0) 2.5989 (1.14) 1;0 2.2710 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,034.9339 (2.36) 1,038.1025 (2.34) 1,036.6509 (2.35) 1.3713 (1.0) 1,036.1666 (2.36) 2.2737 (1.0) 2;0 0.9646 (0.42) 5 3
test_plots-plots-diff-json[main] 821.3031 (1.87) 834.3261 (1.88) 829.2112 (1.88) 4.9131 (3.58) 829.8331 (1.89) 5.6536 (2.49) 2;0 1.2060 (0.53) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 3 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 388.0529 (1.0) 395.0304 (1.0) 390.3959 (1.0) 2.8339 (1.15) 388.9873 (1.0) 3.5132 (1.0) 1;0 2.5615 (1.0) 5 3
test_plots-plots-show[3.10.0] 651.7031 (1.68) 657.3301 (1.66) 654.8948 (1.68) 2.4555 (1.0) 654.6744 (1.68) 4.3067 (1.23) 1;0 1.5270 (0.60) 5 3
test_plots-plots-show[main] 632.9486 (1.63) 661.3828 (1.67) 645.1641 (1.65) 11.1505 (4.54) 645.9318 (1.66) 16.1772 (4.60) 2;0 1.5500 (0.61) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 400.2459 (1.0) 407.4201 (1.0) 404.1096 (1.0) 2.6335 (1.0) 403.9047 (1.0) 3.1034 (1.0) 2;0 2.4746 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 788.0898 (1.97) 809.7548 (1.99) 797.2610 (1.97) 7.8413 (2.98) 796.6220 (1.97) 6.8098 (2.19) 2;0 1.2543 (0.51) 5 3
test_plots-plots-show-json[main] 676.8338 (1.69) 689.8428 (1.69) 685.1938 (1.70) 5.5417 (2.10) 688.4685 (1.70) 8.0572 (2.60) 1;0 1.4594 (0.59) 5 3
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 3.4262 (2.36) 3.4262 (2.36) 3.4262 (2.36) 0.0000 (1.0) 3.4262 (2.36) 0.0000 (1.0) 0;0 0.2919 (0.42) 1 1
test_push-push[3.10.0] 1.9165 (1.32) 1.9165 (1.32) 1.9165 (1.32) 0.0000 (1.0) 1.9165 (1.32) 0.0000 (1.0) 0;0 0.5218 (0.76) 1 1
test_push-push[main] 1.4498 (1.0) 1.4498 (1.0) 1.4498 (1.0) 0.0000 (1.0) 1.4498 (1.0) 0.0000 (1.0) 0;0 0.6897 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-add': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add[2.58.2] 3.5871 (1.03) 3.5871 (1.03) 3.5871 (1.03) 0.0000 (1.0) 3.5871 (1.03) 0.0000 (1.0) 0;0 0.2788 (0.97) 1 1
test_sharing-add[3.10.0] 3.5941 (1.04) 3.5941 (1.04) 3.5941 (1.04) 0.0000 (1.0) 3.5941 (1.04) 0.0000 (1.0) 0;0 0.2782 (0.96) 1 1
test_sharing-add[main] 3.4660 (1.0) 3.4660 (1.0) 3.4660 (1.0) 0.0000 (1.0) 3.4660 (1.0) 0.0000 (1.0) 0;0 0.2885 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop[2.58.2] 2.4308 (1.06) 2.4308 (1.06) 2.4308 (1.06) 0.0000 (1.0) 2.4308 (1.06) 0.0000 (1.0) 0;0 0.4114 (0.94) 1 1
test_sharing-add-noop[3.10.0] 2.5177 (1.10) 2.5177 (1.10) 2.5177 (1.10) 0.0000 (1.0) 2.5177 (1.10) 0.0000 (1.0) 0;0 0.3972 (0.91) 1 1
test_sharing-add-noop[main] 2.2936 (1.0) 2.2936 (1.0) 2.2936 (1.0) 0.0000 (1.0) 2.2936 (1.0) 0.0000 (1.0) 0;0 0.4360 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout[2.58.2] 1.8471 (1.35) 1.8471 (1.35) 1.8471 (1.35) 0.0000 (1.0) 1.8471 (1.35) 0.0000 (1.0) 0;0 0.5414 (0.74) 1 1
test_sharing-checkout[3.10.0] 3.6949 (2.70) 3.6949 (2.70) 3.6949 (2.70) 0.0000 (1.0) 3.6949 (2.70) 0.0000 (1.0) 0;0 0.2706 (0.37) 1 1
test_sharing-checkout[main] 1.3672 (1.0) 1.3672 (1.0) 1.3672 (1.0) 0.0000 (1.0) 1.3672 (1.0) 0.0000 (1.0) 0;0 0.7314 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop[2.58.2] 568.2478 (1.03) 568.2478 (1.03) 568.2478 (1.03) 0.0000 (1.0) 568.2478 (1.03) 0.0000 (1.0) 0;0 1.7598 (0.98) 1 1
test_sharing-checkout-noop[3.10.0] 589.2975 (1.06) 589.2975 (1.06) 589.2975 (1.06) 0.0000 (1.0) 589.2975 (1.06) 0.0000 (1.0) 0;0 1.6969 (0.94) 1 1
test_sharing-checkout-noop[main] 554.2195 (1.0) 554.2195 (1.0) 554.2195 (1.0) 0.0000 (1.0) 554.2195 (1.0) 0.0000 (1.0) 0;0 1.8043 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 3.8448 (2.05) 3.8448 (2.05) 3.8448 (2.05) 0.0000 (1.0) 3.8448 (2.05) 0.0000 (1.0) 0;0 0.2601 (0.49) 1 1
test_sharing-fetch[3.10.0] 4.2879 (2.29) 4.2879 (2.29) 4.2879 (2.29) 0.0000 (1.0) 4.2879 (2.29) 0.0000 (1.0) 0;0 0.2332 (0.44) 1 1
test_sharing-fetch[main] 1.8753 (1.0) 1.8753 (1.0) 1.8753 (1.0) 0.0000 (1.0) 1.8753 (1.0) 0.0000 (1.0) 0;0 0.5333 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 438.3281 (1.0) 438.3281 (1.0) 438.3281 (1.0) 0.0000 (1.0) 438.3281 (1.0) 0.0000 (1.0) 0;0 2.2814 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 506.3087 (1.16) 506.3087 (1.16) 506.3087 (1.16) 0.0000 (1.0) 506.3087 (1.16) 0.0000 (1.0) 0;0 1.9751 (0.87) 1 1
test_sharing-fetch-noop[main] 821.3867 (1.87) 821.3867 (1.87) 821.3867 (1.87) 0.0000 (1.0) 821.3867 (1.87) 0.0000 (1.0) 0;0 1.2175 (0.53) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 3.4178 (2.34) 3.4178 (2.34) 3.4178 (2.34) 0.0000 (1.0) 3.4178 (2.34) 0.0000 (1.0) 0;0 0.2926 (0.43) 1 1
test_sharing-push[3.10.0] 1.8951 (1.30) 1.8951 (1.30) 1.8951 (1.30) 0.0000 (1.0) 1.8951 (1.30) 0.0000 (1.0) 0;0 0.5277 (0.77) 1 1
test_sharing-push[main] 1.4617 (1.0) 1.4617 (1.0) 1.4617 (1.0) 0.0000 (1.0) 1.4617 (1.0) 0.0000 (1.0) 0;0 0.6841 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 448.8298 (1.0) 448.8298 (1.0) 448.8298 (1.0) 0.0000 (1.0) 448.8298 (1.0) 0.0000 (1.0) 0;0 2.2280 (1.0) 1 1
test_sharing-push-noop[3.10.0] 449.3403 (1.00) 449.3403 (1.00) 449.3403 (1.00) 0.0000 (1.0) 449.3403 (1.00) 0.0000 (1.0) 0;0 2.2255 (1.00) 1 1
test_sharing-push-noop[main] 821.2595 (1.83) 821.2595 (1.83) 821.2595 (1.83) 0.0000 (1.0) 821.2595 (1.83) 0.0000 (1.0) 0;0 1.2176 (0.55) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.2206 (1.01) 1.2206 (1.01) 1.2206 (1.01) 0.0000 (1.0) 1.2206 (1.01) 0.0000 (1.0) 0;0 0.8192 (0.99) 1 1
test_status-status[3.10.0] 1.2733 (1.06) 1.2733 (1.06) 1.2733 (1.06) 0.0000 (1.0) 1.2733 (1.06) 0.0000 (1.0) 0;0 0.7854 (0.95) 1 1
test_status-status[main] 1.2052 (1.0) 1.2052 (1.0) 1.2052 (1.0) 0.0000 (1.0) 1.2052 (1.0) 0.0000 (1.0) 0;0 0.8298 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 555.4180 (1.0) 555.4180 (1.0) 555.4180 (1.0) 0.0000 (1.0) 555.4180 (1.0) 0.0000 (1.0) 0;0 1.8004 (1.0) 1 1
test_status-status-changed[3.10.0] 589.7254 (1.06) 589.7254 (1.06) 589.7254 (1.06) 0.0000 (1.0) 589.7254 (1.06) 0.0000 (1.0) 0;0 1.6957 (0.94) 1 1
test_status-status-changed[main] 579.0882 (1.04) 579.0882 (1.04) 579.0882 (1.04) 0.0000 (1.0) 579.0882 (1.04) 0.0000 (1.0) 0;0 1.7269 (0.96) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 551.7549 (1.0) 551.7549 (1.0) 551.7549 (1.0) 0.0000 (1.0) 551.7549 (1.0) 0.0000 (1.0) 0;0 1.8124 (1.0) 1 1
test_status-status-changed-noop[3.10.0] 615.7509 (1.12) 615.7509 (1.12) 615.7509 (1.12) 0.0000 (1.0) 615.7509 (1.12) 0.0000 (1.0) 0;0 1.6240 (0.90) 1 1
test_status-status-changed-noop[main] 556.1357 (1.01) 556.1357 (1.01) 556.1357 (1.01) 0.0000 (1.0) 556.1357 (1.01) 0.0000 (1.0) 0;0 1.7981 (0.99) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 3 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 537.0341 (1.0) 537.0341 (1.0) 537.0341 (1.0) 0.0000 (1.0) 537.0341 (1.0) 0.0000 (1.0) 0;0 1.8621 (1.0) 1 1
test_status-status-noop[3.10.0] 573.4036 (1.07) 573.4036 (1.07) 573.4036 (1.07) 0.0000 (1.0) 573.4036 (1.07) 0.0000 (1.0) 0;0 1.7440 (0.94) 1 1
test_status-status-noop[main] 566.3458 (1.05) 566.3458 (1.05) 566.3458 (1.05) 0.0000 (1.0) 566.3458 (1.05) 0.0000 (1.0) 0;0 1.7657 (0.95) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 7.4445 (1.46) 7.4445 (1.46) 7.4445 (1.46) 0.0000 (1.0) 7.4445 (1.46) 0.0000 (1.0) 0;0 0.1343 (0.69) 1 1
test_update-import-url[3.10.0] 7.5989 (1.49) 7.5989 (1.49) 7.5989 (1.49) 0.0000 (1.0) 7.5989 (1.49) 0.0000 (1.0) 0;0 0.1316 (0.67) 1 1
test_update-import-url[main] 5.1150 (1.0) 5.1150 (1.0) 5.1150 (1.0) 0.0000 (1.0) 5.1150 (1.0) 0.0000 (1.0) 0;0 0.1955 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 6.6909 (1.53) 6.6909 (1.53) 6.6909 (1.53) 0.0000 (1.0) 6.6909 (1.53) 0.0000 (1.0) 0;0 0.1495 (0.65) 1 1
test_update-update[3.10.0] 6.8893 (1.57) 6.8893 (1.57) 6.8893 (1.57) 0.0000 (1.0) 6.8893 (1.57) 0.0000 (1.0) 0;0 0.1452 (0.64) 1 1
test_update-update[main] 4.3763 (1.0) 4.3763 (1.0) 4.3763 (1.0) 0.0000 (1.0) 4.3763 (1.0) 0.0000 (1.0) 0;0 0.2285 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_update-update-noop': 3 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 976.7052 (1.01) 976.7052 (1.01) 976.7052 (1.01) 0.0000 (1.0) 976.7052 (1.01) 0.0000 (1.0) 0;0 1.0239 (0.99) 1 1
test_update-update-noop[3.10.0] 1,024.0529 (1.05) 1,024.0529 (1.05) 1,024.0529 (1.05) 0.0000 (1.0) 1,024.0529 (1.05) 0.0000 (1.0) 0;0 0.9765 (0.95) 1 1
test_update-update-noop[main] 971.0765 (1.0) 971.0765 (1.0) 971.0765 (1.0) 0.0000 (1.0) 971.0765 (1.0) 0.0000 (1.0) 0;0 1.0298 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
updates: