github-actions[bot]
commented
2 weeks ago
Mon Aug 26 20:21:42 UTC 2024
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2] 3.7679 (1.80) 3.7679 (1.80) 3.7679 (1.80) 0.0000 (1.0) 3.7679 (1.80) 0.0000 (1.0) 0;0 0.2654 (0.56) 1 1
test_add_copy-add[3.10.0] 3.9733 (1.90) 3.9733 (1.90) 3.9733 (1.90) 0.0000 (1.0) 3.9733 (1.90) 0.0000 (1.0) 0;0 0.2517 (0.53) 1 1
test_add_copy-add[3.53.2] 3.2815 (1.57) 3.2815 (1.57) 3.2815 (1.57) 0.0000 (1.0) 3.2815 (1.57) 0.0000 (1.0) 0;0 0.3047 (0.64) 1 1
test_add_copy-add[main] 2.0914 (1.0) 2.0914 (1.0) 2.0914 (1.0) 0.0000 (1.0) 2.0914 (1.0) 0.0000 (1.0) 0;0 0.4781 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2] 1.5714 (2.38) 1.5714 (2.38) 1.5714 (2.38) 0.0000 (1.0) 1.5714 (2.38) 0.0000 (1.0) 0;0 0.6364 (0.42) 1 1
test_add_copy-add-noop[3.10.0] 1.4185 (2.15) 1.4185 (2.15) 1.4185 (2.15) 0.0000 (1.0) 1.4185 (2.15) 0.0000 (1.0) 0;0 0.7050 (0.46) 1 1
test_add_copy-add-noop[3.53.2] 1.3437 (2.04) 1.3437 (2.04) 1.3437 (2.04) 0.0000 (1.0) 1.3437 (2.04) 0.0000 (1.0) 0;0 0.7442 (0.49) 1 1
test_add_copy-add-noop[main] 0.6593 (1.0) 0.6593 (1.0) 0.6593 (1.0) 0.0000 (1.0) 0.6593 (1.0) 0.0000 (1.0) 0;0 1.5167 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2] 3.2975 (1.40) 3.2975 (1.40) 3.2975 (1.40) 0.0000 (1.0) 3.2975 (1.40) 0.0000 (1.0) 0;0 0.3033 (0.71) 1 1
test_add_hardlink-add[3.10.0] 3.0017 (1.28) 3.0017 (1.28) 3.0017 (1.28) 0.0000 (1.0) 3.0017 (1.28) 0.0000 (1.0) 0;0 0.3331 (0.78) 1 1
test_add_hardlink-add[3.53.2] 2.7112 (1.15) 2.7112 (1.15) 2.7112 (1.15) 0.0000 (1.0) 2.7112 (1.15) 0.0000 (1.0) 0;0 0.3688 (0.87) 1 1
test_add_hardlink-add[main] 2.3536 (1.0) 2.3536 (1.0) 2.3536 (1.0) 0.0000 (1.0) 2.3536 (1.0) 0.0000 (1.0) 0;0 0.4249 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2] 1.6621 (2.30) 1.6621 (2.30) 1.6621 (2.30) 0.0000 (1.0) 1.6621 (2.30) 0.0000 (1.0) 0;0 0.6016 (0.43) 1 1
test_add_hardlink-add-noop[3.10.0] 1.6070 (2.22) 1.6070 (2.22) 1.6070 (2.22) 0.0000 (1.0) 1.6070 (2.22) 0.0000 (1.0) 0;0 0.6223 (0.45) 1 1
test_add_hardlink-add-noop[3.53.2] 1.5450 (2.14) 1.5450 (2.14) 1.5450 (2.14) 0.0000 (1.0) 1.5450 (2.14) 0.0000 (1.0) 0;0 0.6473 (0.47) 1 1
test_add_hardlink-add-noop[main] 0.7228 (1.0) 0.7228 (1.0) 0.7228 (1.0) 0.0000 (1.0) 0.7228 (1.0) 0.0000 (1.0) 0;0 1.3834 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2] 3.1769 (1.34) 3.1769 (1.34) 3.1769 (1.34) 0.0000 (1.0) 3.1769 (1.34) 0.0000 (1.0) 0;0 0.3148 (0.75) 1 1
test_add_symlink-add[3.10.0] 3.1061 (1.31) 3.1061 (1.31) 3.1061 (1.31) 0.0000 (1.0) 3.1061 (1.31) 0.0000 (1.0) 0;0 0.3220 (0.77) 1 1
test_add_symlink-add[3.53.2] 2.8675 (1.21) 2.8675 (1.21) 2.8675 (1.21) 0.0000 (1.0) 2.8675 (1.21) 0.0000 (1.0) 0;0 0.3487 (0.83) 1 1
test_add_symlink-add[main] 2.3784 (1.0) 2.3784 (1.0) 2.3784 (1.0) 0.0000 (1.0) 2.3784 (1.0) 0.0000 (1.0) 0;0 0.4205 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2] 2.0063 (2.73) 2.0063 (2.73) 2.0063 (2.73) 0.0000 (1.0) 2.0063 (2.73) 0.0000 (1.0) 0;0 0.4984 (0.37) 1 1
test_add_symlink-add-noop[3.10.0] 1.9047 (2.59) 1.9047 (2.59) 1.9047 (2.59) 0.0000 (1.0) 1.9047 (2.59) 0.0000 (1.0) 0;0 0.5250 (0.39) 1 1
test_add_symlink-add-noop[3.53.2] 1.7648 (2.40) 1.7648 (2.40) 1.7648 (2.40) 0.0000 (1.0) 1.7648 (2.40) 0.0000 (1.0) 0;0 0.5666 (0.42) 1 1
test_add_symlink-add-noop[main] 0.7359 (1.0) 0.7359 (1.0) 0.7359 (1.0) 0.0000 (1.0) 0.7359 (1.0) 0.0000 (1.0) 0;0 1.3589 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 2.0556 (1.22) 2.0556 (1.22) 2.0556 (1.22) 0.0000 (1.0) 2.0556 (1.22) 0.0000 (1.0) 0;0 0.4865 (0.82) 1 1
test_checkout_copy-checkout[3.10.0] 2.7066 (1.61) 2.7066 (1.61) 2.7066 (1.61) 0.0000 (1.0) 2.7066 (1.61) 0.0000 (1.0) 0;0 0.3695 (0.62) 1 1
test_checkout_copy-checkout[3.53.2] 1.6826 (1.0) 1.6826 (1.0) 1.6826 (1.0) 0.0000 (1.0) 1.6826 (1.0) 0.0000 (1.0) 0;0 0.5943 (1.0) 1 1
test_checkout_copy-checkout[main] 1.8938 (1.13) 1.8938 (1.13) 1.8938 (1.13) 0.0000 (1.0) 1.8938 (1.13) 0.0000 (1.0) 0;0 0.5280 (0.89) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 573.6787 (1.19) 573.6787 (1.19) 573.6787 (1.19) 0.0000 (1.0) 573.6787 (1.19) 0.0000 (1.0) 0;0 1.7431 (0.84) 1 1
test_checkout_copy-checkout-noop[3.10.0] 583.1354 (1.21) 583.1354 (1.21) 583.1354 (1.21) 0.0000 (1.0) 583.1354 (1.21) 0.0000 (1.0) 0;0 1.7149 (0.83) 1 1
test_checkout_copy-checkout-noop[3.53.2] 562.7507 (1.16) 562.7507 (1.16) 562.7507 (1.16) 0.0000 (1.0) 562.7507 (1.16) 0.0000 (1.0) 0;0 1.7770 (0.86) 1 1
test_checkout_copy-checkout-noop[main] 483.3078 (1.0) 483.3078 (1.0) 483.3078 (1.0) 0.0000 (1.0) 483.3078 (1.0) 0.0000 (1.0) 0;0 2.0691 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 696.5670 (1.30) 696.5670 (1.30) 696.5670 (1.30) 0.0000 (1.0) 696.5670 (1.30) 0.0000 (1.0) 0;0 1.4356 (0.77) 1 1
test_checkout_copy-checkout-update[3.10.0] 647.1166 (1.20) 647.1166 (1.20) 647.1166 (1.20) 0.0000 (1.0) 647.1166 (1.20) 0.0000 (1.0) 0;0 1.5453 (0.83) 1 1
test_checkout_copy-checkout-update[3.53.2] 621.6214 (1.16) 621.6214 (1.16) 621.6214 (1.16) 0.0000 (1.0) 621.6214 (1.16) 0.0000 (1.0) 0;0 1.6087 (0.87) 1 1
test_checkout_copy-checkout-update[main] 537.7965 (1.0) 537.7965 (1.0) 537.7965 (1.0) 0.0000 (1.0) 537.7965 (1.0) 0.0000 (1.0) 0;0 1.8594 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.4040 (1.19) 1.4040 (1.19) 1.4040 (1.19) 0.0000 (1.0) 1.4040 (1.19) 0.0000 (1.0) 0;0 0.7122 (0.84) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.3434 (1.14) 1.3434 (1.14) 1.3434 (1.14) 0.0000 (1.0) 1.3434 (1.14) 0.0000 (1.0) 0;0 0.7444 (0.88) 1 1
test_checkout_hardlink-checkout[3.53.2] 1.1781 (1.0) 1.1781 (1.0) 1.1781 (1.0) 0.0000 (1.0) 1.1781 (1.0) 0.0000 (1.0) 0;0 0.8488 (1.0) 1 1
test_checkout_hardlink-checkout[main] 1.3470 (1.14) 1.3470 (1.14) 1.3470 (1.14) 0.0000 (1.0) 1.3470 (1.14) 0.0000 (1.0) 0;0 0.7424 (0.87) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 579.1976 (1.21) 579.1976 (1.21) 579.1976 (1.21) 0.0000 (1.0) 579.1976 (1.21) 0.0000 (1.0) 0;0 1.7265 (0.82) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 588.8817 (1.23) 588.8817 (1.23) 588.8817 (1.23) 0.0000 (1.0) 588.8817 (1.23) 0.0000 (1.0) 0;0 1.6981 (0.81) 1 1
test_checkout_hardlink-checkout-noop[3.53.2] 558.0734 (1.17) 558.0734 (1.17) 558.0734 (1.17) 0.0000 (1.0) 558.0734 (1.17) 0.0000 (1.0) 0;0 1.7919 (0.85) 1 1
test_checkout_hardlink-checkout-noop[main] 477.0557 (1.0) 477.0557 (1.0) 477.0557 (1.0) 0.0000 (1.0) 477.0557 (1.0) 0.0000 (1.0) 0;0 2.0962 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 709.9154 (1.32) 709.9154 (1.32) 709.9154 (1.32) 0.0000 (1.0) 709.9154 (1.32) 0.0000 (1.0) 0;0 1.4086 (0.76) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 648.0035 (1.21) 648.0035 (1.21) 648.0035 (1.21) 0.0000 (1.0) 648.0035 (1.21) 0.0000 (1.0) 0;0 1.5432 (0.83) 1 1
test_checkout_hardlink-checkout-update[3.53.2] 610.1471 (1.14) 610.1471 (1.14) 610.1471 (1.14) 0.0000 (1.0) 610.1471 (1.14) 0.0000 (1.0) 0;0 1.6389 (0.88) 1 1
test_checkout_hardlink-checkout-update[main] 537.4090 (1.0) 537.4090 (1.0) 537.4090 (1.0) 0.0000 (1.0) 537.4090 (1.0) 0.0000 (1.0) 0;0 1.8608 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.6742 (1.25) 1.6742 (1.25) 1.6742 (1.25) 0.0000 (1.0) 1.6742 (1.25) 0.0000 (1.0) 0;0 0.5973 (0.80) 1 1
test_checkout_symlink-checkout[3.10.0] 1.4390 (1.08) 1.4390 (1.08) 1.4390 (1.08) 0.0000 (1.0) 1.4390 (1.08) 0.0000 (1.0) 0;0 0.6949 (0.93) 1 1
test_checkout_symlink-checkout[3.53.2] 1.3359 (1.0) 1.3359 (1.0) 1.3359 (1.0) 0.0000 (1.0) 1.3359 (1.0) 0.0000 (1.0) 0;0 0.7485 (1.0) 1 1
test_checkout_symlink-checkout[main] 1.4889 (1.11) 1.4889 (1.11) 1.4889 (1.11) 0.0000 (1.0) 1.4889 (1.11) 0.0000 (1.0) 0;0 0.6716 (0.90) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 628.1831 (1.16) 628.1831 (1.16) 628.1831 (1.16) 0.0000 (1.0) 628.1831 (1.16) 0.0000 (1.0) 0;0 1.5919 (0.86) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 638.7856 (1.18) 638.7856 (1.18) 638.7856 (1.18) 0.0000 (1.0) 638.7856 (1.18) 0.0000 (1.0) 0;0 1.5655 (0.85) 1 1
test_checkout_symlink-checkout-noop[3.53.2] 607.1450 (1.12) 607.1450 (1.12) 607.1450 (1.12) 0.0000 (1.0) 607.1450 (1.12) 0.0000 (1.0) 0;0 1.6471 (0.89) 1 1
test_checkout_symlink-checkout-noop[main] 540.6349 (1.0) 540.6349 (1.0) 540.6349 (1.0) 0.0000 (1.0) 540.6349 (1.0) 0.0000 (1.0) 0;0 1.8497 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 815.9624 (1.32) 815.9624 (1.32) 815.9624 (1.32) 0.0000 (1.0) 815.9624 (1.32) 0.0000 (1.0) 0;0 1.2255 (0.76) 1 1
test_checkout_symlink-checkout-update[3.10.0] 753.1410 (1.22) 753.1410 (1.22) 753.1410 (1.22) 0.0000 (1.0) 753.1410 (1.22) 0.0000 (1.0) 0;0 1.3278 (0.82) 1 1
test_checkout_symlink-checkout-update[3.53.2] 694.1855 (1.13) 694.1855 (1.13) 694.1855 (1.13) 0.0000 (1.0) 694.1855 (1.13) 0.0000 (1.0) 0;0 1.4405 (0.89) 1 1
test_checkout_symlink-checkout-update[main] 616.2624 (1.0) 616.2624 (1.0) 616.2624 (1.0) 0.0000 (1.0) 616.2624 (1.0) 0.0000 (1.0) 0;0 1.6227 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 711.7824 (1.28) 711.7824 (1.28) 711.7824 (1.28) 0.0000 (1.0) 711.7824 (1.28) 0.0000 (1.0) 0;0 1.4049 (0.78) 1 1
test_data_status-data-changed[3.10.0] 623.6237 (1.12) 623.6237 (1.12) 623.6237 (1.12) 0.0000 (1.0) 623.6237 (1.12) 0.0000 (1.0) 0;0 1.6035 (0.89) 1 1
test_data_status-data-changed[3.53.2] 640.6309 (1.15) 640.6309 (1.15) 640.6309 (1.15) 0.0000 (1.0) 640.6309 (1.15) 0.0000 (1.0) 0;0 1.5610 (0.87) 1 1
test_data_status-data-changed[main] 558.0227 (1.0) 558.0227 (1.0) 558.0227 (1.0) 0.0000 (1.0) 558.0227 (1.0) 0.0000 (1.0) 0;0 1.7920 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 703.1875 (1.23) 703.1875 (1.23) 703.1875 (1.23) 0.0000 (1.0) 703.1875 (1.23) 0.0000 (1.0) 0;0 1.4221 (0.82) 1 1
test_data_status-data-changed-noop[3.10.0] 632.0257 (1.10) 632.0257 (1.10) 632.0257 (1.10) 0.0000 (1.0) 632.0257 (1.10) 0.0000 (1.0) 0;0 1.5822 (0.91) 1 1
test_data_status-data-changed-noop[3.53.2] 620.6393 (1.08) 620.6393 (1.08) 620.6393 (1.08) 0.0000 (1.0) 620.6393 (1.08) 0.0000 (1.0) 0;0 1.6112 (0.92) 1 1
test_data_status-data-changed-noop[main] 573.5220 (1.0) 573.5220 (1.0) 573.5220 (1.0) 0.0000 (1.0) 573.5220 (1.0) 0.0000 (1.0) 0;0 1.7436 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.6325 (1.66) 1.6325 (1.66) 1.6325 (1.66) 0.0000 (1.0) 1.6325 (1.66) 0.0000 (1.0) 0;0 0.6126 (0.60) 1 1
test_data_status-data-new[3.10.0] 1.5730 (1.60) 1.5730 (1.60) 1.5730 (1.60) 0.0000 (1.0) 1.5730 (1.60) 0.0000 (1.0) 0;0 0.6357 (0.63) 1 1
test_data_status-data-new[3.53.2] 1.5166 (1.54) 1.5166 (1.54) 1.5166 (1.54) 0.0000 (1.0) 1.5166 (1.54) 0.0000 (1.0) 0;0 0.6594 (0.65) 1 1
test_data_status-data-new[main] 0.9854 (1.0) 0.9854 (1.0) 0.9854 (1.0) 0.0000 (1.0) 0.9854 (1.0) 0.0000 (1.0) 0;0 1.0148 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 696.2440 (1.35) 696.2440 (1.35) 696.2440 (1.35) 0.0000 (1.0) 696.2440 (1.35) 0.0000 (1.0) 0;0 1.4363 (0.74) 1 1
test_data_status-data-noop[3.10.0] 626.9638 (1.21) 626.9638 (1.21) 626.9638 (1.21) 0.0000 (1.0) 626.9638 (1.21) 0.0000 (1.0) 0;0 1.5950 (0.82) 1 1
test_data_status-data-noop[3.53.2] 834.9104 (1.62) 834.9104 (1.62) 834.9104 (1.62) 0.0000 (1.0) 834.9104 (1.62) 0.0000 (1.0) 0;0 1.1977 (0.62) 1 1
test_data_status-data-noop[main] 516.1456 (1.0) 516.1456 (1.0) 516.1456 (1.0) 0.0000 (1.0) 516.1456 (1.0) 0.0000 (1.0) 0;0 1.9374 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.1801 (1.14) 1.1801 (1.14) 1.1801 (1.14) 0.0000 (1.0) 1.1801 (1.14) 0.0000 (1.0) 0;0 0.8474 (0.88) 1 1
test_data_status_all_flags-data-changed[3.10.0] 1.1178 (1.08) 1.1178 (1.08) 1.1178 (1.08) 0.0000 (1.0) 1.1178 (1.08) 0.0000 (1.0) 0;0 0.8946 (0.93) 1 1
test_data_status_all_flags-data-changed[3.53.2] 1.1045 (1.07) 1.1045 (1.07) 1.1045 (1.07) 0.0000 (1.0) 1.1045 (1.07) 0.0000 (1.0) 0;0 0.9054 (0.94) 1 1
test_data_status_all_flags-data-changed[main] 1.0369 (1.0) 1.0369 (1.0) 1.0369 (1.0) 0.0000 (1.0) 1.0369 (1.0) 0.0000 (1.0) 0;0 0.9644 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.1400 (1.11) 1.1400 (1.11) 1.1400 (1.11) 0.0000 (1.0) 1.1400 (1.11) 0.0000 (1.0) 0;0 0.8772 (0.90) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 1.1128 (1.08) 1.1128 (1.08) 1.1128 (1.08) 0.0000 (1.0) 1.1128 (1.08) 0.0000 (1.0) 0;0 0.8986 (0.92) 1 1
test_data_status_all_flags-data-changed-noop[3.53.2] 1.1255 (1.10) 1.1255 (1.10) 1.1255 (1.10) 0.0000 (1.0) 1.1255 (1.10) 0.0000 (1.0) 0;0 0.8885 (0.91) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.0277 (1.0) 1.0277 (1.0) 1.0277 (1.0) 0.0000 (1.0) 1.0277 (1.0) 0.0000 (1.0) 0;0 0.9731 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 2.0408 (1.32) 2.0408 (1.32) 2.0408 (1.32) 0.0000 (1.0) 2.0408 (1.32) 0.0000 (1.0) 0;0 0.4900 (0.76) 1 1
test_data_status_all_flags-data-new[3.10.0] 2.0585 (1.33) 2.0585 (1.33) 2.0585 (1.33) 0.0000 (1.0) 2.0585 (1.33) 0.0000 (1.0) 0;0 0.4858 (0.75) 1 1
test_data_status_all_flags-data-new[3.53.2] 1.9775 (1.28) 1.9775 (1.28) 1.9775 (1.28) 0.0000 (1.0) 1.9775 (1.28) 0.0000 (1.0) 0;0 0.5057 (0.78) 1 1
test_data_status_all_flags-data-new[main] 1.5474 (1.0) 1.5474 (1.0) 1.5474 (1.0) 0.0000 (1.0) 1.5474 (1.0) 0.0000 (1.0) 0;0 0.6462 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 1.1788 (1.15) 1.1788 (1.15) 1.1788 (1.15) 0.0000 (1.0) 1.1788 (1.15) 0.0000 (1.0) 0;0 0.8483 (0.87) 1 1
test_data_status_all_flags-data-noop[3.10.0] 1.1030 (1.08) 1.1030 (1.08) 1.1030 (1.08) 0.0000 (1.0) 1.1030 (1.08) 0.0000 (1.0) 0;0 0.9066 (0.93) 1 1
test_data_status_all_flags-data-noop[3.53.2] 1.0791 (1.06) 1.0791 (1.06) 1.0791 (1.06) 0.0000 (1.0) 1.0791 (1.06) 0.0000 (1.0) 0;0 0.9267 (0.95) 1 1
test_data_status_all_flags-data-noop[main] 1.0213 (1.0) 1.0213 (1.0) 1.0213 (1.0) 0.0000 (1.0) 1.0213 (1.0) 0.0000 (1.0) 0;0 0.9791 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.4143 (1.30) 1.4143 (1.30) 1.4143 (1.30) 0.0000 (1.0) 1.4143 (1.30) 0.0000 (1.0) 0;0 0.7071 (0.77) 1 1
test_diff-diff[3.10.0] 1.5307 (1.41) 1.5307 (1.41) 1.5307 (1.41) 0.0000 (1.0) 1.5307 (1.41) 0.0000 (1.0) 0;0 0.6533 (0.71) 1 1
test_diff-diff[3.53.2] 1.4162 (1.30) 1.4162 (1.30) 1.4162 (1.30) 0.0000 (1.0) 1.4162 (1.30) 0.0000 (1.0) 0;0 0.7061 (0.77) 1 1
test_diff-diff[main] 1.0868 (1.0) 1.0868 (1.0) 1.0868 (1.0) 0.0000 (1.0) 1.0868 (1.0) 0.0000 (1.0) 0;0 0.9201 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 664.1302 (1.21) 664.1302 (1.21) 664.1302 (1.21) 0.0000 (1.0) 664.1302 (1.21) 0.0000 (1.0) 0;0 1.5057 (0.83) 1 1
test_diff-diff-changed[3.10.0] 667.8868 (1.21) 667.8868 (1.21) 667.8868 (1.21) 0.0000 (1.0) 667.8868 (1.21) 0.0000 (1.0) 0;0 1.4973 (0.82) 1 1
test_diff-diff-changed[3.53.2] 615.8893 (1.12) 615.8893 (1.12) 615.8893 (1.12) 0.0000 (1.0) 615.8893 (1.12) 0.0000 (1.0) 0;0 1.6237 (0.89) 1 1
test_diff-diff-changed[main] 550.6931 (1.0) 550.6931 (1.0) 550.6931 (1.0) 0.0000 (1.0) 550.6931 (1.0) 0.0000 (1.0) 0;0 1.8159 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 641.2377 (1.17) 641.2377 (1.17) 641.2377 (1.17) 0.0000 (1.0) 641.2377 (1.17) 0.0000 (1.0) 0;0 1.5595 (0.85) 1 1
test_diff-diff-changed-noop[3.10.0] 638.4392 (1.16) 638.4392 (1.16) 638.4392 (1.16) 0.0000 (1.0) 638.4392 (1.16) 0.0000 (1.0) 0;0 1.5663 (0.86) 1 1
test_diff-diff-changed-noop[3.53.2] 617.7182 (1.13) 617.7182 (1.13) 617.7182 (1.13) 0.0000 (1.0) 617.7182 (1.13) 0.0000 (1.0) 0;0 1.6189 (0.89) 1 1
test_diff-diff-changed-noop[main] 548.0171 (1.0) 548.0171 (1.0) 548.0171 (1.0) 0.0000 (1.0) 548.0171 (1.0) 0.0000 (1.0) 0;0 1.8248 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 610.4597 (1.11) 610.4597 (1.11) 610.4597 (1.11) 0.0000 (1.0) 610.4597 (1.11) 0.0000 (1.0) 0;0 1.6381 (0.90) 1 1
test_diff-diff-noop[3.10.0] 604.2763 (1.10) 604.2763 (1.10) 604.2763 (1.10) 0.0000 (1.0) 604.2763 (1.10) 0.0000 (1.0) 0;0 1.6549 (0.91) 1 1
test_diff-diff-noop[3.53.2] 617.3740 (1.12) 617.3740 (1.12) 617.3740 (1.12) 0.0000 (1.0) 617.3740 (1.12) 0.0000 (1.0) 0;0 1.6198 (0.89) 1 1
test_diff-diff-noop[main] 549.1324 (1.0) 549.1324 (1.0) 549.1324 (1.0) 0.0000 (1.0) 549.1324 (1.0) 0.0000 (1.0) 0;0 1.8211 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
-------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests --------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 1.0449 (1.0) 1.0449 (1.0) 1.0449 (1.0) 0.0000 (1.0) 1.0449 (1.0) 0.0000 (1.0) 0;0 0.9570 (1.0) 1 1
test_exp_show-exp[3.10.0] 12.1918 (11.67) 12.1918 (11.67) 12.1918 (11.67) 0.0000 (1.0) 12.1918 (11.67) 0.0000 (1.0) 0;0 0.0820 (0.09) 1 1
test_exp_show-exp[3.53.2] 4.5831 (4.39) 4.5831 (4.39) 4.5831 (4.39) 0.0000 (1.0) 4.5831 (4.39) 0.0000 (1.0) 0;0 0.2182 (0.23) 1 1
test_exp_show-exp[main] 5.8115 (5.56) 5.8115 (5.56) 5.8115 (5.56) 0.0000 (1.0) 5.8115 (5.56) 0.0000 (1.0) 0;0 0.1721 (0.18) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 2.7053 (1.76) 2.7053 (1.76) 2.7053 (1.76) 0.0000 (1.0) 2.7053 (1.76) 0.0000 (1.0) 0;0 0.3696 (0.57) 1 1
test_fetch-fetch[3.10.0] 3.1833 (2.07) 3.1833 (2.07) 3.1833 (2.07) 0.0000 (1.0) 3.1833 (2.07) 0.0000 (1.0) 0;0 0.3141 (0.48) 1 1
test_fetch-fetch[3.53.2] 1.9303 (1.26) 1.9303 (1.26) 1.9303 (1.26) 0.0000 (1.0) 1.9303 (1.26) 0.0000 (1.0) 0;0 0.5180 (0.80) 1 1
test_fetch-fetch[main] 1.5367 (1.0) 1.5367 (1.0) 1.5367 (1.0) 0.0000 (1.0) 1.5367 (1.0) 0.0000 (1.0) 0;0 0.6508 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 725.1011 (1.16) 725.1011 (1.16) 725.1011 (1.16) 0.0000 (1.0) 725.1011 (1.16) 0.0000 (1.0) 0;0 1.3791 (0.86) 1 1
test_gc-gc[3.10.0] 753.7243 (1.20) 753.7243 (1.20) 753.7243 (1.20) 0.0000 (1.0) 753.7243 (1.20) 0.0000 (1.0) 0;0 1.3267 (0.83) 1 1
test_gc-gc[3.53.2] 658.9086 (1.05) 658.9086 (1.05) 658.9086 (1.05) 0.0000 (1.0) 658.9086 (1.05) 0.0000 (1.0) 0;0 1.5177 (0.95) 1 1
test_gc-gc[main] 626.1336 (1.0) 626.1336 (1.0) 626.1336 (1.0) 0.0000 (1.0) 626.1336 (1.0) 0.0000 (1.0) 0;0 1.5971 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 4.2418 (1.0) 4.2418 (1.0) 4.2418 (1.0) 0.0000 (1.0) 4.2418 (1.0) 0.0000 (1.0) 0;0 0.2358 (1.0) 1 1
test_get-get[3.10.0] 5.1551 (1.22) 5.1551 (1.22) 5.1551 (1.22) 0.0000 (1.0) 5.1551 (1.22) 0.0000 (1.0) 0;0 0.1940 (0.82) 1 1
test_get-get[3.53.2] 4.4887 (1.06) 4.4887 (1.06) 4.4887 (1.06) 0.0000 (1.0) 4.4887 (1.06) 0.0000 (1.0) 0;0 0.2228 (0.94) 1 1
test_get-get[main] 4.3906 (1.04) 4.3906 (1.04) 4.3906 (1.04) 0.0000 (1.0) 4.3906 (1.04) 0.0000 (1.0) 0;0 0.2278 (0.97) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 1.8578 (1.79) 1.8578 (1.79) 1.8578 (1.79) 0.0000 (1.0) 1.8578 (1.79) 0.0000 (1.0) 0;0 0.5383 (0.56) 1 1
test_get_url-get-url[3.10.0] 2.1217 (2.04) 2.1217 (2.04) 2.1217 (2.04) 0.0000 (1.0) 2.1217 (2.04) 0.0000 (1.0) 0;0 0.4713 (0.49) 1 1
test_get_url-get-url[3.53.2] 1.0628 (1.02) 1.0628 (1.02) 1.0628 (1.02) 0.0000 (1.0) 1.0628 (1.02) 0.0000 (1.0) 0;0 0.9410 (0.98) 1 1
test_get_url-get-url[main] 1.0391 (1.0) 1.0391 (1.0) 1.0391 (1.0) 0.0000 (1.0) 1.0391 (1.0) 0.0000 (1.0) 0;0 0.9624 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 122.9668 (1.02) 128.8341 (1.0) 124.6096 (1.02) 1.2610 (1.0) 124.3375 (1.02) 1.3142 (1.0) 22;8 8.0251 (0.98) 100 1
test_help---help[3.10.0] 120.5222 (1.0) 128.8774 (1.00) 122.7210 (1.0) 1.5689 (1.24) 122.2633 (1.0) 1.5494 (1.18) 20;7 8.1486 (1.0) 100 1
test_help---help[3.53.2] 123.2530 (1.02) 152.2363 (1.18) 125.9073 (1.03) 3.9653 (3.14) 124.7605 (1.02) 1.6268 (1.24) 6;9 7.9423 (0.97) 100 1
test_help---help[main] 122.4707 (1.02) 145.9675 (1.13) 125.5610 (1.02) 2.8764 (2.28) 124.7825 (1.02) 1.9301 (1.47) 12;10 7.9643 (0.98) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import-import': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 7.5798 (1.00) 7.5798 (1.00) 7.5798 (1.00) 0.0000 (1.0) 7.5798 (1.00) 0.0000 (1.0) 0;0 0.1319 (1.00) 1 1
test_import-import[3.10.0] 8.5998 (1.14) 8.5998 (1.14) 8.5998 (1.14) 0.0000 (1.0) 8.5998 (1.14) 0.0000 (1.0) 0;0 0.1163 (0.88) 1 1
test_import-import[main] 7.5590 (1.0) 7.5590 (1.0) 7.5590 (1.0) 0.0000 (1.0) 7.5590 (1.0) 0.0000 (1.0) 0;0 0.1323 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 6.4322 (2.19) 6.4322 (2.19) 6.4322 (2.19) 0.0000 (1.0) 6.4322 (2.19) 0.0000 (1.0) 0;0 0.1555 (0.46) 1 1
test_import_url-import-url[3.10.0] 6.3851 (2.18) 6.3851 (2.18) 6.3851 (2.18) 0.0000 (1.0) 6.3851 (2.18) 0.0000 (1.0) 0;0 0.1566 (0.46) 1 1
test_import_url-import-url[3.53.2] 4.8288 (1.65) 4.8288 (1.65) 4.8288 (1.65) 0.0000 (1.0) 4.8288 (1.65) 0.0000 (1.0) 0;0 0.2071 (0.61) 1 1
test_import_url-import-url[main] 2.9353 (1.0) 2.9353 (1.0) 2.9353 (1.0) 0.0000 (1.0) 2.9353 (1.0) 0.0000 (1.0) 0;0 0.3407 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 405.3469 (1.02) 456.2581 (1.08) 416.8033 (1.02) 9.1271 (2.57) 414.7926 (1.02) 8.5927 (2.15) 17;5 2.3992 (0.98) 100 1
test_init-init[3.10.0] 410.3801 (1.03) 442.5377 (1.05) 421.9801 (1.04) 5.7827 (1.63) 420.7712 (1.03) 6.3259 (1.59) 27;4 2.3698 (0.97) 100 1
test_init-init[3.53.2] 398.8522 (1.0) 420.6087 (1.0) 407.5326 (1.0) 3.5545 (1.0) 407.3159 (1.0) 3.9900 (1.0) 27;4 2.4538 (1.0) 100 1
test_init-init[main] 404.0731 (1.01) 874.0363 (2.08) 418.9089 (1.03) 46.3771 (13.05) 413.6235 (1.02) 8.2260 (2.06) 1;3 2.3872 (0.97) 100 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 603.4644 (1.07) 603.4644 (1.07) 603.4644 (1.07) 0.0000 (1.0) 603.4644 (1.07) 0.0000 (1.0) 0;0 1.6571 (0.93) 1 1
test_list-list[3.10.0] 709.1850 (1.26) 709.1850 (1.26) 709.1850 (1.26) 0.0000 (1.0) 709.1850 (1.26) 0.0000 (1.0) 0;0 1.4101 (0.79) 1 1
test_list-list[3.53.2] 596.5146 (1.06) 596.5146 (1.06) 596.5146 (1.06) 0.0000 (1.0) 596.5146 (1.06) 0.0000 (1.0) 0;0 1.6764 (0.94) 1 1
test_list-list[main] 563.1451 (1.0) 563.1451 (1.0) 563.1451 (1.0) 0.0000 (1.0) 563.1451 (1.0) 0.0000 (1.0) 0;0 1.7757 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 451.1882 (1.05) 451.1882 (1.05) 451.1882 (1.05) 0.0000 (1.0) 451.1882 (1.05) 0.0000 (1.0) 0;0 2.2164 (0.95) 1 1
test_list-list-dvc-only[3.10.0] 445.3403 (1.04) 445.3403 (1.04) 445.3403 (1.04) 0.0000 (1.0) 445.3403 (1.04) 0.0000 (1.0) 0;0 2.2455 (0.96) 1 1
test_list-list-dvc-only[3.53.2] 428.3677 (1.0) 428.3677 (1.0) 428.3677 (1.0) 0.0000 (1.0) 428.3677 (1.0) 0.0000 (1.0) 0;0 2.3344 (1.0) 1 1
test_list-list-dvc-only[main] 441.0363 (1.03) 441.0363 (1.03) 441.0363 (1.03) 0.0000 (1.0) 441.0363 (1.03) 0.0000 (1.0) 0;0 2.2674 (0.97) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 685.1108 (1.36) 685.1108 (1.36) 685.1108 (1.36) 0.0000 (1.0) 685.1108 (1.36) 0.0000 (1.0) 0;0 1.4596 (0.74) 1 1
test_list-list-recursive[3.10.0] 518.0373 (1.03) 518.0373 (1.03) 518.0373 (1.03) 0.0000 (1.0) 518.0373 (1.03) 0.0000 (1.0) 0;0 1.9304 (0.97) 1 1
test_list-list-recursive[3.53.2] 504.2234 (1.0) 504.2234 (1.0) 504.2234 (1.0) 0.0000 (1.0) 504.2234 (1.0) 0.0000 (1.0) 0;0 1.9832 (1.0) 1 1
test_list-list-recursive[main] 517.7734 (1.03) 517.7734 (1.03) 517.7734 (1.03) 0.0000 (1.0) 517.7734 (1.03) 0.0000 (1.0) 0;0 1.9313 (0.97) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 435.4330 (1.04) 435.4330 (1.04) 435.4330 (1.04) 0.0000 (1.0) 435.4330 (1.04) 0.0000 (1.0) 0;0 2.2966 (0.96) 1 1
test_list-list-shallow[3.10.0] 446.9107 (1.06) 446.9107 (1.06) 446.9107 (1.06) 0.0000 (1.0) 446.9107 (1.06) 0.0000 (1.0) 0;0 2.2376 (0.94) 1 1
test_list-list-shallow[3.53.2] 419.9992 (1.0) 419.9992 (1.0) 419.9992 (1.0) 0.0000 (1.0) 419.9992 (1.0) 0.0000 (1.0) 0;0 2.3810 (1.0) 1 1
test_list-list-shallow[main] 432.1486 (1.03) 432.1486 (1.03) 432.1486 (1.03) 0.0000 (1.0) 432.1486 (1.03) 0.0000 (1.0) 0;0 2.3140 (0.97) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.1543 (1.32) 2.1543 (1.32) 2.1543 (1.32) 0.0000 (1.0) 2.1543 (1.32) 0.0000 (1.0) 0;0 0.4642 (0.76) 1 1
test_partial_add-add[3.10.0] 2.3954 (1.47) 2.3954 (1.47) 2.3954 (1.47) 0.0000 (1.0) 2.3954 (1.47) 0.0000 (1.0) 0;0 0.4175 (0.68) 1 1
test_partial_add-add[3.53.2] 1.9615 (1.21) 1.9615 (1.21) 1.9615 (1.21) 0.0000 (1.0) 1.9615 (1.21) 0.0000 (1.0) 0;0 0.5098 (0.83) 1 1
test_partial_add-add[main] 1.6267 (1.0) 1.6267 (1.0) 1.6267 (1.0) 0.0000 (1.0) 1.6267 (1.0) 0.0000 (1.0) 0;0 0.6147 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 3.0934 (2.86) 3.0934 (2.86) 3.0934 (2.86) 0.0000 (1.0) 3.0934 (2.86) 0.0000 (1.0) 0;0 0.3233 (0.35) 1 1
test_partial_add-add-partial[3.10.0] 2.9140 (2.69) 2.9140 (2.69) 2.9140 (2.69) 0.0000 (1.0) 2.9140 (2.69) 0.0000 (1.0) 0;0 0.3432 (0.37) 1 1
test_partial_add-add-partial[3.53.2] 2.6275 (2.43) 2.6275 (2.43) 2.6275 (2.43) 0.0000 (1.0) 2.6275 (2.43) 0.0000 (1.0) 0;0 0.3806 (0.41) 1 1
test_partial_add-add-partial[main] 1.0824 (1.0) 1.0824 (1.0) 1.0824 (1.0) 0.0000 (1.0) 1.0824 (1.0) 0.0000 (1.0) 0;0 0.9239 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 566.1940 (1.0) 566.1940 (1.0) 566.1940 (1.0) 0.0000 (1.0) 566.1940 (1.0) 0.0000 (1.0) 0;0 1.7662 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 600.7517 (1.06) 600.7517 (1.06) 600.7517 (1.06) 0.0000 (1.0) 600.7517 (1.06) 0.0000 (1.0) 0;0 1.6646 (0.94) 1 1
test_partial_add-gc-cloud-noop[3.53.2] 612.1795 (1.08) 612.1795 (1.08) 612.1795 (1.08) 0.0000 (1.0) 612.1795 (1.08) 0.0000 (1.0) 0;0 1.6335 (0.92) 1 1
test_partial_add-gc-cloud-noop[main] 618.0680 (1.09) 618.0680 (1.09) 618.0680 (1.09) 0.0000 (1.0) 618.0680 (1.09) 0.0000 (1.0) 0;0 1.6179 (0.92) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 492.1506 (1.0) 492.1506 (1.0) 492.1506 (1.0) 0.0000 (1.0) 492.1506 (1.0) 0.0000 (1.0) 0;0 2.0319 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 531.9779 (1.08) 531.9779 (1.08) 531.9779 (1.08) 0.0000 (1.0) 531.9779 (1.08) 0.0000 (1.0) 0;0 1.8798 (0.93) 1 1
test_partial_add-gc-noop[3.53.2] 528.3835 (1.07) 528.3835 (1.07) 528.3835 (1.07) 0.0000 (1.0) 528.3835 (1.07) 0.0000 (1.0) 0;0 1.8926 (0.93) 1 1
test_partial_add-gc-noop[main] 521.6411 (1.06) 521.6411 (1.06) 521.6411 (1.06) 0.0000 (1.0) 521.6411 (1.06) 0.0000 (1.0) 0;0 1.9170 (0.94) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 1.2966 (1.26) 1.2966 (1.26) 1.2966 (1.26) 0.0000 (1.0) 1.2966 (1.26) 0.0000 (1.0) 0;0 0.7713 (0.79) 1 1
test_partial_add-push[3.10.0] 1.1498 (1.12) 1.1498 (1.12) 1.1498 (1.12) 0.0000 (1.0) 1.1498 (1.12) 0.0000 (1.0) 0;0 0.8697 (0.90) 1 1
test_partial_add-push[3.53.2] 1.0681 (1.04) 1.0681 (1.04) 1.0681 (1.04) 0.0000 (1.0) 1.0681 (1.04) 0.0000 (1.0) 0;0 0.9363 (0.96) 1 1
test_partial_add-push[main] 1.0301 (1.0) 1.0301 (1.0) 1.0301 (1.0) 0.0000 (1.0) 1.0301 (1.0) 0.0000 (1.0) 0;0 0.9708 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 1.3282 (1.18) 1.3282 (1.18) 1.3282 (1.18) 0.0000 (1.0) 1.3282 (1.18) 0.0000 (1.0) 0;0 0.7529 (0.85) 1 1
test_partial_add-push-partial[3.10.0] 1.2228 (1.08) 1.2228 (1.08) 1.2228 (1.08) 0.0000 (1.0) 1.2228 (1.08) 0.0000 (1.0) 0;0 0.8178 (0.92) 1 1
test_partial_add-push-partial[3.53.2] 1.1576 (1.03) 1.1576 (1.03) 1.1576 (1.03) 0.0000 (1.0) 1.1576 (1.03) 0.0000 (1.0) 0;0 0.8638 (0.98) 1 1
test_partial_add-push-partial[main] 1.1291 (1.0) 1.1291 (1.0) 1.1291 (1.0) 0.0000 (1.0) 1.1291 (1.0) 0.0000 (1.0) 0;0 0.8856 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.8332 (1.80) 3.8332 (1.80) 3.8332 (1.80) 0.0000 (1.0) 3.8332 (1.80) 0.0000 (1.0) 0;0 0.2609 (0.56) 1 1
test_partial_remove-add[3.10.0] 3.7830 (1.78) 3.7830 (1.78) 3.7830 (1.78) 0.0000 (1.0) 3.7830 (1.78) 0.0000 (1.0) 0;0 0.2643 (0.56) 1 1
test_partial_remove-add[3.53.2] 3.3803 (1.59) 3.3803 (1.59) 3.3803 (1.59) 0.0000 (1.0) 3.3803 (1.59) 0.0000 (1.0) 0;0 0.2958 (0.63) 1 1
test_partial_remove-add[main] 2.1291 (1.0) 2.1291 (1.0) 2.1291 (1.0) 0.0000 (1.0) 2.1291 (1.0) 0.0000 (1.0) 0;0 0.4697 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.5316 (2.44) 1.5316 (2.44) 1.5316 (2.44) 0.0000 (1.0) 1.5316 (2.44) 0.0000 (1.0) 0;0 0.6529 (0.41) 1 1
test_partial_remove-add-update[3.10.0] 1.5070 (2.40) 1.5070 (2.40) 1.5070 (2.40) 0.0000 (1.0) 1.5070 (2.40) 0.0000 (1.0) 0;0 0.6636 (0.42) 1 1
test_partial_remove-add-update[3.53.2] 1.3879 (2.21) 1.3879 (2.21) 1.3879 (2.21) 0.0000 (1.0) 1.3879 (2.21) 0.0000 (1.0) 0;0 0.7205 (0.45) 1 1
test_partial_remove-add-update[main] 0.6289 (1.0) 0.6289 (1.0) 0.6289 (1.0) 0.0000 (1.0) 0.6289 (1.0) 0.0000 (1.0) 0;0 1.5902 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 521.2221 (1.0) 521.2221 (1.0) 521.2221 (1.0) 0.0000 (1.0) 521.2221 (1.0) 0.0000 (1.0) 0;0 1.9186 (1.0) 1 1
test_partial_remove-gc[3.10.0] 622.6508 (1.19) 622.6508 (1.19) 622.6508 (1.19) 0.0000 (1.0) 622.6508 (1.19) 0.0000 (1.0) 0;0 1.6060 (0.84) 1 1
test_partial_remove-gc[3.53.2] 528.2412 (1.01) 528.2412 (1.01) 528.2412 (1.01) 0.0000 (1.0) 528.2412 (1.01) 0.0000 (1.0) 0;0 1.8931 (0.99) 1 1
test_partial_remove-gc[main] 537.7097 (1.03) 537.7097 (1.03) 537.7097 (1.03) 0.0000 (1.0) 537.7097 (1.03) 0.0000 (1.0) 0;0 1.8597 (0.97) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 573.9600 (1.0) 573.9600 (1.0) 573.9600 (1.0) 0.0000 (1.0) 573.9600 (1.0) 0.0000 (1.0) 0;0 1.7423 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 625.0914 (1.09) 625.0914 (1.09) 625.0914 (1.09) 0.0000 (1.0) 625.0914 (1.09) 0.0000 (1.0) 0;0 1.5998 (0.92) 1 1
test_partial_remove-gc-cloud[3.53.2] 604.1804 (1.05) 604.1804 (1.05) 604.1804 (1.05) 0.0000 (1.0) 604.1804 (1.05) 0.0000 (1.0) 0;0 1.6551 (0.95) 1 1
test_partial_remove-gc-cloud[main] 607.7236 (1.06) 607.7236 (1.06) 607.7236 (1.06) 0.0000 (1.0) 607.7236 (1.06) 0.0000 (1.0) 0;0 1.6455 (0.94) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 2.1764 (1.52) 2.1764 (1.52) 2.1764 (1.52) 0.0000 (1.0) 2.1764 (1.52) 0.0000 (1.0) 0;0 0.4595 (0.66) 1 1
test_partial_remove-push[3.10.0] 1.9112 (1.34) 1.9112 (1.34) 1.9112 (1.34) 0.0000 (1.0) 1.9112 (1.34) 0.0000 (1.0) 0;0 0.5232 (0.75) 1 1
test_partial_remove-push[3.53.2] 1.5278 (1.07) 1.5278 (1.07) 1.5278 (1.07) 0.0000 (1.0) 1.5278 (1.07) 0.0000 (1.0) 0;0 0.6545 (0.94) 1 1
test_partial_remove-push[main] 1.4290 (1.0) 1.4290 (1.0) 1.4290 (1.0) 0.0000 (1.0) 1.4290 (1.0) 0.0000 (1.0) 0;0 0.6998 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 524.8663 (1.0) 524.8663 (1.0) 524.8663 (1.0) 0.0000 (1.0) 524.8663 (1.0) 0.0000 (1.0) 0;0 1.9052 (1.0) 1 1
test_partial_remove-push-update[3.10.0] 536.3692 (1.02) 536.3692 (1.02) 536.3692 (1.02) 0.0000 (1.0) 536.3692 (1.02) 0.0000 (1.0) 0;0 1.8644 (0.98) 1 1
test_partial_remove-push-update[3.53.2] 830.0765 (1.58) 830.0765 (1.58) 830.0765 (1.58) 0.0000 (1.0) 830.0765 (1.58) 0.0000 (1.0) 0;0 1.2047 (0.63) 1 1
test_partial_remove-push-update[main] 845.8780 (1.61) 845.8780 (1.61) 845.8780 (1.61) 0.0000 (1.0) 845.8780 (1.61) 0.0000 (1.0) 0;0 1.1822 (0.62) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 482.6225 (1.0) 497.4959 (1.0) 492.0666 (1.0) 5.8506 (1.0) 493.0874 (1.0) 7.5017 (1.0) 1;0 2.0322 (1.0) 5 3
test_plots-plots-diff[3.10.0] 836.0142 (1.73) 855.8334 (1.72) 847.9772 (1.72) 7.4098 (1.27) 848.6156 (1.72) 8.0226 (1.07) 2;0 1.1793 (0.58) 5 3
test_plots-plots-diff[3.53.2] 799.5298 (1.66) 838.0849 (1.68) 814.4243 (1.66) 18.5088 (3.16) 804.0202 (1.63) 32.8535 (4.38) 1;0 1.2279 (0.60) 5 3
test_plots-plots-diff[main] 794.0524 (1.65) 867.2010 (1.74) 826.8635 (1.68) 29.9313 (5.12) 833.8641 (1.69) 46.8526 (6.25) 2;0 1.2094 (0.60) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests ---------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 505.1678 (1.0) 526.1375 (1.0) 513.0795 (1.0) 7.9861 (1.0) 510.8140 (1.0) 9.0258 (1.0) 1;0 1.9490 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,080.3891 (2.14) 1,137.9075 (2.16) 1,107.8939 (2.16) 21.5996 (2.70) 1,108.9029 (2.17) 29.4409 (3.26) 2;0 0.9026 (0.46) 5 3
test_plots-plots-diff-json[3.53.2] 871.8239 (1.73) 904.2088 (1.72) 883.9905 (1.72) 14.2195 (1.78) 875.8446 (1.71) 22.5465 (2.50) 1;0 1.1312 (0.58) 5 3
test_plots-plots-diff-json[main] 847.2234 (1.68) 868.0493 (1.65) 854.3742 (1.67) 8.3561 (1.05) 853.9482 (1.67) 10.2239 (1.13) 1;0 1.1704 (0.60) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 441.8240 (1.0) 487.0130 (1.0) 465.7762 (1.0) 22.5525 (2.90) 470.9193 (1.0) 44.5071 (3.63) 2;0 2.1470 (1.0) 5 3
test_plots-plots-show[3.10.0] 713.5892 (1.62) 730.3781 (1.50) 720.6471 (1.55) 7.7838 (1.0) 716.2823 (1.52) 13.5262 (1.10) 1;0 1.3876 (0.65) 5 3
test_plots-plots-show[3.53.2] 651.8243 (1.48) 687.3326 (1.41) 662.1308 (1.42) 14.3803 (1.85) 656.1018 (1.39) 12.2584 (1.0) 1;1 1.5103 (0.70) 5 3
test_plots-plots-show[main] 670.7871 (1.52) 720.4123 (1.48) 686.8396 (1.47) 19.8462 (2.55) 677.3892 (1.44) 21.2049 (1.73) 1;0 1.4559 (0.68) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 449.8269 (1.0) 469.9270 (1.0) 457.0390 (1.0) 7.6562 (2.53) 454.3459 (1.0) 7.3124 (1.62) 1;0 2.1880 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 815.0048 (1.81) 853.8171 (1.82) 832.6568 (1.82) 16.3337 (5.40) 836.8295 (1.84) 26.8352 (5.94) 2;0 1.2010 (0.55) 5 3
test_plots-plots-show-json[3.53.2] 692.6506 (1.54) 700.3066 (1.49) 696.2300 (1.52) 3.0268 (1.0) 695.1992 (1.53) 4.5142 (1.0) 2;0 1.4363 (0.66) 5 3
test_plots-plots-show-json[main] 714.9811 (1.59) 770.7020 (1.64) 731.1339 (1.60) 23.2613 (7.69) 722.1213 (1.59) 27.0433 (5.99) 1;0 1.3677 (0.63) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 2.2806 (1.50) 2.2806 (1.50) 2.2806 (1.50) 0.0000 (1.0) 2.2806 (1.50) 0.0000 (1.0) 0;0 0.4385 (0.67) 1 1
test_push-push[3.10.0] 2.1148 (1.39) 2.1148 (1.39) 2.1148 (1.39) 0.0000 (1.0) 2.1148 (1.39) 0.0000 (1.0) 0;0 0.4729 (0.72) 1 1
test_push-push[3.53.2] 1.6312 (1.07) 1.6312 (1.07) 1.6312 (1.07) 0.0000 (1.0) 1.6312 (1.07) 0.0000 (1.0) 0;0 0.6131 (0.93) 1 1
test_push-push[main] 1.5236 (1.0) 1.5236 (1.0) 1.5236 (1.0) 0.0000 (1.0) 1.5236 (1.0) 0.0000 (1.0) 0;0 0.6563 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 2.7572 (1.82) 2.7572 (1.82) 2.7572 (1.82) 0.0000 (1.0) 2.7572 (1.82) 0.0000 (1.0) 0;0 0.3627 (0.55) 1 1
test_sharing-fetch[3.10.0] 3.2312 (2.13) 3.2312 (2.13) 3.2312 (2.13) 0.0000 (1.0) 3.2312 (2.13) 0.0000 (1.0) 0;0 0.3095 (0.47) 1 1
test_sharing-fetch[3.53.2] 1.8406 (1.21) 1.8406 (1.21) 1.8406 (1.21) 0.0000 (1.0) 1.8406 (1.21) 0.0000 (1.0) 0;0 0.5433 (0.82) 1 1
test_sharing-fetch[main] 1.5174 (1.0) 1.5174 (1.0) 1.5174 (1.0) 0.0000 (1.0) 1.5174 (1.0) 0.0000 (1.0) 0;0 0.6590 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 500.5056 (1.0) 500.5056 (1.0) 500.5056 (1.0) 0.0000 (1.0) 500.5056 (1.0) 0.0000 (1.0) 0;0 1.9980 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 601.0444 (1.20) 601.0444 (1.20) 601.0444 (1.20) 0.0000 (1.0) 601.0444 (1.20) 0.0000 (1.0) 0;0 1.6638 (0.83) 1 1
test_sharing-fetch-noop[3.53.2] 893.4078 (1.79) 893.4078 (1.79) 893.4078 (1.79) 0.0000 (1.0) 893.4078 (1.79) 0.0000 (1.0) 0;0 1.1193 (0.56) 1 1
test_sharing-fetch-noop[main] 885.0918 (1.77) 885.0918 (1.77) 885.0918 (1.77) 0.0000 (1.0) 885.0918 (1.77) 0.0000 (1.0) 0;0 1.1298 (0.57) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 2.5815 (1.59) 2.5815 (1.59) 2.5815 (1.59) 0.0000 (1.0) 2.5815 (1.59) 0.0000 (1.0) 0;0 0.3874 (0.63) 1 1
test_sharing-push[3.10.0] 2.2238 (1.37) 2.2238 (1.37) 2.2238 (1.37) 0.0000 (1.0) 2.2238 (1.37) 0.0000 (1.0) 0;0 0.4497 (0.73) 1 1
test_sharing-push[3.53.2] 1.7214 (1.06) 1.7214 (1.06) 1.7214 (1.06) 0.0000 (1.0) 1.7214 (1.06) 0.0000 (1.0) 0;0 0.5809 (0.94) 1 1
test_sharing-push[main] 1.6191 (1.0) 1.6191 (1.0) 1.6191 (1.0) 0.0000 (1.0) 1.6191 (1.0) 0.0000 (1.0) 0;0 0.6176 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 571.3736 (1.04) 571.3736 (1.04) 571.3736 (1.04) 0.0000 (1.0) 571.3736 (1.04) 0.0000 (1.0) 0;0 1.7502 (0.96) 1 1
test_sharing-push-noop[3.10.0] 551.1282 (1.0) 551.1282 (1.0) 551.1282 (1.0) 0.0000 (1.0) 551.1282 (1.0) 0.0000 (1.0) 0;0 1.8145 (1.0) 1 1
test_sharing-push-noop[3.53.2] 906.0109 (1.64) 906.0109 (1.64) 906.0109 (1.64) 0.0000 (1.0) 906.0109 (1.64) 0.0000 (1.0) 0;0 1.1037 (0.61) 1 1
test_sharing-push-noop[main] 898.8630 (1.63) 898.8630 (1.63) 898.8630 (1.63) 0.0000 (1.0) 898.8630 (1.63) 0.0000 (1.0) 0;0 1.1125 (0.61) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.3356 (1.64) 1.3356 (1.64) 1.3356 (1.64) 0.0000 (1.0) 1.3356 (1.64) 0.0000 (1.0) 0;0 0.7488 (0.61) 1 1
test_status-status[3.10.0] 1.4532 (1.79) 1.4532 (1.79) 1.4532 (1.79) 0.0000 (1.0) 1.4532 (1.79) 0.0000 (1.0) 0;0 0.6882 (0.56) 1 1
test_status-status[3.53.2] 1.2810 (1.58) 1.2810 (1.58) 1.2810 (1.58) 0.0000 (1.0) 1.2810 (1.58) 0.0000 (1.0) 0;0 0.7806 (0.63) 1 1
test_status-status[main] 0.8133 (1.0) 0.8133 (1.0) 0.8133 (1.0) 0.0000 (1.0) 0.8133 (1.0) 0.0000 (1.0) 0;0 1.2296 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 534.4492 (1.17) 534.4492 (1.17) 534.4492 (1.17) 0.0000 (1.0) 534.4492 (1.17) 0.0000 (1.0) 0;0 1.8711 (0.85) 1 1
test_status-status-changed[3.10.0] 558.2799 (1.23) 558.2799 (1.23) 558.2799 (1.23) 0.0000 (1.0) 558.2799 (1.23) 0.0000 (1.0) 0;0 1.7912 (0.82) 1 1
test_status-status-changed[3.53.2] 531.4486 (1.17) 531.4486 (1.17) 531.4486 (1.17) 0.0000 (1.0) 531.4486 (1.17) 0.0000 (1.0) 0;0 1.8816 (0.86) 1 1
test_status-status-changed[main] 455.1656 (1.0) 455.1656 (1.0) 455.1656 (1.0) 0.0000 (1.0) 455.1656 (1.0) 0.0000 (1.0) 0;0 2.1970 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 653.3134 (1.44) 653.3134 (1.44) 653.3134 (1.44) 0.0000 (1.0) 653.3134 (1.44) 0.0000 (1.0) 0;0 1.5307 (0.69) 1 1
test_status-status-changed-noop[3.10.0] 547.0273 (1.21) 547.0273 (1.21) 547.0273 (1.21) 0.0000 (1.0) 547.0273 (1.21) 0.0000 (1.0) 0;0 1.8281 (0.83) 1 1
test_status-status-changed-noop[3.53.2] 516.4782 (1.14) 516.4782 (1.14) 516.4782 (1.14) 0.0000 (1.0) 516.4782 (1.14) 0.0000 (1.0) 0;0 1.9362 (0.88) 1 1
test_status-status-changed-noop[main] 452.8745 (1.0) 452.8745 (1.0) 452.8745 (1.0) 0.0000 (1.0) 452.8745 (1.0) 0.0000 (1.0) 0;0 2.2081 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 544.9560 (1.19) 544.9560 (1.19) 544.9560 (1.19) 0.0000 (1.0) 544.9560 (1.19) 0.0000 (1.0) 0;0 1.8350 (0.84) 1 1
test_status-status-noop[3.10.0] 564.8168 (1.24) 564.8168 (1.24) 564.8168 (1.24) 0.0000 (1.0) 564.8168 (1.24) 0.0000 (1.0) 0;0 1.7705 (0.81) 1 1
test_status-status-noop[3.53.2] 520.0431 (1.14) 520.0431 (1.14) 520.0431 (1.14) 0.0000 (1.0) 520.0431 (1.14) 0.0000 (1.0) 0;0 1.9229 (0.88) 1 1
test_status-status-noop[main] 457.3344 (1.0) 457.3344 (1.0) 457.3344 (1.0) 0.0000 (1.0) 457.3344 (1.0) 0.0000 (1.0) 0;0 2.1866 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 6.2410 (2.13) 6.2410 (2.13) 6.2410 (2.13) 0.0000 (1.0) 6.2410 (2.13) 0.0000 (1.0) 0;0 0.1602 (0.47) 1 1
test_update-import-url[3.10.0] 6.1384 (2.10) 6.1384 (2.10) 6.1384 (2.10) 0.0000 (1.0) 6.1384 (2.10) 0.0000 (1.0) 0;0 0.1629 (0.48) 1 1
test_update-import-url[3.53.2] 4.7933 (1.64) 4.7933 (1.64) 4.7933 (1.64) 0.0000 (1.0) 4.7933 (1.64) 0.0000 (1.0) 0;0 0.2086 (0.61) 1 1
test_update-import-url[main] 2.9232 (1.0) 2.9232 (1.0) 2.9232 (1.0) 0.0000 (1.0) 2.9232 (1.0) 0.0000 (1.0) 0;0 0.3421 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 5.2120 (3.02) 5.2120 (3.02) 5.2120 (3.02) 0.0000 (1.0) 5.2120 (3.02) 0.0000 (1.0) 0;0 0.1919 (0.33) 1 1
test_update-update[3.10.0] 5.1254 (2.97) 5.1254 (2.97) 5.1254 (2.97) 0.0000 (1.0) 5.1254 (2.97) 0.0000 (1.0) 0;0 0.1951 (0.34) 1 1
test_update-update[3.53.2] 4.0198 (2.33) 4.0198 (2.33) 4.0198 (2.33) 0.0000 (1.0) 4.0198 (2.33) 0.0000 (1.0) 0;0 0.2488 (0.43) 1 1
test_update-update[main] 1.7269 (1.0) 1.7269 (1.0) 1.7269 (1.0) 0.0000 (1.0) 1.7269 (1.0) 0.0000 (1.0) 0;0 0.5791 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 951.6127 (1.55) 951.6127 (1.55) 951.6127 (1.55) 0.0000 (1.0) 951.6127 (1.55) 0.0000 (1.0) 0;0 1.0508 (0.64) 1 1
test_update-update-noop[3.10.0] 943.0773 (1.54) 943.0773 (1.54) 943.0773 (1.54) 0.0000 (1.0) 943.0773 (1.54) 0.0000 (1.0) 0;0 1.0604 (0.65) 1 1
test_update-update-noop[3.53.2] 894.1094 (1.46) 894.1094 (1.46) 894.1094 (1.46) 0.0000 (1.0) 894.1094 (1.46) 0.0000 (1.0) 0;0 1.1184 (0.68) 1 1
test_update-update-noop[main] 612.3207 (1.0) 612.3207 (1.0) 612.3207 (1.0) 0.0000 (1.0) 612.3207 (1.0) 0.0000 (1.0) 0;0 1.6331 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
updates: