Closed skshetry closed 3 weeks ago
Wed Aug 21 02:33:41 UTC 2024 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add[2.58.2] 3.7244 (1.88) 3.7244 (1.88) 3.7244 (1.88) 0.0000 (1.0) 3.7244 (1.88) 0.0000 (1.0) 0;0 0.2685 (0.53) 1 1 test_add_copy-add[3.10.0] 3.6785 (1.86) 3.6785 (1.86) 3.6785 (1.86) 0.0000 (1.0) 3.6785 (1.86) 0.0000 (1.0) 0;0 0.2719 (0.54) 1 1 test_add_copy-add[3.53.2] 3.2668 (1.65) 3.2668 (1.65) 3.2668 (1.65) 0.0000 (1.0) 3.2668 (1.65) 0.0000 (1.0) 0;0 0.3061 (0.60) 1 1 test_add_copy-add[main] 1.9763 (1.0) 1.9763 (1.0) 1.9763 (1.0) 0.0000 (1.0) 1.9763 (1.0) 0.0000 (1.0) 0;0 0.5060 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add-noop[2.58.2] 1.4878 (2.23) 1.4878 (2.23) 1.4878 (2.23) 0.0000 (1.0) 1.4878 (2.23) 0.0000 (1.0) 0;0 0.6721 (0.45) 1 1 test_add_copy-add-noop[3.10.0] 1.6624 (2.49) 1.6624 (2.49) 1.6624 (2.49) 0.0000 (1.0) 1.6624 (2.49) 0.0000 (1.0) 0;0 0.6015 (0.40) 1 1 test_add_copy-add-noop[3.53.2] 1.3294 (1.99) 1.3294 (1.99) 1.3294 (1.99) 0.0000 (1.0) 1.3294 (1.99) 0.0000 (1.0) 0;0 0.7522 (0.50) 1 1 test_add_copy-add-noop[main] 0.6673 (1.0) 0.6673 (1.0) 0.6673 (1.0) 0.0000 (1.0) 0.6673 (1.0) 0.0000 (1.0) 0;0 1.4987 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add[2.58.2] 3.0786 (1.39) 3.0786 (1.39) 3.0786 (1.39) 0.0000 (1.0) 3.0786 (1.39) 0.0000 (1.0) 0;0 0.3248 (0.72) 1 1 test_add_hardlink-add[3.10.0] 3.1697 (1.43) 3.1697 (1.43) 3.1697 (1.43) 0.0000 (1.0) 3.1697 (1.43) 0.0000 (1.0) 0;0 0.3155 (0.70) 1 1 test_add_hardlink-add[3.53.2] 2.7090 (1.22) 2.7090 (1.22) 2.7090 (1.22) 0.0000 (1.0) 2.7090 (1.22) 0.0000 (1.0) 0;0 0.3691 (0.82) 1 1 test_add_hardlink-add[main] 2.2145 (1.0) 2.2145 (1.0) 2.2145 (1.0) 0.0000 (1.0) 2.2145 (1.0) 0.0000 (1.0) 0;0 0.4516 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add-noop[2.58.2] 1.6659 (2.51) 1.6659 (2.51) 1.6659 (2.51) 0.0000 (1.0) 1.6659 (2.51) 0.0000 (1.0) 0;0 0.6003 (0.40) 1 1 test_add_hardlink-add-noop[3.10.0] 1.5866 (2.39) 1.5866 (2.39) 1.5866 (2.39) 0.0000 (1.0) 1.5866 (2.39) 0.0000 (1.0) 0;0 0.6303 (0.42) 1 1 test_add_hardlink-add-noop[3.53.2] 1.5031 (2.26) 1.5031 (2.26) 1.5031 (2.26) 0.0000 (1.0) 1.5031 (2.26) 0.0000 (1.0) 0;0 0.6653 (0.44) 1 1 test_add_hardlink-add-noop[main] 0.6642 (1.0) 0.6642 (1.0) 0.6642 (1.0) 0.0000 (1.0) 0.6642 (1.0) 0.0000 (1.0) 0;0 1.5056 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_symlink-add[2.58.2] 3.1876 (1.41) 3.1876 (1.41) 3.1876 (1.41) 0.0000 (1.0) 3.1876 (1.41) 0.0000 (1.0) 0;0 0.3137 (0.71) 1 1 test_add_symlink-add[3.10.0] 3.4624 (1.53) 3.4624 (1.53) 3.4624 (1.53) 0.0000 (1.0) 3.4624 (1.53) 0.0000 (1.0) 0;0 0.2888 (0.66) 1 1 test_add_symlink-add[3.53.2] 2.8987 (1.28) 2.8987 (1.28) 2.8987 (1.28) 0.0000 (1.0) 2.8987 (1.28) 0.0000 (1.0) 0;0 0.3450 (0.78) 1 1 test_add_symlink-add[main] 2.2681 (1.0) 2.2681 (1.0) 2.2681 (1.0) 0.0000 (1.0) 2.2681 (1.0) 0.0000 (1.0) 0;0 0.4409 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_add_symlink-add-noop[2.58.2] 1.9525 (2.73) 1.9525 (2.73) 1.9525 (2.73) 0.0000 (1.0) 1.9525 (2.73) 0.0000 (1.0) 0;0 0.5122 (0.37) 1 1 test_add_symlink-add-noop[3.10.0] 1.9084 (2.67) 1.9084 (2.67) 1.9084 (2.67) 0.0000 (1.0) 1.9084 (2.67) 0.0000 (1.0) 0;0 0.5240 (0.37) 1 1 test_add_symlink-add-noop[3.53.2] 1.7778 (2.49) 1.7778 (2.49) 1.7778 (2.49) 0.0000 (1.0) 1.7778 (2.49) 0.0000 (1.0) 0;0 0.5625 (0.40) 1 1 test_add_symlink-add-noop[main] 0.7151 (1.0) 0.7151 (1.0) 0.7151 (1.0) 0.0000 (1.0) 0.7151 (1.0) 0.0000 (1.0) 0;0 1.3983 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.58.2] 2.2756 (1.34) 2.2756 (1.34) 2.2756 (1.34) 0.0000 (1.0) 2.2756 (1.34) 0.0000 (1.0) 0;0 0.4394 (0.75) 1 1 test_checkout_copy-checkout[3.10.0] 4.0551 (2.39) 4.0551 (2.39) 4.0551 (2.39) 0.0000 (1.0) 4.0551 (2.39) 0.0000 (1.0) 0;0 0.2466 (0.42) 1 1 test_checkout_copy-checkout[3.53.2] 1.6987 (1.0) 1.6987 (1.0) 1.6987 (1.0) 0.0000 (1.0) 1.6987 (1.0) 0.0000 (1.0) 0;0 0.5887 (1.0) 1 1 test_checkout_copy-checkout[main] 1.7883 (1.05) 1.7883 (1.05) 1.7883 (1.05) 0.0000 (1.0) 1.7883 (1.05) 0.0000 (1.0) 0;0 0.5592 (0.95) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.58.2] 582.0812 (1.18) 582.0812 (1.18) 582.0812 (1.18) 0.0000 (1.0) 582.0812 (1.18) 0.0000 (1.0) 0;0 1.7180 (0.84) 1 1 test_checkout_copy-checkout-noop[3.10.0] 595.1943 (1.21) 595.1943 (1.21) 595.1943 (1.21) 0.0000 (1.0) 595.1943 (1.21) 0.0000 (1.0) 0;0 1.6801 (0.83) 1 1 test_checkout_copy-checkout-noop[3.53.2] 567.9095 (1.16) 567.9095 (1.16) 567.9095 (1.16) 0.0000 (1.0) 567.9095 (1.16) 0.0000 (1.0) 0;0 1.7608 (0.86) 1 1 test_checkout_copy-checkout-noop[main] 491.2359 (1.0) 491.2359 (1.0) 491.2359 (1.0) 0.0000 (1.0) 491.2359 (1.0) 0.0000 (1.0) 0;0 2.0357 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.58.2] 722.0752 (1.34) 722.0752 (1.34) 722.0752 (1.34) 0.0000 (1.0) 722.0752 (1.34) 0.0000 (1.0) 0;0 1.3849 (0.75) 1 1 test_checkout_copy-checkout-update[3.10.0] 654.4710 (1.21) 654.4710 (1.21) 654.4710 (1.21) 0.0000 (1.0) 654.4710 (1.21) 0.0000 (1.0) 0;0 1.5280 (0.83) 1 1 test_checkout_copy-checkout-update[3.53.2] 614.2753 (1.14) 614.2753 (1.14) 614.2753 (1.14) 0.0000 (1.0) 614.2753 (1.14) 0.0000 (1.0) 0;0 1.6279 (0.88) 1 1 test_checkout_copy-checkout-update[main] 540.1175 (1.0) 540.1175 (1.0) 540.1175 (1.0) 0.0000 (1.0) 540.1175 (1.0) 0.0000 (1.0) 0;0 1.8514 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.58.2] 1.7348 (1.45) 1.7348 (1.45) 1.7348 (1.45) 0.0000 (1.0) 1.7348 (1.45) 0.0000 (1.0) 0;0 0.5764 (0.69) 1 1 test_checkout_hardlink-checkout[3.10.0] 1.3389 (1.12) 1.3389 (1.12) 1.3389 (1.12) 0.0000 (1.0) 1.3389 (1.12) 0.0000 (1.0) 0;0 0.7469 (0.89) 1 1 test_checkout_hardlink-checkout[3.53.2] 1.1962 (1.0) 1.1962 (1.0) 1.1962 (1.0) 0.0000 (1.0) 1.1962 (1.0) 0.0000 (1.0) 0;0 0.8360 (1.0) 1 1 test_checkout_hardlink-checkout[main] 1.2866 (1.08) 1.2866 (1.08) 1.2866 (1.08) 0.0000 (1.0) 1.2866 (1.08) 0.0000 (1.0) 0;0 0.7773 (0.93) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.58.2] 582.0945 (1.18) 582.0945 (1.18) 582.0945 (1.18) 0.0000 (1.0) 582.0945 (1.18) 0.0000 (1.0) 0;0 1.7179 (0.85) 1 1 test_checkout_hardlink-checkout-noop[3.10.0] 590.4718 (1.20) 590.4718 (1.20) 590.4718 (1.20) 0.0000 (1.0) 590.4718 (1.20) 0.0000 (1.0) 0;0 1.6936 (0.83) 1 1 test_checkout_hardlink-checkout-noop[3.53.2] 567.8362 (1.15) 567.8362 (1.15) 567.8362 (1.15) 0.0000 (1.0) 567.8362 (1.15) 0.0000 (1.0) 0;0 1.7611 (0.87) 1 1 test_checkout_hardlink-checkout-noop[main] 492.7526 (1.0) 492.7526 (1.0) 492.7526 (1.0) 0.0000 (1.0) 492.7526 (1.0) 0.0000 (1.0) 0;0 2.0294 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.58.2] 711.6760 (1.30) 711.6760 (1.30) 711.6760 (1.30) 0.0000 (1.0) 711.6760 (1.30) 0.0000 (1.0) 0;0 1.4051 (0.77) 1 1 test_checkout_hardlink-checkout-update[3.10.0] 648.1714 (1.19) 648.1714 (1.19) 648.1714 (1.19) 0.0000 (1.0) 648.1714 (1.19) 0.0000 (1.0) 0;0 1.5428 (0.84) 1 1 test_checkout_hardlink-checkout-update[3.53.2] 622.5098 (1.14) 622.5098 (1.14) 622.5098 (1.14) 0.0000 (1.0) 622.5098 (1.14) 0.0000 (1.0) 0;0 1.6064 (0.88) 1 1 test_checkout_hardlink-checkout-update[main] 545.9944 (1.0) 545.9944 (1.0) 545.9944 (1.0) 0.0000 (1.0) 545.9944 (1.0) 0.0000 (1.0) 0;0 1.8315 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.58.2] 1.5021 (1.15) 1.5021 (1.15) 1.5021 (1.15) 0.0000 (1.0) 1.5021 (1.15) 0.0000 (1.0) 0;0 0.6658 (0.87) 1 1 test_checkout_symlink-checkout[3.10.0] 1.4568 (1.11) 1.4568 (1.11) 1.4568 (1.11) 0.0000 (1.0) 1.4568 (1.11) 0.0000 (1.0) 0;0 0.6864 (0.90) 1 1 test_checkout_symlink-checkout[3.53.2] 1.3073 (1.0) 1.3073 (1.0) 1.3073 (1.0) 0.0000 (1.0) 1.3073 (1.0) 0.0000 (1.0) 0;0 0.7650 (1.0) 1 1 test_checkout_symlink-checkout[main] 1.3508 (1.03) 1.3508 (1.03) 1.3508 (1.03) 0.0000 (1.0) 1.3508 (1.03) 0.0000 (1.0) 0;0 0.7403 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.58.2] 631.6052 (1.22) 631.6052 (1.22) 631.6052 (1.22) 0.0000 (1.0) 631.6052 (1.22) 0.0000 (1.0) 0;0 1.5833 (0.82) 1 1 test_checkout_symlink-checkout-noop[3.10.0] 655.2148 (1.26) 655.2148 (1.26) 655.2148 (1.26) 0.0000 (1.0) 655.2148 (1.26) 0.0000 (1.0) 0;0 1.5262 (0.79) 1 1 test_checkout_symlink-checkout-noop[3.53.2] 606.1618 (1.17) 606.1618 (1.17) 606.1618 (1.17) 0.0000 (1.0) 606.1618 (1.17) 0.0000 (1.0) 0;0 1.6497 (0.86) 1 1 test_checkout_symlink-checkout-noop[main] 518.8447 (1.0) 518.8447 (1.0) 518.8447 (1.0) 0.0000 (1.0) 518.8447 (1.0) 0.0000 (1.0) 0;0 1.9274 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout-update[2.58.2] 799.7468 (1.36) 799.7468 (1.36) 799.7468 (1.36) 0.0000 (1.0) 799.7468 (1.36) 0.0000 (1.0) 0;0 1.2504 (0.74) 1 1 test_checkout_symlink-checkout-update[3.10.0] 717.9831 (1.22) 717.9831 (1.22) 717.9831 (1.22) 0.0000 (1.0) 717.9831 (1.22) 0.0000 (1.0) 0;0 1.3928 (0.82) 1 1 test_checkout_symlink-checkout-update[3.53.2] 692.5437 (1.17) 692.5437 (1.17) 692.5437 (1.17) 0.0000 (1.0) 692.5437 (1.17) 0.0000 (1.0) 0;0 1.4440 (0.85) 1 1 test_checkout_symlink-checkout-update[main] 589.7903 (1.0) 589.7903 (1.0) 589.7903 (1.0) 0.0000 (1.0) 589.7903 (1.0) 0.0000 (1.0) 0;0 1.6955 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.58.2] 609.3462 (1.23) 609.3462 (1.23) 609.3462 (1.23) 0.0000 (1.0) 609.3462 (1.23) 0.0000 (1.0) 0;0 1.6411 (0.81) 1 1 test_data_status-data-changed[3.10.0] 585.7392 (1.18) 585.7392 (1.18) 585.7392 (1.18) 0.0000 (1.0) 585.7392 (1.18) 0.0000 (1.0) 0;0 1.7072 (0.84) 1 1 test_data_status-data-changed[3.53.2] 574.8772 (1.16) 574.8772 (1.16) 574.8772 (1.16) 0.0000 (1.0) 574.8772 (1.16) 0.0000 (1.0) 0;0 1.7395 (0.86) 1 1 test_data_status-data-changed[main] 494.7415 (1.0) 494.7415 (1.0) 494.7415 (1.0) 0.0000 (1.0) 494.7415 (1.0) 0.0000 (1.0) 0;0 2.0213 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.58.2] 622.1847 (1.21) 622.1847 (1.21) 622.1847 (1.21) 0.0000 (1.0) 622.1847 (1.21) 0.0000 (1.0) 0;0 1.6072 (0.83) 1 1 test_data_status-data-changed-noop[3.10.0] 586.5309 (1.14) 586.5309 (1.14) 586.5309 (1.14) 0.0000 (1.0) 586.5309 (1.14) 0.0000 (1.0) 0;0 1.7049 (0.88) 1 1 test_data_status-data-changed-noop[3.53.2] 583.4026 (1.13) 583.4026 (1.13) 583.4026 (1.13) 0.0000 (1.0) 583.4026 (1.13) 0.0000 (1.0) 0;0 1.7141 (0.88) 1 1 test_data_status-data-changed-noop[main] 515.2967 (1.0) 515.2967 (1.0) 515.2967 (1.0) 0.0000 (1.0) 515.2967 (1.0) 0.0000 (1.0) 0;0 1.9406 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.58.2] 1.5370 (1.90) 1.5370 (1.90) 1.5370 (1.90) 0.0000 (1.0) 1.5370 (1.90) 0.0000 (1.0) 0;0 0.6506 (0.53) 1 1 test_data_status-data-new[3.10.0] 1.5145 (1.88) 1.5145 (1.88) 1.5145 (1.88) 0.0000 (1.0) 1.5145 (1.88) 0.0000 (1.0) 0;0 0.6603 (0.53) 1 1 test_data_status-data-new[3.53.2] 1.3995 (1.73) 1.3995 (1.73) 1.3995 (1.73) 0.0000 (1.0) 1.3995 (1.73) 0.0000 (1.0) 0;0 0.7146 (0.58) 1 1 test_data_status-data-new[main] 0.8075 (1.0) 0.8075 (1.0) 0.8075 (1.0) 0.0000 (1.0) 0.8075 (1.0) 0.0000 (1.0) 0;0 1.2383 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.58.2] 614.1654 (1.24) 614.1654 (1.24) 614.1654 (1.24) 0.0000 (1.0) 614.1654 (1.24) 0.0000 (1.0) 0;0 1.6282 (0.81) 1 1 test_data_status-data-noop[3.10.0] 595.8722 (1.20) 595.8722 (1.20) 595.8722 (1.20) 0.0000 (1.0) 595.8722 (1.20) 0.0000 (1.0) 0;0 1.6782 (0.83) 1 1 test_data_status-data-noop[3.53.2] 572.4504 (1.15) 572.4504 (1.15) 572.4504 (1.15) 0.0000 (1.0) 572.4504 (1.15) 0.0000 (1.0) 0;0 1.7469 (0.87) 1 1 test_data_status-data-noop[main] 496.1509 (1.0) 496.1509 (1.0) 496.1509 (1.0) 0.0000 (1.0) 496.1509 (1.0) 0.0000 (1.0) 0;0 2.0155 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.58.2] 1.1188 (1.10) 1.1188 (1.10) 1.1188 (1.10) 0.0000 (1.0) 1.1188 (1.10) 0.0000 (1.0) 0;0 0.8938 (0.91) 1 1 test_data_status_all_flags-data-changed[3.10.0] 1.0949 (1.08) 1.0949 (1.08) 1.0949 (1.08) 0.0000 (1.0) 1.0949 (1.08) 0.0000 (1.0) 0;0 0.9133 (0.93) 1 1 test_data_status_all_flags-data-changed[3.53.2] 1.0791 (1.06) 1.0791 (1.06) 1.0791 (1.06) 0.0000 (1.0) 1.0791 (1.06) 0.0000 (1.0) 0;0 0.9267 (0.94) 1 1 test_data_status_all_flags-data-changed[main] 1.0170 (1.0) 1.0170 (1.0) 1.0170 (1.0) 0.0000 (1.0) 1.0170 (1.0) 0.0000 (1.0) 0;0 0.9833 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.58.2] 1.1422 (1.14) 1.1422 (1.14) 1.1422 (1.14) 0.0000 (1.0) 1.1422 (1.14) 0.0000 (1.0) 0;0 0.8755 (0.87) 1 1 test_data_status_all_flags-data-changed-noop[3.10.0] 1.0953 (1.10) 1.0953 (1.10) 1.0953 (1.10) 0.0000 (1.0) 1.0953 (1.10) 0.0000 (1.0) 0;0 0.9130 (0.91) 1 1 test_data_status_all_flags-data-changed-noop[3.53.2] 1.0841 (1.09) 1.0841 (1.09) 1.0841 (1.09) 0.0000 (1.0) 1.0841 (1.09) 0.0000 (1.0) 0;0 0.9224 (0.92) 1 1 test_data_status_all_flags-data-changed-noop[main] 0.9990 (1.0) 0.9990 (1.0) 0.9990 (1.0) 0.0000 (1.0) 0.9990 (1.0) 0.0000 (1.0) 0;0 1.0010 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.58.2] 2.0804 (1.51) 2.0804 (1.51) 2.0804 (1.51) 0.0000 (1.0) 2.0804 (1.51) 0.0000 (1.0) 0;0 0.4807 (0.66) 1 1 test_data_status_all_flags-data-new[3.10.0] 2.0615 (1.50) 2.0615 (1.50) 2.0615 (1.50) 0.0000 (1.0) 2.0615 (1.50) 0.0000 (1.0) 0;0 0.4851 (0.67) 1 1 test_data_status_all_flags-data-new[3.53.2] 1.9291 (1.40) 1.9291 (1.40) 1.9291 (1.40) 0.0000 (1.0) 1.9291 (1.40) 0.0000 (1.0) 0;0 0.5184 (0.71) 1 1 test_data_status_all_flags-data-new[main] 1.3782 (1.0) 1.3782 (1.0) 1.3782 (1.0) 0.0000 (1.0) 1.3782 (1.0) 0.0000 (1.0) 0;0 0.7256 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.58.2] 1.1052 (1.13) 1.1052 (1.13) 1.1052 (1.13) 0.0000 (1.0) 1.1052 (1.13) 0.0000 (1.0) 0;0 0.9048 (0.89) 1 1 test_data_status_all_flags-data-noop[3.10.0] 1.1149 (1.14) 1.1149 (1.14) 1.1149 (1.14) 0.0000 (1.0) 1.1149 (1.14) 0.0000 (1.0) 0;0 0.8969 (0.88) 1 1 test_data_status_all_flags-data-noop[3.53.2] 1.0509 (1.07) 1.0509 (1.07) 1.0509 (1.07) 0.0000 (1.0) 1.0509 (1.07) 0.0000 (1.0) 0;0 0.9515 (0.93) 1 1 test_data_status_all_flags-data-noop[main] 0.9794 (1.0) 0.9794 (1.0) 0.9794 (1.0) 0.0000 (1.0) 0.9794 (1.0) 0.0000 (1.0) 0;0 1.0210 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.58.2] 1.4090 (1.42) 1.4090 (1.42) 1.4090 (1.42) 0.0000 (1.0) 1.4090 (1.42) 0.0000 (1.0) 0;0 0.7097 (0.70) 1 1 test_diff-diff[3.10.0] 1.5380 (1.56) 1.5380 (1.56) 1.5380 (1.56) 0.0000 (1.0) 1.5380 (1.56) 0.0000 (1.0) 0;0 0.6502 (0.64) 1 1 test_diff-diff[3.53.2] 1.4042 (1.42) 1.4042 (1.42) 1.4042 (1.42) 0.0000 (1.0) 1.4042 (1.42) 0.0000 (1.0) 0;0 0.7121 (0.70) 1 1 test_diff-diff[main] 0.9889 (1.0) 0.9889 (1.0) 0.9889 (1.0) 0.0000 (1.0) 0.9889 (1.0) 0.0000 (1.0) 0;0 1.0112 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.58.2] 669.5506 (1.20) 669.5506 (1.20) 669.5506 (1.20) 0.0000 (1.0) 669.5506 (1.20) 0.0000 (1.0) 0;0 1.4935 (0.83) 1 1 test_diff-diff-changed[3.10.0] 1,003.2793 (1.80) 1,003.2793 (1.80) 1,003.2793 (1.80) 0.0000 (1.0) 1,003.2793 (1.80) 0.0000 (1.0) 0;0 0.9967 (0.56) 1 1 test_diff-diff-changed[3.53.2] 643.1269 (1.15) 643.1269 (1.15) 643.1269 (1.15) 0.0000 (1.0) 643.1269 (1.15) 0.0000 (1.0) 0;0 1.5549 (0.87) 1 1 test_diff-diff-changed[main] 558.7242 (1.0) 558.7242 (1.0) 558.7242 (1.0) 0.0000 (1.0) 558.7242 (1.0) 0.0000 (1.0) 0;0 1.7898 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.58.2] 646.9870 (1.16) 646.9870 (1.16) 646.9870 (1.16) 0.0000 (1.0) 646.9870 (1.16) 0.0000 (1.0) 0;0 1.5456 (0.86) 1 1 test_diff-diff-changed-noop[3.10.0] 832.6571 (1.50) 832.6571 (1.50) 832.6571 (1.50) 0.0000 (1.0) 832.6571 (1.50) 0.0000 (1.0) 0;0 1.2010 (0.67) 1 1 test_diff-diff-changed-noop[3.53.2] 622.0851 (1.12) 622.0851 (1.12) 622.0851 (1.12) 0.0000 (1.0) 622.0851 (1.12) 0.0000 (1.0) 0;0 1.6075 (0.89) 1 1 test_diff-diff-changed-noop[main] 555.4679 (1.0) 555.4679 (1.0) 555.4679 (1.0) 0.0000 (1.0) 555.4679 (1.0) 0.0000 (1.0) 0;0 1.8003 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.58.2] 613.1488 (1.08) 613.1488 (1.08) 613.1488 (1.08) 0.0000 (1.0) 613.1488 (1.08) 0.0000 (1.0) 0;0 1.6309 (0.93) 1 1 test_diff-diff-noop[3.10.0] 645.0995 (1.13) 645.0995 (1.13) 645.0995 (1.13) 0.0000 (1.0) 645.0995 (1.13) 0.0000 (1.0) 0;0 1.5501 (0.88) 1 1 test_diff-diff-noop[3.53.2] 615.9407 (1.08) 615.9407 (1.08) 615.9407 (1.08) 0.0000 (1.0) 615.9407 (1.08) 0.0000 (1.0) 0;0 1.6235 (0.93) 1 1 test_diff-diff-noop[main] 570.0258 (1.0) 570.0258 (1.0) 570.0258 (1.0) 0.0000 (1.0) 570.0258 (1.0) 0.0000 (1.0) 0;0 1.7543 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.58.2] 1.0688 (1.0) 1.0688 (1.0) 1.0688 (1.0) 0.0000 (1.0) 1.0688 (1.0) 0.0000 (1.0) 0;0 0.9357 (1.0) 1 1 test_exp_show-exp[3.10.0] 6.5116 (6.09) 6.5116 (6.09) 6.5116 (6.09) 0.0000 (1.0) 6.5116 (6.09) 0.0000 (1.0) 0;0 0.1536 (0.16) 1 1 test_exp_show-exp[3.53.2] 4.3673 (4.09) 4.3673 (4.09) 4.3673 (4.09) 0.0000 (1.0) 4.3673 (4.09) 0.0000 (1.0) 0;0 0.2290 (0.24) 1 1 test_exp_show-exp[main] 5.9161 (5.54) 5.9161 (5.54) 5.9161 (5.54) 0.0000 (1.0) 5.9161 (5.54) 0.0000 (1.0) 0;0 0.1690 (0.18) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_fetch-fetch[2.58.2] 4.0250 (2.70) 4.0250 (2.70) 4.0250 (2.70) 0.0000 (1.0) 4.0250 (2.70) 0.0000 (1.0) 0;0 0.2485 (0.37) 1 1 test_fetch-fetch[3.10.0] 5.0130 (3.36) 5.0130 (3.36) 5.0130 (3.36) 0.0000 (1.0) 5.0130 (3.36) 0.0000 (1.0) 0;0 0.1995 (0.30) 1 1 test_fetch-fetch[3.53.2] 1.9814 (1.33) 1.9814 (1.33) 1.9814 (1.33) 0.0000 (1.0) 1.9814 (1.33) 0.0000 (1.0) 0;0 0.5047 (0.75) 1 1 test_fetch-fetch[main] 1.4909 (1.0) 1.4909 (1.0) 1.4909 (1.0) 0.0000 (1.0) 1.4909 (1.0) 0.0000 (1.0) 0;0 0.6708 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.58.2] 664.6264 (1.30) 664.6264 (1.30) 664.6264 (1.30) 0.0000 (1.0) 664.6264 (1.30) 0.0000 (1.0) 0;0 1.5046 (0.77) 1 1 test_gc-gc[3.10.0] 777.9740 (1.52) 777.9740 (1.52) 777.9740 (1.52) 0.0000 (1.0) 777.9740 (1.52) 0.0000 (1.0) 0;0 1.2854 (0.66) 1 1 test_gc-gc[3.53.2] 683.4932 (1.33) 683.4932 (1.33) 683.4932 (1.33) 0.0000 (1.0) 683.4932 (1.33) 0.0000 (1.0) 0;0 1.4631 (0.75) 1 1 test_gc-gc[main] 512.8689 (1.0) 512.8689 (1.0) 512.8689 (1.0) 0.0000 (1.0) 512.8689 (1.0) 0.0000 (1.0) 0;0 1.9498 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.58.2] 5.7235 (1.17) 5.7235 (1.17) 5.7235 (1.17) 0.0000 (1.0) 5.7235 (1.17) 0.0000 (1.0) 0;0 0.1747 (0.86) 1 1 test_get-get[3.10.0] 6.8065 (1.39) 6.8065 (1.39) 6.8065 (1.39) 0.0000 (1.0) 6.8065 (1.39) 0.0000 (1.0) 0;0 0.1469 (0.72) 1 1 test_get-get[3.53.2] 5.1065 (1.04) 5.1065 (1.04) 5.1065 (1.04) 0.0000 (1.0) 5.1065 (1.04) 0.0000 (1.0) 0;0 0.1958 (0.96) 1 1 test_get-get[main] 4.9023 (1.0) 4.9023 (1.0) 4.9023 (1.0) 0.0000 (1.0) 4.9023 (1.0) 0.0000 (1.0) 0;0 0.2040 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.58.2] 3.1117 (3.35) 3.1117 (3.35) 3.1117 (3.35) 0.0000 (1.0) 3.1117 (3.35) 0.0000 (1.0) 0;0 0.3214 (0.30) 1 1 test_get_url-get-url[3.10.0] 3.3853 (3.64) 3.3853 (3.64) 3.3853 (3.64) 0.0000 (1.0) 3.3853 (3.64) 0.0000 (1.0) 0;0 0.2954 (0.27) 1 1 test_get_url-get-url[3.53.2] 1.0607 (1.14) 1.0607 (1.14) 1.0607 (1.14) 0.0000 (1.0) 1.0607 (1.14) 0.0000 (1.0) 0;0 0.9427 (0.88) 1 1 test_get_url-get-url[main] 0.9300 (1.0) 0.9300 (1.0) 0.9300 (1.0) 0.0000 (1.0) 0.9300 (1.0) 0.0000 (1.0) 0;0 1.0753 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.58.2] 126.0627 (1.00) 135.7544 (1.02) 129.2445 (1.01) 1.8642 (1.14) 128.8384 (1.00) 2.1012 (1.00) 22;4 7.7373 (0.99) 100 1 test_help---help[3.10.0] 125.9144 (1.0) 136.1068 (1.03) 129.9603 (1.01) 1.7457 (1.07) 129.7753 (1.01) 2.0974 (1.0) 23;3 7.6947 (0.99) 100 1 test_help---help[3.53.2] 126.0082 (1.00) 175.5944 (1.32) 130.4628 (1.01) 5.9018 (3.61) 128.9811 (1.00) 4.3281 (2.06) 3;2 7.6650 (0.99) 100 1 test_help---help[main] 126.0551 (1.00) 132.5308 (1.0) 128.5490 (1.0) 1.6328 (1.0) 128.3578 (1.0) 2.2167 (1.06) 34;0 7.7791 (1.0) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 3 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.58.2] 9.1722 (1.15) 9.1722 (1.15) 9.1722 (1.15) 0.0000 (1.0) 9.1722 (1.15) 0.0000 (1.0) 0;0 0.1090 (0.87) 1 1 test_import-import[3.10.0] 10.2042 (1.28) 10.2042 (1.28) 10.2042 (1.28) 0.0000 (1.0) 10.2042 (1.28) 0.0000 (1.0) 0;0 0.0980 (0.78) 1 1 test_import-import[main] 7.9981 (1.0) 7.9981 (1.0) 7.9981 (1.0) 0.0000 (1.0) 7.9981 (1.0) 0.0000 (1.0) 0;0 0.1250 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.58.2] 7.4869 (2.63) 7.4869 (2.63) 7.4869 (2.63) 0.0000 (1.0) 7.4869 (2.63) 0.0000 (1.0) 0;0 0.1336 (0.38) 1 1 test_import_url-import-url[3.10.0] 7.7180 (2.71) 7.7180 (2.71) 7.7180 (2.71) 0.0000 (1.0) 7.7180 (2.71) 0.0000 (1.0) 0;0 0.1296 (0.37) 1 1 test_import_url-import-url[3.53.2] 4.7847 (1.68) 4.7847 (1.68) 4.7847 (1.68) 0.0000 (1.0) 4.7847 (1.68) 0.0000 (1.0) 0;0 0.2090 (0.60) 1 1 test_import_url-import-url[main] 2.8483 (1.0) 2.8483 (1.0) 2.8483 (1.0) 0.0000 (1.0) 2.8483 (1.0) 0.0000 (1.0) 0;0 0.3511 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.58.2] 398.0709 (1.00) 453.4771 (1.00) 414.1922 (1.01) 10.7431 (1.50) 411.8776 (1.00) 14.1967 (1.60) 24;2 2.4143 (0.99) 100 1 test_init-init[3.10.0] 412.8365 (1.04) 460.3589 (1.02) 424.1557 (1.03) 7.1678 (1.0) 423.1391 (1.03) 8.8874 (1.0) 26;1 2.3576 (0.97) 100 1 test_init-init[3.53.2] 397.4350 (1.0) 453.4463 (1.0) 411.0031 (1.0) 8.9163 (1.24) 410.7113 (1.0) 10.3165 (1.16) 21;2 2.4331 (1.0) 100 1 test_init-init[main] 398.3858 (1.00) 588.5012 (1.30) 416.8369 (1.01) 22.3486 (3.12) 411.3809 (1.00) 11.3377 (1.28) 5;8 2.3990 (0.99) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.58.2] 585.1802 (1.41) 585.1802 (1.41) 585.1802 (1.41) 0.0000 (1.0) 585.1802 (1.41) 0.0000 (1.0) 0;0 1.7089 (0.71) 1 1 test_list-list[3.10.0] 662.0583 (1.59) 662.0583 (1.59) 662.0583 (1.59) 0.0000 (1.0) 662.0583 (1.59) 0.0000 (1.0) 0;0 1.5104 (0.63) 1 1 test_list-list[3.53.2] 569.4842 (1.37) 569.4842 (1.37) 569.4842 (1.37) 0.0000 (1.0) 569.4842 (1.37) 0.0000 (1.0) 0;0 1.7560 (0.73) 1 1 test_list-list[main] 415.5631 (1.0) 415.5631 (1.0) 415.5631 (1.0) 0.0000 (1.0) 415.5631 (1.0) 0.0000 (1.0) 0;0 2.4064 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.58.2] 437.5931 (1.06) 437.5931 (1.06) 437.5931 (1.06) 0.0000 (1.0) 437.5931 (1.06) 0.0000 (1.0) 0;0 2.2852 (0.94) 1 1 test_list-list-dvc-only[3.10.0] 429.9507 (1.04) 429.9507 (1.04) 429.9507 (1.04) 0.0000 (1.0) 429.9507 (1.04) 0.0000 (1.0) 0;0 2.3258 (0.96) 1 1 test_list-list-dvc-only[3.53.2] 421.8312 (1.02) 421.8312 (1.02) 421.8312 (1.02) 0.0000 (1.0) 421.8312 (1.02) 0.0000 (1.0) 0;0 2.3706 (0.98) 1 1 test_list-list-dvc-only[main] 412.4604 (1.0) 412.4604 (1.0) 412.4604 (1.0) 0.0000 (1.0) 412.4604 (1.0) 0.0000 (1.0) 0;0 2.4245 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.58.2] 512.6465 (1.06) 512.6465 (1.06) 512.6465 (1.06) 0.0000 (1.0) 512.6465 (1.06) 0.0000 (1.0) 0;0 1.9507 (0.94) 1 1 test_list-list-recursive[3.10.0] 511.5300 (1.06) 511.5300 (1.06) 511.5300 (1.06) 0.0000 (1.0) 511.5300 (1.06) 0.0000 (1.0) 0;0 1.9549 (0.94) 1 1 test_list-list-recursive[3.53.2] 484.9203 (1.01) 484.9203 (1.01) 484.9203 (1.01) 0.0000 (1.0) 484.9203 (1.01) 0.0000 (1.0) 0;0 2.0622 (0.99) 1 1 test_list-list-recursive[main] 481.7578 (1.0) 481.7578 (1.0) 481.7578 (1.0) 0.0000 (1.0) 481.7578 (1.0) 0.0000 (1.0) 0;0 2.0757 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.58.2] 425.9843 (1.04) 425.9843 (1.04) 425.9843 (1.04) 0.0000 (1.0) 425.9843 (1.04) 0.0000 (1.0) 0;0 2.3475 (0.96) 1 1 test_list-list-shallow[3.10.0] 424.2463 (1.04) 424.2463 (1.04) 424.2463 (1.04) 0.0000 (1.0) 424.2463 (1.04) 0.0000 (1.0) 0;0 2.3571 (0.96) 1 1 test_list-list-shallow[3.53.2] 409.0494 (1.0) 409.0494 (1.0) 409.0494 (1.0) 0.0000 (1.0) 409.0494 (1.0) 0.0000 (1.0) 0;0 2.4447 (1.0) 1 1 test_list-list-shallow[main] 424.5488 (1.04) 424.5488 (1.04) 424.5488 (1.04) 0.0000 (1.0) 424.5488 (1.04) 0.0000 (1.0) 0;0 2.3554 (0.96) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add[2.58.2] 2.2376 (1.45) 2.2376 (1.45) 2.2376 (1.45) 0.0000 (1.0) 2.2376 (1.45) 0.0000 (1.0) 0;0 0.4469 (0.69) 1 1 test_partial_add-add[3.10.0] 2.2646 (1.46) 2.2646 (1.46) 2.2646 (1.46) 0.0000 (1.0) 2.2646 (1.46) 0.0000 (1.0) 0;0 0.4416 (0.68) 1 1 test_partial_add-add[3.53.2] 2.0245 (1.31) 2.0245 (1.31) 2.0245 (1.31) 0.0000 (1.0) 2.0245 (1.31) 0.0000 (1.0) 0;0 0.4939 (0.76) 1 1 test_partial_add-add[main] 1.5480 (1.0) 1.5480 (1.0) 1.5480 (1.0) 0.0000 (1.0) 1.5480 (1.0) 0.0000 (1.0) 0;0 0.6460 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial[2.58.2] 3.1133 (2.64) 3.1133 (2.64) 3.1133 (2.64) 0.0000 (1.0) 3.1133 (2.64) 0.0000 (1.0) 0;0 0.3212 (0.38) 1 1 test_partial_add-add-partial[3.10.0] 2.9769 (2.53) 2.9769 (2.53) 2.9769 (2.53) 0.0000 (1.0) 2.9769 (2.53) 0.0000 (1.0) 0;0 0.3359 (0.40) 1 1 test_partial_add-add-partial[3.53.2] 2.7134 (2.30) 2.7134 (2.30) 2.7134 (2.30) 0.0000 (1.0) 2.7134 (2.30) 0.0000 (1.0) 0;0 0.3685 (0.43) 1 1 test_partial_add-add-partial[main] 1.1774 (1.0) 1.1774 (1.0) 1.1774 (1.0) 0.0000 (1.0) 1.1774 (1.0) 0.0000 (1.0) 0;0 0.8494 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.58.2] 596.6441 (1.0) 596.6441 (1.0) 596.6441 (1.0) 0.0000 (1.0) 596.6441 (1.0) 0.0000 (1.0) 0;0 1.6760 (1.0) 1 1 test_partial_add-gc-cloud-noop[3.10.0] 635.4951 (1.07) 635.4951 (1.07) 635.4951 (1.07) 0.0000 (1.0) 635.4951 (1.07) 0.0000 (1.0) 0;0 1.5736 (0.94) 1 1 test_partial_add-gc-cloud-noop[3.53.2] 686.5895 (1.15) 686.5895 (1.15) 686.5895 (1.15) 0.0000 (1.0) 686.5895 (1.15) 0.0000 (1.0) 0;0 1.4565 (0.87) 1 1 test_partial_add-gc-cloud-noop[main] 649.0393 (1.09) 649.0393 (1.09) 649.0393 (1.09) 0.0000 (1.0) 649.0393 (1.09) 0.0000 (1.0) 0;0 1.5407 (0.92) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.58.2] 510.1520 (1.0) 510.1520 (1.0) 510.1520 (1.0) 0.0000 (1.0) 510.1520 (1.0) 0.0000 (1.0) 0;0 1.9602 (1.0) 1 1 test_partial_add-gc-noop[3.10.0] 565.3135 (1.11) 565.3135 (1.11) 565.3135 (1.11) 0.0000 (1.0) 565.3135 (1.11) 0.0000 (1.0) 0;0 1.7689 (0.90) 1 1 test_partial_add-gc-noop[3.53.2] 553.5700 (1.09) 553.5700 (1.09) 553.5700 (1.09) 0.0000 (1.0) 553.5700 (1.09) 0.0000 (1.0) 0;0 1.8065 (0.92) 1 1 test_partial_add-gc-noop[main] 564.7871 (1.11) 564.7871 (1.11) 564.7871 (1.11) 0.0000 (1.0) 564.7871 (1.11) 0.0000 (1.0) 0;0 1.7706 (0.90) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push[2.58.2] 1.9994 (1.83) 1.9994 (1.83) 1.9994 (1.83) 0.0000 (1.0) 1.9994 (1.83) 0.0000 (1.0) 0;0 0.5001 (0.55) 1 1 test_partial_add-push[3.10.0] 1.1941 (1.09) 1.1941 (1.09) 1.1941 (1.09) 0.0000 (1.0) 1.1941 (1.09) 0.0000 (1.0) 0;0 0.8375 (0.92) 1 1 test_partial_add-push[3.53.2] 1.2000 (1.10) 1.2000 (1.10) 1.2000 (1.10) 0.0000 (1.0) 1.2000 (1.10) 0.0000 (1.0) 0;0 0.8334 (0.91) 1 1 test_partial_add-push[main] 1.0946 (1.0) 1.0946 (1.0) 1.0946 (1.0) 0.0000 (1.0) 1.0946 (1.0) 0.0000 (1.0) 0;0 0.9136 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial[2.58.2] 2.0386 (1.69) 2.0386 (1.69) 2.0386 (1.69) 0.0000 (1.0) 2.0386 (1.69) 0.0000 (1.0) 0;0 0.4905 (0.59) 1 1 test_partial_add-push-partial[3.10.0] 1.2500 (1.03) 1.2500 (1.03) 1.2500 (1.03) 0.0000 (1.0) 1.2500 (1.03) 0.0000 (1.0) 0;0 0.8000 (0.97) 1 1 test_partial_add-push-partial[3.53.2] 1.2086 (1.0) 1.2086 (1.0) 1.2086 (1.0) 0.0000 (1.0) 1.2086 (1.0) 0.0000 (1.0) 0;0 0.8274 (1.0) 1 1 test_partial_add-push-partial[main] 1.2146 (1.00) 1.2146 (1.00) 1.2146 (1.00) 0.0000 (1.0) 1.2146 (1.00) 0.0000 (1.0) 0;0 0.8233 (1.00) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.58.2] 3.8997 (1.90) 3.8997 (1.90) 3.8997 (1.90) 0.0000 (1.0) 3.8997 (1.90) 0.0000 (1.0) 0;0 0.2564 (0.53) 1 1 test_partial_remove-add[3.10.0] 3.8450 (1.88) 3.8450 (1.88) 3.8450 (1.88) 0.0000 (1.0) 3.8450 (1.88) 0.0000 (1.0) 0;0 0.2601 (0.53) 1 1 test_partial_remove-add[3.53.2] 3.4932 (1.70) 3.4932 (1.70) 3.4932 (1.70) 0.0000 (1.0) 3.4932 (1.70) 0.0000 (1.0) 0;0 0.2863 (0.59) 1 1 test_partial_remove-add[main] 2.0506 (1.0) 2.0506 (1.0) 2.0506 (1.0) 0.0000 (1.0) 2.0506 (1.0) 0.0000 (1.0) 0;0 0.4877 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add-update[2.58.2] 1.5926 (2.46) 1.5926 (2.46) 1.5926 (2.46) 0.0000 (1.0) 1.5926 (2.46) 0.0000 (1.0) 0;0 0.6279 (0.41) 1 1 test_partial_remove-add-update[3.10.0] 1.5437 (2.39) 1.5437 (2.39) 1.5437 (2.39) 0.0000 (1.0) 1.5437 (2.39) 0.0000 (1.0) 0;0 0.6478 (0.42) 1 1 test_partial_remove-add-update[3.53.2] 1.3938 (2.15) 1.3938 (2.15) 1.3938 (2.15) 0.0000 (1.0) 1.3938 (2.15) 0.0000 (1.0) 0;0 0.7175 (0.46) 1 1 test_partial_remove-add-update[main] 0.6470 (1.0) 0.6470 (1.0) 0.6470 (1.0) 0.0000 (1.0) 0.6470 (1.0) 0.0000 (1.0) 0;0 1.5456 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.58.2] 541.3563 (1.0) 541.3563 (1.0) 541.3563 (1.0) 0.0000 (1.0) 541.3563 (1.0) 0.0000 (1.0) 0;0 1.8472 (1.0) 1 1 test_partial_remove-gc[3.10.0] 578.0929 (1.07) 578.0929 (1.07) 578.0929 (1.07) 0.0000 (1.0) 578.0929 (1.07) 0.0000 (1.0) 0;0 1.7298 (0.94) 1 1 test_partial_remove-gc[3.53.2] 552.2219 (1.02) 552.2219 (1.02) 552.2219 (1.02) 0.0000 (1.0) 552.2219 (1.02) 0.0000 (1.0) 0;0 1.8109 (0.98) 1 1 test_partial_remove-gc[main] 557.0993 (1.03) 557.0993 (1.03) 557.0993 (1.03) 0.0000 (1.0) 557.0993 (1.03) 0.0000 (1.0) 0;0 1.7950 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.58.2] 619.4333 (1.0) 619.4333 (1.0) 619.4333 (1.0) 0.0000 (1.0) 619.4333 (1.0) 0.0000 (1.0) 0;0 1.6144 (1.0) 1 1 test_partial_remove-gc-cloud[3.10.0] 629.0809 (1.02) 629.0809 (1.02) 629.0809 (1.02) 0.0000 (1.0) 629.0809 (1.02) 0.0000 (1.0) 0;0 1.5896 (0.98) 1 1 test_partial_remove-gc-cloud[3.53.2] 843.4776 (1.36) 843.4776 (1.36) 843.4776 (1.36) 0.0000 (1.0) 843.4776 (1.36) 0.0000 (1.0) 0;0 1.1856 (0.73) 1 1 test_partial_remove-gc-cloud[main] 668.3749 (1.08) 668.3749 (1.08) 668.3749 (1.08) 0.0000 (1.0) 668.3749 (1.08) 0.0000 (1.0) 0;0 1.4962 (0.93) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.58.2] 3.4996 (2.33) 3.4996 (2.33) 3.4996 (2.33) 0.0000 (1.0) 3.4996 (2.33) 0.0000 (1.0) 0;0 0.2857 (0.43) 1 1 test_partial_remove-push[3.10.0] 1.9373 (1.29) 1.9373 (1.29) 1.9373 (1.29) 0.0000 (1.0) 1.9373 (1.29) 0.0000 (1.0) 0;0 0.5162 (0.77) 1 1 test_partial_remove-push[3.53.2] 1.4990 (1.0) 1.4990 (1.0) 1.4990 (1.0) 0.0000 (1.0) 1.4990 (1.0) 0.0000 (1.0) 0;0 0.6671 (1.0) 1 1 test_partial_remove-push[main] 1.5608 (1.04) 1.5608 (1.04) 1.5608 (1.04) 0.0000 (1.0) 1.5608 (1.04) 0.0000 (1.0) 0;0 0.6407 (0.96) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push-update[2.58.2] 572.6821 (1.03) 572.6821 (1.03) 572.6821 (1.03) 0.0000 (1.0) 572.6821 (1.03) 0.0000 (1.0) 0;0 1.7462 (0.97) 1 1 test_partial_remove-push-update[3.10.0] 554.1542 (1.0) 554.1542 (1.0) 554.1542 (1.0) 0.0000 (1.0) 554.1542 (1.0) 0.0000 (1.0) 0;0 1.8046 (1.0) 1 1 test_partial_remove-push-update[3.53.2] 848.3050 (1.53) 848.3050 (1.53) 848.3050 (1.53) 0.0000 (1.0) 848.3050 (1.53) 0.0000 (1.0) 0;0 1.1788 (0.65) 1 1 test_partial_remove-push-update[main] 851.7411 (1.54) 851.7411 (1.54) 851.7411 (1.54) 0.0000 (1.0) 851.7411 (1.54) 0.0000 (1.0) 0;0 1.1741 (0.65) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_plots-plots-diff[2.58.2] 458.6635 (1.0) 471.9984 (1.0) 466.1369 (1.0) 5.5843 (1.52) 464.7561 (1.0) 8.9606 (1.36) 2;0 2.1453 (1.0) 5 3 test_plots-plots-diff[3.10.0] 831.7676 (1.81) 848.2575 (1.80) 839.2960 (1.80) 6.7422 (1.83) 838.8544 (1.80) 11.1707 (1.70) 2;0 1.1915 (0.56) 5 3 test_plots-plots-diff[3.53.2] 793.1083 (1.73) 801.2892 (1.70) 797.7257 (1.71) 3.6753 (1.0) 799.0336 (1.72) 6.5789 (1.0) 1;0 1.2536 (0.58) 5 3 test_plots-plots-diff[main] 801.8990 (1.75) 826.3179 (1.75) 814.9411 (1.75) 11.8865 (3.23) 821.8332 (1.77) 21.2714 (3.23) 2;0 1.2271 (0.57) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.58.2] 479.1169 (1.0) 501.4360 (1.0) 489.1998 (1.0) 8.1479 (1.18) 489.6294 (1.0) 9.0403 (1.0) 2;0 2.0442 (1.0) 5 3 test_plots-plots-diff-json[3.10.0] 1,067.4054 (2.23) 1,102.5902 (2.20) 1,076.6192 (2.20) 14.7272 (2.13) 1,071.2623 (2.19) 12.8334 (1.42) 1;1 0.9288 (0.45) 5 3 test_plots-plots-diff-json[3.53.2] 866.5836 (1.81) 891.8833 (1.78) 878.6159 (1.80) 10.2401 (1.48) 880.2822 (1.80) 16.4790 (1.82) 2;0 1.1382 (0.56) 5 3 test_plots-plots-diff-json[main] 864.6431 (1.80) 880.9663 (1.76) 870.4088 (1.78) 6.9042 (1.0) 867.5881 (1.77) 10.4510 (1.16) 1;0 1.1489 (0.56) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show[2.58.2] 422.6607 (1.0) 435.6962 (1.0) 427.5891 (1.0) 4.8479 (1.37) 426.2093 (1.0) 3.9868 (1.0) 2;1 2.3387 (1.0) 5 3 test_plots-plots-show[3.10.0] 680.2377 (1.61) 692.4030 (1.59) 684.0037 (1.60) 5.2563 (1.48) 680.7885 (1.60) 7.0720 (1.77) 1;0 1.4620 (0.63) 5 3 test_plots-plots-show[3.53.2] 663.1320 (1.57) 681.6944 (1.56) 669.9623 (1.57) 7.3099 (2.06) 669.1609 (1.57) 9.4307 (2.37) 1;0 1.4926 (0.64) 5 3 test_plots-plots-show[main] 661.6868 (1.57) 669.8732 (1.54) 665.3553 (1.56) 3.5504 (1.0) 663.7252 (1.56) 5.9568 (1.49) 2;0 1.5030 (0.64) 5 3 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.58.2] 447.3923 (1.0) 465.4254 (1.0) 453.6086 (1.0) 6.9339 (10.11) 452.0432 (1.0) 6.4775 (6.92) 1;0 2.2045 (1.0) 5 3 test_plots-plots-show-json[3.10.0] 811.0916 (1.81) 812.8731 (1.75) 811.8872 (1.79) 0.6857 (1.0) 811.6424 (1.80) 0.9362 (1.0) 2;0 1.2317 (0.56) 5 3 test_plots-plots-show-json[3.53.2] 705.8842 (1.58) 719.9557 (1.55) 715.2435 (1.58) 5.4950 (8.01) 716.8608 (1.59) 5.5784 (5.96) 1;0 1.3981 (0.63) 5 3 test_plots-plots-show-json[main] 708.8534 (1.58) 718.7195 (1.54) 714.9454 (1.58) 3.9825 (5.81) 715.8197 (1.58) 5.8668 (6.27) 1;0 1.3987 (0.63) 5 3 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.58.2] 3.6427 (2.43) 3.6427 (2.43) 3.6427 (2.43) 0.0000 (1.0) 3.6427 (2.43) 0.0000 (1.0) 0;0 0.2745 (0.41) 1 1 test_push-push[3.10.0] 2.1556 (1.44) 2.1556 (1.44) 2.1556 (1.44) 0.0000 (1.0) 2.1556 (1.44) 0.0000 (1.0) 0;0 0.4639 (0.70) 1 1 test_push-push[3.53.2] 1.7063 (1.14) 1.7063 (1.14) 1.7063 (1.14) 0.0000 (1.0) 1.7063 (1.14) 0.0000 (1.0) 0;0 0.5861 (0.88) 1 1 test_push-push[main] 1.4991 (1.0) 1.4991 (1.0) 1.4991 (1.0) 0.0000 (1.0) 1.4991 (1.0) 0.0000 (1.0) 0;0 0.6671 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-fetch[2.58.2] 3.8804 (2.71) 3.8804 (2.71) 3.8804 (2.71) 0.0000 (1.0) 3.8804 (2.71) 0.0000 (1.0) 0;0 0.2577 (0.37) 1 1 test_sharing-fetch[3.10.0] 4.1593 (2.91) 4.1593 (2.91) 4.1593 (2.91) 0.0000 (1.0) 4.1593 (2.91) 0.0000 (1.0) 0;0 0.2404 (0.34) 1 1 test_sharing-fetch[3.53.2] 2.1428 (1.50) 2.1428 (1.50) 2.1428 (1.50) 0.0000 (1.0) 2.1428 (1.50) 0.0000 (1.0) 0;0 0.4667 (0.67) 1 1 test_sharing-fetch[main] 1.4307 (1.0) 1.4307 (1.0) 1.4307 (1.0) 0.0000 (1.0) 1.4307 (1.0) 0.0000 (1.0) 0;0 0.6990 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing-fetch-noop[2.58.2] 451.1141 (1.0) 451.1141 (1.0) 451.1141 (1.0) 0.0000 (1.0) 451.1141 (1.0) 0.0000 (1.0) 0;0 2.2167 (1.0) 1 1 test_sharing-fetch-noop[3.10.0] 531.4285 (1.18) 531.4285 (1.18) 531.4285 (1.18) 0.0000 (1.0) 531.4285 (1.18) 0.0000 (1.0) 0;0 1.8817 (0.85) 1 1 test_sharing-fetch-noop[3.53.2] 790.2343 (1.75) 790.2343 (1.75) 790.2343 (1.75) 0.0000 (1.0) 790.2343 (1.75) 0.0000 (1.0) 0;0 1.2654 (0.57) 1 1 test_sharing-fetch-noop[main] 818.7625 (1.81) 818.7625 (1.81) 818.7625 (1.81) 0.0000 (1.0) 818.7625 (1.81) 0.0000 (1.0) 0;0 1.2214 (0.55) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.58.2] 3.5632 (2.56) 3.5632 (2.56) 3.5632 (2.56) 0.0000 (1.0) 3.5632 (2.56) 0.0000 (1.0) 0;0 0.2806 (0.39) 1 1 test_sharing-push[3.10.0] 2.1315 (1.53) 2.1315 (1.53) 2.1315 (1.53) 0.0000 (1.0) 2.1315 (1.53) 0.0000 (1.0) 0;0 0.4691 (0.65) 1 1 test_sharing-push[3.53.2] 1.5875 (1.14) 1.5875 (1.14) 1.5875 (1.14) 0.0000 (1.0) 1.5875 (1.14) 0.0000 (1.0) 0;0 0.6299 (0.88) 1 1 test_sharing-push[main] 1.3913 (1.0) 1.3913 (1.0) 1.3913 (1.0) 0.0000 (1.0) 1.3913 (1.0) 0.0000 (1.0) 0;0 0.7188 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.58.2] 477.9585 (1.00) 477.9585 (1.00) 477.9585 (1.00) 0.0000 (1.0) 477.9585 (1.00) 0.0000 (1.0) 0;0 2.0922 (1.00) 1 1 test_sharing-push-noop[3.10.0] 477.1990 (1.0) 477.1990 (1.0) 477.1990 (1.0) 0.0000 (1.0) 477.1990 (1.0) 0.0000 (1.0) 0;0 2.0956 (1.0) 1 1 test_sharing-push-noop[3.53.2] 802.2886 (1.68) 802.2886 (1.68) 802.2886 (1.68) 0.0000 (1.0) 802.2886 (1.68) 0.0000 (1.0) 0;0 1.2464 (0.59) 1 1 test_sharing-push-noop[main] 807.6131 (1.69) 807.6131 (1.69) 807.6131 (1.69) 0.0000 (1.0) 807.6131 (1.69) 0.0000 (1.0) 0;0 1.2382 (0.59) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.58.2] 1.5069 (2.16) 1.5069 (2.16) 1.5069 (2.16) 0.0000 (1.0) 1.5069 (2.16) 0.0000 (1.0) 0;0 0.6636 (0.46) 1 1 test_status-status[3.10.0] 1.4342 (2.05) 1.4342 (2.05) 1.4342 (2.05) 0.0000 (1.0) 1.4342 (2.05) 0.0000 (1.0) 0;0 0.6972 (0.49) 1 1 test_status-status[3.53.2] 1.2724 (1.82) 1.2724 (1.82) 1.2724 (1.82) 0.0000 (1.0) 1.2724 (1.82) 0.0000 (1.0) 0;0 0.7859 (0.55) 1 1 test_status-status[main] 0.6984 (1.0) 0.6984 (1.0) 0.6984 (1.0) 0.0000 (1.0) 0.6984 (1.0) 0.0000 (1.0) 0;0 1.4317 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.58.2] 542.7179 (1.19) 542.7179 (1.19) 542.7179 (1.19) 0.0000 (1.0) 542.7179 (1.19) 0.0000 (1.0) 0;0 1.8426 (0.84) 1 1 test_status-status-changed[3.10.0] 555.7520 (1.22) 555.7520 (1.22) 555.7520 (1.22) 0.0000 (1.0) 555.7520 (1.22) 0.0000 (1.0) 0;0 1.7994 (0.82) 1 1 test_status-status-changed[3.53.2] 537.2556 (1.18) 537.2556 (1.18) 537.2556 (1.18) 0.0000 (1.0) 537.2556 (1.18) 0.0000 (1.0) 0;0 1.8613 (0.85) 1 1 test_status-status-changed[main] 456.1933 (1.0) 456.1933 (1.0) 456.1933 (1.0) 0.0000 (1.0) 456.1933 (1.0) 0.0000 (1.0) 0;0 2.1921 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.58.2] 547.6939 (1.21) 547.6939 (1.21) 547.6939 (1.21) 0.0000 (1.0) 547.6939 (1.21) 0.0000 (1.0) 0;0 1.8258 (0.83) 1 1 test_status-status-changed-noop[3.10.0] 552.4762 (1.22) 552.4762 (1.22) 552.4762 (1.22) 0.0000 (1.0) 552.4762 (1.22) 0.0000 (1.0) 0;0 1.8100 (0.82) 1 1 test_status-status-changed-noop[3.53.2] 525.8458 (1.16) 525.8458 (1.16) 525.8458 (1.16) 0.0000 (1.0) 525.8458 (1.16) 0.0000 (1.0) 0;0 1.9017 (0.86) 1 1 test_status-status-changed-noop[main] 452.6759 (1.0) 452.6759 (1.0) 452.6759 (1.0) 0.0000 (1.0) 452.6759 (1.0) 0.0000 (1.0) 0;0 2.2091 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.58.2] 549.9465 (1.20) 549.9465 (1.20) 549.9465 (1.20) 0.0000 (1.0) 549.9465 (1.20) 0.0000 (1.0) 0;0 1.8184 (0.84) 1 1 test_status-status-noop[3.10.0] 550.7337 (1.20) 550.7337 (1.20) 550.7337 (1.20) 0.0000 (1.0) 550.7337 (1.20) 0.0000 (1.0) 0;0 1.8158 (0.84) 1 1 test_status-status-noop[3.53.2] 523.0502 (1.14) 523.0502 (1.14) 523.0502 (1.14) 0.0000 (1.0) 523.0502 (1.14) 0.0000 (1.0) 0;0 1.9119 (0.88) 1 1 test_status-status-noop[main] 459.9459 (1.0) 459.9459 (1.0) 459.9459 (1.0) 0.0000 (1.0) 459.9459 (1.0) 0.0000 (1.0) 0;0 2.1742 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-import-url[2.58.2] 7.5639 (2.63) 7.5639 (2.63) 7.5639 (2.63) 0.0000 (1.0) 7.5639 (2.63) 0.0000 (1.0) 0;0 0.1322 (0.38) 1 1 test_update-import-url[3.10.0] 7.4620 (2.60) 7.4620 (2.60) 7.4620 (2.60) 0.0000 (1.0) 7.4620 (2.60) 0.0000 (1.0) 0;0 0.1340 (0.38) 1 1 test_update-import-url[3.53.2] 4.7768 (1.66) 4.7768 (1.66) 4.7768 (1.66) 0.0000 (1.0) 4.7768 (1.66) 0.0000 (1.0) 0;0 0.2093 (0.60) 1 1 test_update-import-url[main] 2.8715 (1.0) 2.8715 (1.0) 2.8715 (1.0) 0.0000 (1.0) 2.8715 (1.0) 0.0000 (1.0) 0;0 0.3482 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.58.2] 6.6075 (3.80) 6.6075 (3.80) 6.6075 (3.80) 0.0000 (1.0) 6.6075 (3.80) 0.0000 (1.0) 0;0 0.1513 (0.26) 1 1 test_update-update[3.10.0] 6.5081 (3.74) 6.5081 (3.74) 6.5081 (3.74) 0.0000 (1.0) 6.5081 (3.74) 0.0000 (1.0) 0;0 0.1537 (0.27) 1 1 test_update-update[3.53.2] 4.1713 (2.40) 4.1713 (2.40) 4.1713 (2.40) 0.0000 (1.0) 4.1713 (2.40) 0.0000 (1.0) 0;0 0.2397 (0.42) 1 1 test_update-update[main] 1.7392 (1.0) 1.7392 (1.0) 1.7392 (1.0) 0.0000 (1.0) 1.7392 (1.0) 0.0000 (1.0) 0;0 0.5750 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_update-update-noop[2.58.2] 982.0122 (1.60) 982.0122 (1.60) 982.0122 (1.60) 0.0000 (1.0) 982.0122 (1.60) 0.0000 (1.0) 0;0 1.0183 (0.63) 1 1 test_update-update-noop[3.10.0] 953.7464 (1.55) 953.7464 (1.55) 953.7464 (1.55) 0.0000 (1.0) 953.7464 (1.55) 0.0000 (1.0) 0;0 1.0485 (0.64) 1 1 test_update-update-noop[3.53.2] 916.9425 (1.49) 916.9425 (1.49) 916.9425 (1.49) 0.0000 (1.0) 916.9425 (1.49) 0.0000 (1.0) 0;0 1.0906 (0.67) 1 1 test_update-update-noop[main] 614.3386 (1.0) 614.3386 (1.0) 614.3386 (1.0) 0.0000 (1.0) 614.3386 (1.0) 0.0000 (1.0) 0;0 1.6278 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
3 weeks ago 
github-actions[bot]
commented
3 weeks ago