Closed skshetry closed 3 weeks ago
Wed Aug 21 16:04:38 UTC 2024 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add[2.58.2] 3.8715 (1.70) 3.8715 (1.70) 3.8715 (1.70) 0.0000 (1.0) 3.8715 (1.70) 0.0000 (1.0) 0;0 0.2583 (0.59) 1 1 test_add_copy-add[3.10.0] 3.8402 (1.69) 3.8402 (1.69) 3.8402 (1.69) 0.0000 (1.0) 3.8402 (1.69) 0.0000 (1.0) 0;0 0.2604 (0.59) 1 1 test_add_copy-add[3.53.2] 3.4257 (1.50) 3.4257 (1.50) 3.4257 (1.50) 0.0000 (1.0) 3.4257 (1.50) 0.0000 (1.0) 0;0 0.2919 (0.66) 1 1 test_add_copy-add[main] 2.2779 (1.0) 2.2779 (1.0) 2.2779 (1.0) 0.0000 (1.0) 2.2779 (1.0) 0.0000 (1.0) 0;0 0.4390 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add-noop[2.58.2] 1.5780 (2.07) 1.5780 (2.07) 1.5780 (2.07) 0.0000 (1.0) 1.5780 (2.07) 0.0000 (1.0) 0;0 0.6337 (0.48) 1 1 test_add_copy-add-noop[3.10.0] 1.6108 (2.12) 1.6108 (2.12) 1.6108 (2.12) 0.0000 (1.0) 1.6108 (2.12) 0.0000 (1.0) 0;0 0.6208 (0.47) 1 1 test_add_copy-add-noop[3.53.2] 1.5479 (2.04) 1.5479 (2.04) 1.5479 (2.04) 0.0000 (1.0) 1.5479 (2.04) 0.0000 (1.0) 0;0 0.6460 (0.49) 1 1 test_add_copy-add-noop[main] 0.7606 (1.0) 0.7606 (1.0) 0.7606 (1.0) 0.0000 (1.0) 0.7606 (1.0) 0.0000 (1.0) 0;0 1.3148 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add[2.58.2] 3.2468 (1.33) 3.2468 (1.33) 3.2468 (1.33) 0.0000 (1.0) 3.2468 (1.33) 0.0000 (1.0) 0;0 0.3080 (0.75) 1 1 test_add_hardlink-add[3.10.0] 3.2036 (1.31) 3.2036 (1.31) 3.2036 (1.31) 0.0000 (1.0) 3.2036 (1.31) 0.0000 (1.0) 0;0 0.3121 (0.76) 1 1 test_add_hardlink-add[3.53.2] 2.8664 (1.18) 2.8664 (1.18) 2.8664 (1.18) 0.0000 (1.0) 2.8664 (1.18) 0.0000 (1.0) 0;0 0.3489 (0.85) 1 1 test_add_hardlink-add[main] 2.4380 (1.0) 2.4380 (1.0) 2.4380 (1.0) 0.0000 (1.0) 2.4380 (1.0) 0.0000 (1.0) 0;0 0.4102 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add-noop[2.58.2] 1.8044 (2.41) 1.8044 (2.41) 1.8044 (2.41) 0.0000 (1.0) 1.8044 (2.41) 0.0000 (1.0) 0;0 0.5542 (0.41) 1 1 test_add_hardlink-add-noop[3.10.0] 1.6879 (2.26) 1.6879 (2.26) 1.6879 (2.26) 0.0000 (1.0) 1.6879 (2.26) 0.0000 (1.0) 0;0 0.5925 (0.44) 1 1 test_add_hardlink-add-noop[3.53.2] 2.0691 (2.77) 2.0691 (2.77) 2.0691 (2.77) 0.0000 (1.0) 2.0691 (2.77) 0.0000 (1.0) 0;0 0.4833 (0.36) 1 1 test_add_hardlink-add-noop[main] 0.7479 (1.0) 0.7479 (1.0) 0.7479 (1.0) 0.0000 (1.0) 0.7479 (1.0) 0.0000 (1.0) 0;0 1.3371 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_symlink-add[2.58.2] 3.1367 (1.31) 3.1367 (1.31) 3.1367 (1.31) 0.0000 (1.0) 3.1367 (1.31) 0.0000 (1.0) 0;0 0.3188 (0.76) 1 1 test_add_symlink-add[3.10.0] 3.1052 (1.29) 3.1052 (1.29) 3.1052 (1.29) 0.0000 (1.0) 3.1052 (1.29) 0.0000 (1.0) 0;0 0.3220 (0.77) 1 1 test_add_symlink-add[3.53.2] 2.8641 (1.19) 2.8641 (1.19) 2.8641 (1.19) 0.0000 (1.0) 2.8641 (1.19) 0.0000 (1.0) 0;0 0.3491 (0.84) 1 1 test_add_symlink-add[main] 2.3992 (1.0) 2.3992 (1.0) 2.3992 (1.0) 0.0000 (1.0) 2.3992 (1.0) 0.0000 (1.0) 0;0 0.4168 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_add_symlink-add-noop[2.58.2] 1.9884 (2.72) 1.9884 (2.72) 1.9884 (2.72) 0.0000 (1.0) 1.9884 (2.72) 0.0000 (1.0) 0;0 0.5029 (0.37) 1 1 test_add_symlink-add-noop[3.10.0] 1.9108 (2.61) 1.9108 (2.61) 1.9108 (2.61) 0.0000 (1.0) 1.9108 (2.61) 0.0000 (1.0) 0;0 0.5233 (0.38) 1 1 test_add_symlink-add-noop[3.53.2] 1.7907 (2.45) 1.7907 (2.45) 1.7907 (2.45) 0.0000 (1.0) 1.7907 (2.45) 0.0000 (1.0) 0;0 0.5584 (0.41) 1 1 test_add_symlink-add-noop[main] 0.7309 (1.0) 0.7309 (1.0) 0.7309 (1.0) 0.0000 (1.0) 0.7309 (1.0) 0.0000 (1.0) 0;0 1.3681 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.58.2] 2.0578 (1.23) 2.0578 (1.23) 2.0578 (1.23) 0.0000 (1.0) 2.0578 (1.23) 0.0000 (1.0) 0;0 0.4860 (0.81) 1 1 test_checkout_copy-checkout[3.10.0] 2.7679 (1.66) 2.7679 (1.66) 2.7679 (1.66) 0.0000 (1.0) 2.7679 (1.66) 0.0000 (1.0) 0;0 0.3613 (0.60) 1 1 test_checkout_copy-checkout[3.53.2] 1.6706 (1.0) 1.6706 (1.0) 1.6706 (1.0) 0.0000 (1.0) 1.6706 (1.0) 0.0000 (1.0) 0;0 0.5986 (1.0) 1 1 test_checkout_copy-checkout[main] 1.9177 (1.15) 1.9177 (1.15) 1.9177 (1.15) 0.0000 (1.0) 1.9177 (1.15) 0.0000 (1.0) 0;0 0.5215 (0.87) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.58.2] 558.2869 (1.12) 558.2869 (1.12) 558.2869 (1.12) 0.0000 (1.0) 558.2869 (1.12) 0.0000 (1.0) 0;0 1.7912 (0.89) 1 1 test_checkout_copy-checkout-noop[3.10.0] 568.8931 (1.14) 568.8931 (1.14) 568.8931 (1.14) 0.0000 (1.0) 568.8931 (1.14) 0.0000 (1.0) 0;0 1.7578 (0.88) 1 1 test_checkout_copy-checkout-noop[3.53.2] 543.0873 (1.09) 543.0873 (1.09) 543.0873 (1.09) 0.0000 (1.0) 543.0873 (1.09) 0.0000 (1.0) 0;0 1.8413 (0.92) 1 1 test_checkout_copy-checkout-noop[main] 499.0982 (1.0) 499.0982 (1.0) 499.0982 (1.0) 0.0000 (1.0) 499.0982 (1.0) 0.0000 (1.0) 0;0 2.0036 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.58.2] 687.3826 (1.28) 687.3826 (1.28) 687.3826 (1.28) 0.0000 (1.0) 687.3826 (1.28) 0.0000 (1.0) 0;0 1.4548 (0.78) 1 1 test_checkout_copy-checkout-update[3.10.0] 677.3254 (1.26) 677.3254 (1.26) 677.3254 (1.26) 0.0000 (1.0) 677.3254 (1.26) 0.0000 (1.0) 0;0 1.4764 (0.79) 1 1 test_checkout_copy-checkout-update[3.53.2] 605.0145 (1.13) 605.0145 (1.13) 605.0145 (1.13) 0.0000 (1.0) 605.0145 (1.13) 0.0000 (1.0) 0;0 1.6529 (0.89) 1 1 test_checkout_copy-checkout-update[main] 536.3554 (1.0) 536.3554 (1.0) 536.3554 (1.0) 0.0000 (1.0) 536.3554 (1.0) 0.0000 (1.0) 0;0 1.8644 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.58.2] 1.3388 (1.17) 1.3388 (1.17) 1.3388 (1.17) 0.0000 (1.0) 1.3388 (1.17) 0.0000 (1.0) 0;0 0.7469 (0.86) 1 1 test_checkout_hardlink-checkout[3.10.0] 1.2759 (1.11) 1.2759 (1.11) 1.2759 (1.11) 0.0000 (1.0) 1.2759 (1.11) 0.0000 (1.0) 0;0 0.7837 (0.90) 1 1 test_checkout_hardlink-checkout[3.53.2] 1.1462 (1.0) 1.1462 (1.0) 1.1462 (1.0) 0.0000 (1.0) 1.1462 (1.0) 0.0000 (1.0) 0;0 0.8724 (1.0) 1 1 test_checkout_hardlink-checkout[main] 1.3551 (1.18) 1.3551 (1.18) 1.3551 (1.18) 0.0000 (1.0) 1.3551 (1.18) 0.0000 (1.0) 0;0 0.7380 (0.85) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.58.2] 550.9521 (1.17) 550.9521 (1.17) 550.9521 (1.17) 0.0000 (1.0) 550.9521 (1.17) 0.0000 (1.0) 0;0 1.8150 (0.85) 1 1 test_checkout_hardlink-checkout-noop[3.10.0] 567.7708 (1.21) 567.7708 (1.21) 567.7708 (1.21) 0.0000 (1.0) 567.7708 (1.21) 0.0000 (1.0) 0;0 1.7613 (0.83) 1 1 test_checkout_hardlink-checkout-noop[3.53.2] 540.0114 (1.15) 540.0114 (1.15) 540.0114 (1.15) 0.0000 (1.0) 540.0114 (1.15) 0.0000 (1.0) 0;0 1.8518 (0.87) 1 1 test_checkout_hardlink-checkout-noop[main] 470.5969 (1.0) 470.5969 (1.0) 470.5969 (1.0) 0.0000 (1.0) 470.5969 (1.0) 0.0000 (1.0) 0;0 2.1250 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.58.2] 688.6426 (1.33) 688.6426 (1.33) 688.6426 (1.33) 0.0000 (1.0) 688.6426 (1.33) 0.0000 (1.0) 0;0 1.4521 (0.75) 1 1 test_checkout_hardlink-checkout-update[3.10.0] 622.0305 (1.20) 622.0305 (1.20) 622.0305 (1.20) 0.0000 (1.0) 622.0305 (1.20) 0.0000 (1.0) 0;0 1.6076 (0.83) 1 1 test_checkout_hardlink-checkout-update[3.53.2] 592.7212 (1.14) 592.7212 (1.14) 592.7212 (1.14) 0.0000 (1.0) 592.7212 (1.14) 0.0000 (1.0) 0;0 1.6871 (0.88) 1 1 test_checkout_hardlink-checkout-update[main] 518.8109 (1.0) 518.8109 (1.0) 518.8109 (1.0) 0.0000 (1.0) 518.8109 (1.0) 0.0000 (1.0) 0;0 1.9275 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.58.2] 1.7127 (1.27) 1.7127 (1.27) 1.7127 (1.27) 0.0000 (1.0) 1.7127 (1.27) 0.0000 (1.0) 0;0 0.5839 (0.79) 1 1 test_checkout_symlink-checkout[3.10.0] 1.5068 (1.11) 1.5068 (1.11) 1.5068 (1.11) 0.0000 (1.0) 1.5068 (1.11) 0.0000 (1.0) 0;0 0.6636 (0.90) 1 1 test_checkout_symlink-checkout[3.53.2] 1.3535 (1.0) 1.3535 (1.0) 1.3535 (1.0) 0.0000 (1.0) 1.3535 (1.0) 0.0000 (1.0) 0;0 0.7388 (1.0) 1 1 test_checkout_symlink-checkout[main] 1.5313 (1.13) 1.5313 (1.13) 1.5313 (1.13) 0.0000 (1.0) 1.5313 (1.13) 0.0000 (1.0) 0;0 0.6530 (0.88) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.58.2] 650.7724 (1.17) 650.7724 (1.17) 650.7724 (1.17) 0.0000 (1.0) 650.7724 (1.17) 0.0000 (1.0) 0;0 1.5366 (0.86) 1 1 test_checkout_symlink-checkout-noop[3.10.0] 665.8835 (1.19) 665.8835 (1.19) 665.8835 (1.19) 0.0000 (1.0) 665.8835 (1.19) 0.0000 (1.0) 0;0 1.5018 (0.84) 1 1 test_checkout_symlink-checkout-noop[3.53.2] 654.0074 (1.17) 654.0074 (1.17) 654.0074 (1.17) 0.0000 (1.0) 654.0074 (1.17) 0.0000 (1.0) 0;0 1.5290 (0.85) 1 1 test_checkout_symlink-checkout-noop[main] 557.2855 (1.0) 557.2855 (1.0) 557.2855 (1.0) 0.0000 (1.0) 557.2855 (1.0) 0.0000 (1.0) 0;0 1.7944 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout-update[2.58.2] 825.1707 (1.27) 825.1707 (1.27) 825.1707 (1.27) 0.0000 (1.0) 825.1707 (1.27) 0.0000 (1.0) 0;0 1.2119 (0.78) 1 1 test_checkout_symlink-checkout-update[3.10.0] 763.4824 (1.18) 763.4824 (1.18) 763.4824 (1.18) 0.0000 (1.0) 763.4824 (1.18) 0.0000 (1.0) 0;0 1.3098 (0.85) 1 1 test_checkout_symlink-checkout-update[3.53.2] 736.3627 (1.14) 736.3627 (1.14) 736.3627 (1.14) 0.0000 (1.0) 736.3627 (1.14) 0.0000 (1.0) 0;0 1.3580 (0.88) 1 1 test_checkout_symlink-checkout-update[main] 647.3058 (1.0) 647.3058 (1.0) 647.3058 (1.0) 0.0000 (1.0) 647.3058 (1.0) 0.0000 (1.0) 0;0 1.5449 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.58.2] 610.4984 (1.20) 610.4984 (1.20) 610.4984 (1.20) 0.0000 (1.0) 610.4984 (1.20) 0.0000 (1.0) 0;0 1.6380 (0.83) 1 1 test_data_status-data-changed[3.10.0] 590.9355 (1.16) 590.9355 (1.16) 590.9355 (1.16) 0.0000 (1.0) 590.9355 (1.16) 0.0000 (1.0) 0;0 1.6922 (0.86) 1 1 test_data_status-data-changed[3.53.2] 574.0337 (1.13) 574.0337 (1.13) 574.0337 (1.13) 0.0000 (1.0) 574.0337 (1.13) 0.0000 (1.0) 0;0 1.7421 (0.88) 1 1 test_data_status-data-changed[main] 507.5058 (1.0) 507.5058 (1.0) 507.5058 (1.0) 0.0000 (1.0) 507.5058 (1.0) 0.0000 (1.0) 0;0 1.9704 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.58.2] 634.4437 (1.27) 634.4437 (1.27) 634.4437 (1.27) 0.0000 (1.0) 634.4437 (1.27) 0.0000 (1.0) 0;0 1.5762 (0.79) 1 1 test_data_status-data-changed-noop[3.10.0] 585.7356 (1.17) 585.7356 (1.17) 585.7356 (1.17) 0.0000 (1.0) 585.7356 (1.17) 0.0000 (1.0) 0;0 1.7073 (0.86) 1 1 test_data_status-data-changed-noop[3.53.2] 574.0678 (1.15) 574.0678 (1.15) 574.0678 (1.15) 0.0000 (1.0) 574.0678 (1.15) 0.0000 (1.0) 0;0 1.7420 (0.87) 1 1 test_data_status-data-changed-noop[main] 501.2901 (1.0) 501.2901 (1.0) 501.2901 (1.0) 0.0000 (1.0) 501.2901 (1.0) 0.0000 (1.0) 0;0 1.9949 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.58.2] 1.5516 (1.65) 1.5516 (1.65) 1.5516 (1.65) 0.0000 (1.0) 1.5516 (1.65) 0.0000 (1.0) 0;0 0.6445 (0.61) 1 1 test_data_status-data-new[3.10.0] 1.5341 (1.63) 1.5341 (1.63) 1.5341 (1.63) 0.0000 (1.0) 1.5341 (1.63) 0.0000 (1.0) 0;0 0.6519 (0.61) 1 1 test_data_status-data-new[3.53.2] 1.4051 (1.49) 1.4051 (1.49) 1.4051 (1.49) 0.0000 (1.0) 1.4051 (1.49) 0.0000 (1.0) 0;0 0.7117 (0.67) 1 1 test_data_status-data-new[main] 0.9405 (1.0) 0.9405 (1.0) 0.9405 (1.0) 0.0000 (1.0) 0.9405 (1.0) 0.0000 (1.0) 0;0 1.0633 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.58.2] 618.1111 (1.24) 618.1111 (1.24) 618.1111 (1.24) 0.0000 (1.0) 618.1111 (1.24) 0.0000 (1.0) 0;0 1.6178 (0.80) 1 1 test_data_status-data-noop[3.10.0] 586.1640 (1.18) 586.1640 (1.18) 586.1640 (1.18) 0.0000 (1.0) 586.1640 (1.18) 0.0000 (1.0) 0;0 1.7060 (0.85) 1 1 test_data_status-data-noop[3.53.2] 565.7821 (1.14) 565.7821 (1.14) 565.7821 (1.14) 0.0000 (1.0) 565.7821 (1.14) 0.0000 (1.0) 0;0 1.7675 (0.88) 1 1 test_data_status-data-noop[main] 497.5390 (1.0) 497.5390 (1.0) 497.5390 (1.0) 0.0000 (1.0) 497.5390 (1.0) 0.0000 (1.0) 0;0 2.0099 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.58.2] 1.0957 (1.11) 1.0957 (1.11) 1.0957 (1.11) 0.0000 (1.0) 1.0957 (1.11) 0.0000 (1.0) 0;0 0.9126 (0.90) 1 1 test_data_status_all_flags-data-changed[3.10.0] 1.1113 (1.12) 1.1113 (1.12) 1.1113 (1.12) 0.0000 (1.0) 1.1113 (1.12) 0.0000 (1.0) 0;0 0.8998 (0.89) 1 1 test_data_status_all_flags-data-changed[3.53.2] 1.0534 (1.06) 1.0534 (1.06) 1.0534 (1.06) 0.0000 (1.0) 1.0534 (1.06) 0.0000 (1.0) 0;0 0.9493 (0.94) 1 1 test_data_status_all_flags-data-changed[main] 0.9897 (1.0) 0.9897 (1.0) 0.9897 (1.0) 0.0000 (1.0) 0.9897 (1.0) 0.0000 (1.0) 0;0 1.0105 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.58.2] 1.1090 (1.12) 1.1090 (1.12) 1.1090 (1.12) 0.0000 (1.0) 1.1090 (1.12) 0.0000 (1.0) 0;0 0.9017 (0.89) 1 1 test_data_status_all_flags-data-changed-noop[3.10.0] 1.0873 (1.10) 1.0873 (1.10) 1.0873 (1.10) 0.0000 (1.0) 1.0873 (1.10) 0.0000 (1.0) 0;0 0.9197 (0.91) 1 1 test_data_status_all_flags-data-changed-noop[3.53.2] 1.0596 (1.07) 1.0596 (1.07) 1.0596 (1.07) 0.0000 (1.0) 1.0596 (1.07) 0.0000 (1.0) 0;0 0.9438 (0.93) 1 1 test_data_status_all_flags-data-changed-noop[main] 0.9884 (1.0) 0.9884 (1.0) 0.9884 (1.0) 0.0000 (1.0) 0.9884 (1.0) 0.0000 (1.0) 0;0 1.0118 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.58.2] 1.9643 (1.32) 1.9643 (1.32) 1.9643 (1.32) 0.0000 (1.0) 1.9643 (1.32) 0.0000 (1.0) 0;0 0.5091 (0.76) 1 1 test_data_status_all_flags-data-new[3.10.0] 1.9945 (1.34) 1.9945 (1.34) 1.9945 (1.34) 0.0000 (1.0) 1.9945 (1.34) 0.0000 (1.0) 0;0 0.5014 (0.74) 1 1 test_data_status_all_flags-data-new[3.53.2] 1.8907 (1.27) 1.8907 (1.27) 1.8907 (1.27) 0.0000 (1.0) 1.8907 (1.27) 0.0000 (1.0) 0;0 0.5289 (0.78) 1 1 test_data_status_all_flags-data-new[main] 1.4842 (1.0) 1.4842 (1.0) 1.4842 (1.0) 0.0000 (1.0) 1.4842 (1.0) 0.0000 (1.0) 0;0 0.6738 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.58.2] 1.0910 (1.12) 1.0910 (1.12) 1.0910 (1.12) 0.0000 (1.0) 1.0910 (1.12) 0.0000 (1.0) 0;0 0.9166 (0.90) 1 1 test_data_status_all_flags-data-noop[3.10.0] 1.0594 (1.08) 1.0594 (1.08) 1.0594 (1.08) 0.0000 (1.0) 1.0594 (1.08) 0.0000 (1.0) 0;0 0.9439 (0.92) 1 1 test_data_status_all_flags-data-noop[3.53.2] 1.0353 (1.06) 1.0353 (1.06) 1.0353 (1.06) 0.0000 (1.0) 1.0353 (1.06) 0.0000 (1.0) 0;0 0.9659 (0.94) 1 1 test_data_status_all_flags-data-noop[main] 0.9780 (1.0) 0.9780 (1.0) 0.9780 (1.0) 0.0000 (1.0) 0.9780 (1.0) 0.0000 (1.0) 0;0 1.0225 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.58.2] 1.4170 (1.29) 1.4170 (1.29) 1.4170 (1.29) 0.0000 (1.0) 1.4170 (1.29) 0.0000 (1.0) 0;0 0.7057 (0.77) 1 1 test_diff-diff[3.10.0] 1.5151 (1.38) 1.5151 (1.38) 1.5151 (1.38) 0.0000 (1.0) 1.5151 (1.38) 0.0000 (1.0) 0;0 0.6600 (0.72) 1 1 test_diff-diff[3.53.2] 1.3835 (1.26) 1.3835 (1.26) 1.3835 (1.26) 0.0000 (1.0) 1.3835 (1.26) 0.0000 (1.0) 0;0 0.7228 (0.79) 1 1 test_diff-diff[main] 1.0944 (1.0) 1.0944 (1.0) 1.0944 (1.0) 0.0000 (1.0) 1.0944 (1.0) 0.0000 (1.0) 0;0 0.9138 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.58.2] 657.3548 (1.20) 657.3548 (1.20) 657.3548 (1.20) 0.0000 (1.0) 657.3548 (1.20) 0.0000 (1.0) 0;0 1.5212 (0.83) 1 1 test_diff-diff-changed[3.10.0] 675.3383 (1.24) 675.3383 (1.24) 675.3383 (1.24) 0.0000 (1.0) 675.3383 (1.24) 0.0000 (1.0) 0;0 1.4807 (0.81) 1 1 test_diff-diff-changed[3.53.2] 617.1700 (1.13) 617.1700 (1.13) 617.1700 (1.13) 0.0000 (1.0) 617.1700 (1.13) 0.0000 (1.0) 0;0 1.6203 (0.89) 1 1 test_diff-diff-changed[main] 546.4765 (1.0) 546.4765 (1.0) 546.4765 (1.0) 0.0000 (1.0) 546.4765 (1.0) 0.0000 (1.0) 0;0 1.8299 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.58.2] 636.5858 (1.17) 636.5858 (1.17) 636.5858 (1.17) 0.0000 (1.0) 636.5858 (1.17) 0.0000 (1.0) 0;0 1.5709 (0.86) 1 1 test_diff-diff-changed-noop[3.10.0] 639.0026 (1.17) 639.0026 (1.17) 639.0026 (1.17) 0.0000 (1.0) 639.0026 (1.17) 0.0000 (1.0) 0;0 1.5649 (0.85) 1 1 test_diff-diff-changed-noop[3.53.2] 615.9817 (1.13) 615.9817 (1.13) 615.9817 (1.13) 0.0000 (1.0) 615.9817 (1.13) 0.0000 (1.0) 0;0 1.6234 (0.89) 1 1 test_diff-diff-changed-noop[main] 546.3346 (1.0) 546.3346 (1.0) 546.3346 (1.0) 0.0000 (1.0) 546.3346 (1.0) 0.0000 (1.0) 0;0 1.8304 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.58.2] 604.3639 (1.11) 604.3639 (1.11) 604.3639 (1.11) 0.0000 (1.0) 604.3639 (1.11) 0.0000 (1.0) 0;0 1.6546 (0.90) 1 1 test_diff-diff-noop[3.10.0] 604.1742 (1.11) 604.1742 (1.11) 604.1742 (1.11) 0.0000 (1.0) 604.1742 (1.11) 0.0000 (1.0) 0;0 1.6552 (0.90) 1 1 test_diff-diff-noop[3.53.2] 614.7953 (1.13) 614.7953 (1.13) 614.7953 (1.13) 0.0000 (1.0) 614.7953 (1.13) 0.0000 (1.0) 0;0 1.6266 (0.88) 1 1 test_diff-diff-noop[main] 542.0926 (1.0) 542.0926 (1.0) 542.0926 (1.0) 0.0000 (1.0) 542.0926 (1.0) 0.0000 (1.0) 0;0 1.8447 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.58.2] 1.1622 (1.0) 1.1622 (1.0) 1.1622 (1.0) 0.0000 (1.0) 1.1622 (1.0) 0.0000 (1.0) 0;0 0.8604 (1.0) 1 1 test_exp_show-exp[3.10.0] 16.2586 (13.99) 16.2586 (13.99) 16.2586 (13.99) 0.0000 (1.0) 16.2586 (13.99) 0.0000 (1.0) 0;0 0.0615 (0.07) 1 1 test_exp_show-exp[3.53.2] 10.7743 (9.27) 10.7743 (9.27) 10.7743 (9.27) 0.0000 (1.0) 10.7743 (9.27) 0.0000 (1.0) 0;0 0.0928 (0.11) 1 1 test_exp_show-exp[main] 13.2720 (11.42) 13.2720 (11.42) 13.2720 (11.42) 0.0000 (1.0) 13.2720 (11.42) 0.0000 (1.0) 0;0 0.0753 (0.09) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_fetch-fetch[2.58.2] 2.7010 (1.42) 2.7010 (1.42) 2.7010 (1.42) 0.0000 (1.0) 2.7010 (1.42) 0.0000 (1.0) 0;0 0.3702 (0.70) 1 1 test_fetch-fetch[3.10.0] 3.1044 (1.64) 3.1044 (1.64) 3.1044 (1.64) 0.0000 (1.0) 3.1044 (1.64) 0.0000 (1.0) 0;0 0.3221 (0.61) 1 1 test_fetch-fetch[3.53.2] 1.8967 (1.0) 1.8967 (1.0) 1.8967 (1.0) 0.0000 (1.0) 1.8967 (1.0) 0.0000 (1.0) 0;0 0.5272 (1.0) 1 1 test_fetch-fetch[main] 2.4989 (1.32) 2.4989 (1.32) 2.4989 (1.32) 0.0000 (1.0) 2.4989 (1.32) 0.0000 (1.0) 0;0 0.4002 (0.76) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.58.2] 603.5242 (1.01) 603.5242 (1.01) 603.5242 (1.01) 0.0000 (1.0) 603.5242 (1.01) 0.0000 (1.0) 0;0 1.6569 (0.99) 1 1 test_gc-gc[3.10.0] 723.9535 (1.21) 723.9535 (1.21) 723.9535 (1.21) 0.0000 (1.0) 723.9535 (1.21) 0.0000 (1.0) 0;0 1.3813 (0.83) 1 1 test_gc-gc[3.53.2] 625.5917 (1.04) 625.5917 (1.04) 625.5917 (1.04) 0.0000 (1.0) 625.5917 (1.04) 0.0000 (1.0) 0;0 1.5985 (0.96) 1 1 test_gc-gc[main] 599.7859 (1.0) 599.7859 (1.0) 599.7859 (1.0) 0.0000 (1.0) 599.7859 (1.0) 0.0000 (1.0) 0;0 1.6673 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.58.2] 4.2040 (1.0) 4.2040 (1.0) 4.2040 (1.0) 0.0000 (1.0) 4.2040 (1.0) 0.0000 (1.0) 0;0 0.2379 (1.0) 1 1 test_get-get[3.10.0] 5.0657 (1.20) 5.0657 (1.20) 5.0657 (1.20) 0.0000 (1.0) 5.0657 (1.20) 0.0000 (1.0) 0;0 0.1974 (0.83) 1 1 test_get-get[3.53.2] 4.6550 (1.11) 4.6550 (1.11) 4.6550 (1.11) 0.0000 (1.0) 4.6550 (1.11) 0.0000 (1.0) 0;0 0.2148 (0.90) 1 1 test_get-get[main] 4.4450 (1.06) 4.4450 (1.06) 4.4450 (1.06) 0.0000 (1.0) 4.4450 (1.06) 0.0000 (1.0) 0;0 0.2250 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.58.2] 1.9267 (1.81) 1.9267 (1.81) 1.9267 (1.81) 0.0000 (1.0) 1.9267 (1.81) 0.0000 (1.0) 0;0 0.5190 (0.55) 1 1 test_get_url-get-url[3.10.0] 2.1548 (2.02) 2.1548 (2.02) 2.1548 (2.02) 0.0000 (1.0) 2.1548 (2.02) 0.0000 (1.0) 0;0 0.4641 (0.50) 1 1 test_get_url-get-url[3.53.2] 1.0948 (1.03) 1.0948 (1.03) 1.0948 (1.03) 0.0000 (1.0) 1.0948 (1.03) 0.0000 (1.0) 0;0 0.9134 (0.97) 1 1 test_get_url-get-url[main] 1.0670 (1.0) 1.0670 (1.0) 1.0670 (1.0) 0.0000 (1.0) 1.0670 (1.0) 0.0000 (1.0) 0;0 0.9372 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.58.2] 121.8665 (1.01) 138.9569 (1.06) 123.8532 (1.01) 1.7750 (1.33) 123.5834 (1.01) 0.9403 (1.0) 4;5 8.0741 (0.99) 100 1 test_help---help[3.10.0] 120.1641 (1.0) 134.6194 (1.03) 123.2168 (1.0) 2.1078 (1.58) 122.9167 (1.0) 1.4125 (1.50) 15;7 8.1158 (1.0) 100 1 test_help---help[3.53.2] 122.0964 (1.02) 131.2205 (1.0) 123.6727 (1.00) 1.3319 (1.0) 123.3556 (1.00) 1.2786 (1.36) 16;4 8.0859 (1.00) 100 1 test_help---help[main] 121.9603 (1.01) 133.3612 (1.02) 123.6437 (1.00) 1.4574 (1.09) 123.3622 (1.00) 1.1987 (1.27) 9;7 8.0878 (1.00) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_import-import': 3 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.58.2] 7.5503 (1.02) 7.5503 (1.02) 7.5503 (1.02) 0.0000 (1.0) 7.5503 (1.02) 0.0000 (1.0) 0;0 0.1324 (0.98) 1 1 test_import-import[3.10.0] 8.4561 (1.14) 8.4561 (1.14) 8.4561 (1.14) 0.0000 (1.0) 8.4561 (1.14) 0.0000 (1.0) 0;0 0.1183 (0.87) 1 1 test_import-import[main] 7.3864 (1.0) 7.3864 (1.0) 7.3864 (1.0) 0.0000 (1.0) 7.3864 (1.0) 0.0000 (1.0) 0;0 0.1354 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.58.2] 6.1687 (2.12) 6.1687 (2.12) 6.1687 (2.12) 0.0000 (1.0) 6.1687 (2.12) 0.0000 (1.0) 0;0 0.1621 (0.47) 1 1 test_import_url-import-url[3.10.0] 6.1140 (2.10) 6.1140 (2.10) 6.1140 (2.10) 0.0000 (1.0) 6.1140 (2.10) 0.0000 (1.0) 0;0 0.1636 (0.48) 1 1 test_import_url-import-url[3.53.2] 5.0981 (1.75) 5.0981 (1.75) 5.0981 (1.75) 0.0000 (1.0) 5.0981 (1.75) 0.0000 (1.0) 0;0 0.1961 (0.57) 1 1 test_import_url-import-url[main] 2.9067 (1.0) 2.9067 (1.0) 2.9067 (1.0) 0.0000 (1.0) 2.9067 (1.0) 0.0000 (1.0) 0;0 0.3440 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.58.2] 398.2512 (1.0) 430.1719 (1.0) 411.1662 (1.0) 6.4474 (1.0) 410.9109 (1.00) 9.5979 (1.16) 34;1 2.4321 (1.0) 100 1 test_init-init[3.10.0] 413.1495 (1.04) 456.0790 (1.06) 427.8071 (1.04) 7.4567 (1.16) 427.1589 (1.04) 9.0812 (1.10) 26;2 2.3375 (0.96) 100 1 test_init-init[3.53.2] 401.5194 (1.01) 454.0605 (1.06) 416.4372 (1.01) 8.0765 (1.25) 416.4898 (1.02) 9.1357 (1.10) 34;2 2.4013 (0.99) 100 1 test_init-init[main] 400.3613 (1.01) 667.9557 (1.55) 413.8173 (1.01) 27.9079 (4.33) 409.0942 (1.0) 8.2774 (1.0) 2;5 2.4165 (0.99) 100 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.58.2] 585.8632 (1.09) 585.8632 (1.09) 585.8632 (1.09) 0.0000 (1.0) 585.8632 (1.09) 0.0000 (1.0) 0;0 1.7069 (0.92) 1 1 test_list-list[3.10.0] 675.5317 (1.25) 675.5317 (1.25) 675.5317 (1.25) 0.0000 (1.0) 675.5317 (1.25) 0.0000 (1.0) 0;0 1.4803 (0.80) 1 1 test_list-list[3.53.2] 593.5293 (1.10) 593.5293 (1.10) 593.5293 (1.10) 0.0000 (1.0) 593.5293 (1.10) 0.0000 (1.0) 0;0 1.6848 (0.91) 1 1 test_list-list[main] 539.6236 (1.0) 539.6236 (1.0) 539.6236 (1.0) 0.0000 (1.0) 539.6236 (1.0) 0.0000 (1.0) 0;0 1.8531 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.58.2] 424.2531 (1.01) 424.2531 (1.01) 424.2531 (1.01) 0.0000 (1.0) 424.2531 (1.01) 0.0000 (1.0) 0;0 2.3571 (0.99) 1 1 test_list-list-dvc-only[3.10.0] 420.8379 (1.0) 420.8379 (1.0) 420.8379 (1.0) 0.0000 (1.0) 420.8379 (1.0) 0.0000 (1.0) 0;0 2.3762 (1.0) 1 1 test_list-list-dvc-only[3.53.2] 428.6091 (1.02) 428.6091 (1.02) 428.6091 (1.02) 0.0000 (1.0) 428.6091 (1.02) 0.0000 (1.0) 0;0 2.3331 (0.98) 1 1 test_list-list-dvc-only[main] 423.3412 (1.01) 423.3412 (1.01) 423.3412 (1.01) 0.0000 (1.0) 423.3412 (1.01) 0.0000 (1.0) 0;0 2.3622 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.58.2] 511.8982 (1.03) 511.8982 (1.03) 511.8982 (1.03) 0.0000 (1.0) 511.8982 (1.03) 0.0000 (1.0) 0;0 1.9535 (0.97) 1 1 test_list-list-recursive[3.10.0] 502.5386 (1.01) 502.5386 (1.01) 502.5386 (1.01) 0.0000 (1.0) 502.5386 (1.01) 0.0000 (1.0) 0;0 1.9899 (0.99) 1 1 test_list-list-recursive[3.53.2] 497.7063 (1.0) 497.7063 (1.0) 497.7063 (1.0) 0.0000 (1.0) 497.7063 (1.0) 0.0000 (1.0) 0;0 2.0092 (1.0) 1 1 test_list-list-recursive[main] 501.7488 (1.01) 501.7488 (1.01) 501.7488 (1.01) 0.0000 (1.0) 501.7488 (1.01) 0.0000 (1.0) 0;0 1.9930 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.58.2] 427.5415 (1.04) 427.5415 (1.04) 427.5415 (1.04) 0.0000 (1.0) 427.5415 (1.04) 0.0000 (1.0) 0;0 2.3390 (0.96) 1 1 test_list-list-shallow[3.10.0] 425.1027 (1.03) 425.1027 (1.03) 425.1027 (1.03) 0.0000 (1.0) 425.1027 (1.03) 0.0000 (1.0) 0;0 2.3524 (0.97) 1 1 test_list-list-shallow[3.53.2] 411.6987 (1.0) 411.6987 (1.0) 411.6987 (1.0) 0.0000 (1.0) 411.6987 (1.0) 0.0000 (1.0) 0;0 2.4290 (1.0) 1 1 test_list-list-shallow[main] 420.7644 (1.02) 420.7644 (1.02) 420.7644 (1.02) 0.0000 (1.0) 420.7644 (1.02) 0.0000 (1.0) 0;0 2.3766 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add[2.58.2] 2.1677 (1.35) 2.1677 (1.35) 2.1677 (1.35) 0.0000 (1.0) 2.1677 (1.35) 0.0000 (1.0) 0;0 0.4613 (0.74) 1 1 test_partial_add-add[3.10.0] 2.1856 (1.36) 2.1856 (1.36) 2.1856 (1.36) 0.0000 (1.0) 2.1856 (1.36) 0.0000 (1.0) 0;0 0.4575 (0.73) 1 1 test_partial_add-add[3.53.2] 1.9316 (1.21) 1.9316 (1.21) 1.9316 (1.21) 0.0000 (1.0) 1.9316 (1.21) 0.0000 (1.0) 0;0 0.5177 (0.83) 1 1 test_partial_add-add[main] 1.6014 (1.0) 1.6014 (1.0) 1.6014 (1.0) 0.0000 (1.0) 1.6014 (1.0) 0.0000 (1.0) 0;0 0.6245 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial[2.58.2] 3.2465 (3.01) 3.2465 (3.01) 3.2465 (3.01) 0.0000 (1.0) 3.2465 (3.01) 0.0000 (1.0) 0;0 0.3080 (0.33) 1 1 test_partial_add-add-partial[3.10.0] 2.8957 (2.69) 2.8957 (2.69) 2.8957 (2.69) 0.0000 (1.0) 2.8957 (2.69) 0.0000 (1.0) 0;0 0.3453 (0.37) 1 1 test_partial_add-add-partial[3.53.2] 2.6062 (2.42) 2.6062 (2.42) 2.6062 (2.42) 0.0000 (1.0) 2.6062 (2.42) 0.0000 (1.0) 0;0 0.3837 (0.41) 1 1 test_partial_add-add-partial[main] 1.0769 (1.0) 1.0769 (1.0) 1.0769 (1.0) 0.0000 (1.0) 1.0769 (1.0) 0.0000 (1.0) 0;0 0.9286 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.58.2] 562.3190 (1.0) 562.3190 (1.0) 562.3190 (1.0) 0.0000 (1.0) 562.3190 (1.0) 0.0000 (1.0) 0;0 1.7783 (1.0) 1 1 test_partial_add-gc-cloud-noop[3.10.0] 587.0602 (1.04) 587.0602 (1.04) 587.0602 (1.04) 0.0000 (1.0) 587.0602 (1.04) 0.0000 (1.0) 0;0 1.7034 (0.96) 1 1 test_partial_add-gc-cloud-noop[3.53.2] 611.2044 (1.09) 611.2044 (1.09) 611.2044 (1.09) 0.0000 (1.0) 611.2044 (1.09) 0.0000 (1.0) 0;0 1.6361 (0.92) 1 1 test_partial_add-gc-cloud-noop[main] 607.1998 (1.08) 607.1998 (1.08) 607.1998 (1.08) 0.0000 (1.0) 607.1998 (1.08) 0.0000 (1.0) 0;0 1.6469 (0.93) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.58.2] 490.9386 (1.0) 490.9386 (1.0) 490.9386 (1.0) 0.0000 (1.0) 490.9386 (1.0) 0.0000 (1.0) 0;0 2.0369 (1.0) 1 1 test_partial_add-gc-noop[3.10.0] 532.3040 (1.08) 532.3040 (1.08) 532.3040 (1.08) 0.0000 (1.0) 532.3040 (1.08) 0.0000 (1.0) 0;0 1.8786 (0.92) 1 1 test_partial_add-gc-noop[3.53.2] 525.0962 (1.07) 525.0962 (1.07) 525.0962 (1.07) 0.0000 (1.0) 525.0962 (1.07) 0.0000 (1.0) 0;0 1.9044 (0.93) 1 1 test_partial_add-gc-noop[main] 523.1724 (1.07) 523.1724 (1.07) 523.1724 (1.07) 0.0000 (1.0) 523.1724 (1.07) 0.0000 (1.0) 0;0 1.9114 (0.94) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push[2.58.2] 1.2865 (1.28) 1.2865 (1.28) 1.2865 (1.28) 0.0000 (1.0) 1.2865 (1.28) 0.0000 (1.0) 0;0 0.7773 (0.78) 1 1 test_partial_add-push[3.10.0] 1.1610 (1.15) 1.1610 (1.15) 1.1610 (1.15) 0.0000 (1.0) 1.1610 (1.15) 0.0000 (1.0) 0;0 0.8613 (0.87) 1 1 test_partial_add-push[3.53.2] 1.0343 (1.03) 1.0343 (1.03) 1.0343 (1.03) 0.0000 (1.0) 1.0343 (1.03) 0.0000 (1.0) 0;0 0.9668 (0.97) 1 1 test_partial_add-push[main] 1.0070 (1.0) 1.0070 (1.0) 1.0070 (1.0) 0.0000 (1.0) 1.0070 (1.0) 0.0000 (1.0) 0;0 0.9931 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial[2.58.2] 1.3295 (1.19) 1.3295 (1.19) 1.3295 (1.19) 0.0000 (1.0) 1.3295 (1.19) 0.0000 (1.0) 0;0 0.7522 (0.84) 1 1 test_partial_add-push-partial[3.10.0] 1.1883 (1.06) 1.1883 (1.06) 1.1883 (1.06) 0.0000 (1.0) 1.1883 (1.06) 0.0000 (1.0) 0;0 0.8416 (0.94) 1 1 test_partial_add-push-partial[3.53.2] 1.1302 (1.01) 1.1302 (1.01) 1.1302 (1.01) 0.0000 (1.0) 1.1302 (1.01) 0.0000 (1.0) 0;0 0.8848 (0.99) 1 1 test_partial_add-push-partial[main] 1.1178 (1.0) 1.1178 (1.0) 1.1178 (1.0) 0.0000 (1.0) 1.1178 (1.0) 0.0000 (1.0) 0;0 0.8946 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.58.2] 3.7026 (1.78) 3.7026 (1.78) 3.7026 (1.78) 0.0000 (1.0) 3.7026 (1.78) 0.0000 (1.0) 0;0 0.2701 (0.56) 1 1 test_partial_remove-add[3.10.0] 3.6904 (1.78) 3.6904 (1.78) 3.6904 (1.78) 0.0000 (1.0) 3.6904 (1.78) 0.0000 (1.0) 0;0 0.2710 (0.56) 1 1 test_partial_remove-add[3.53.2] 3.2775 (1.58) 3.2775 (1.58) 3.2775 (1.58) 0.0000 (1.0) 3.2775 (1.58) 0.0000 (1.0) 0;0 0.3051 (0.63) 1 1 test_partial_remove-add[main] 2.0763 (1.0) 2.0763 (1.0) 2.0763 (1.0) 0.0000 (1.0) 2.0763 (1.0) 0.0000 (1.0) 0;0 0.4816 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add-update[2.58.2] 1.5102 (2.49) 1.5102 (2.49) 1.5102 (2.49) 0.0000 (1.0) 1.5102 (2.49) 0.0000 (1.0) 0;0 0.6622 (0.40) 1 1 test_partial_remove-add-update[3.10.0] 1.4537 (2.40) 1.4537 (2.40) 1.4537 (2.40) 0.0000 (1.0) 1.4537 (2.40) 0.0000 (1.0) 0;0 0.6879 (0.42) 1 1 test_partial_remove-add-update[3.53.2] 1.3131 (2.17) 1.3131 (2.17) 1.3131 (2.17) 0.0000 (1.0) 1.3131 (2.17) 0.0000 (1.0) 0;0 0.7615 (0.46) 1 1 test_partial_remove-add-update[main] 0.6058 (1.0) 0.6058 (1.0) 0.6058 (1.0) 0.0000 (1.0) 0.6058 (1.0) 0.0000 (1.0) 0;0 1.6507 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.58.2] 502.7750 (1.0) 502.7750 (1.0) 502.7750 (1.0) 0.0000 (1.0) 502.7750 (1.0) 0.0000 (1.0) 0;0 1.9890 (1.0) 1 1 test_partial_remove-gc[3.10.0] 540.9409 (1.08) 540.9409 (1.08) 540.9409 (1.08) 0.0000 (1.0) 540.9409 (1.08) 0.0000 (1.0) 0;0 1.8486 (0.93) 1 1 test_partial_remove-gc[3.53.2] 516.2129 (1.03) 516.2129 (1.03) 516.2129 (1.03) 0.0000 (1.0) 516.2129 (1.03) 0.0000 (1.0) 0;0 1.9372 (0.97) 1 1 test_partial_remove-gc[main] 518.3878 (1.03) 518.3878 (1.03) 518.3878 (1.03) 0.0000 (1.0) 518.3878 (1.03) 0.0000 (1.0) 0;0 1.9291 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.58.2] 562.7717 (1.0) 562.7717 (1.0) 562.7717 (1.0) 0.0000 (1.0) 562.7717 (1.0) 0.0000 (1.0) 0;0 1.7769 (1.0) 1 1 test_partial_remove-gc-cloud[3.10.0] 603.5341 (1.07) 603.5341 (1.07) 603.5341 (1.07) 0.0000 (1.0) 603.5341 (1.07) 0.0000 (1.0) 0;0 1.6569 (0.93) 1 1 test_partial_remove-gc-cloud[3.53.2] 604.4373 (1.07) 604.4373 (1.07) 604.4373 (1.07) 0.0000 (1.0) 604.4373 (1.07) 0.0000 (1.0) 0;0 1.6544 (0.93) 1 1 test_partial_remove-gc-cloud[main] 627.9913 (1.12) 627.9913 (1.12) 627.9913 (1.12) 0.0000 (1.0) 627.9913 (1.12) 0.0000 (1.0) 0;0 1.5924 (0.90) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.58.2] 2.1537 (1.53) 2.1537 (1.53) 2.1537 (1.53) 0.0000 (1.0) 2.1537 (1.53) 0.0000 (1.0) 0;0 0.4643 (0.65) 1 1 test_partial_remove-push[3.10.0] 1.8764 (1.34) 1.8764 (1.34) 1.8764 (1.34) 0.0000 (1.0) 1.8764 (1.34) 0.0000 (1.0) 0;0 0.5329 (0.75) 1 1 test_partial_remove-push[3.53.2] 1.4395 (1.02) 1.4395 (1.02) 1.4395 (1.02) 0.0000 (1.0) 1.4395 (1.02) 0.0000 (1.0) 0;0 0.6947 (0.98) 1 1 test_partial_remove-push[main] 1.4047 (1.0) 1.4047 (1.0) 1.4047 (1.0) 0.0000 (1.0) 1.4047 (1.0) 0.0000 (1.0) 0;0 0.7119 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push-update[2.58.2] 507.6524 (1.03) 507.6524 (1.03) 507.6524 (1.03) 0.0000 (1.0) 507.6524 (1.03) 0.0000 (1.0) 0;0 1.9699 (0.97) 1 1 test_partial_remove-push-update[3.10.0] 494.2787 (1.0) 494.2787 (1.0) 494.2787 (1.0) 0.0000 (1.0) 494.2787 (1.0) 0.0000 (1.0) 0;0 2.0231 (1.0) 1 1 test_partial_remove-push-update[3.53.2] 779.7295 (1.58) 779.7295 (1.58) 779.7295 (1.58) 0.0000 (1.0) 779.7295 (1.58) 0.0000 (1.0) 0;0 1.2825 (0.63) 1 1 test_partial_remove-push-update[main] 775.1717 (1.57) 775.1717 (1.57) 775.1717 (1.57) 0.0000 (1.0) 775.1717 (1.57) 0.0000 (1.0) 0;0 1.2900 (0.64) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.58.2] 480.9167 (1.0) 484.3545 (1.0) 483.0033 (1.0) 1.3232 (1.0) 482.9871 (1.0) 1.6395 (1.0) 2;0 2.0704 (1.0) 5 3 test_plots-plots-diff[3.10.0] 851.2764 (1.77) 876.5505 (1.81) 863.8094 (1.79) 9.0382 (6.83) 863.2763 (1.79) 9.1269 (5.57) 2;0 1.1577 (0.56) 5 3 test_plots-plots-diff[3.53.2] 795.8485 (1.65) 801.1753 (1.65) 798.4463 (1.65) 2.2791 (1.72) 798.2609 (1.65) 4.0452 (2.47) 2;0 1.2524 (0.60) 5 3 test_plots-plots-diff[main] 802.7818 (1.67) 820.1003 (1.69) 808.1988 (1.67) 7.0722 (5.34) 806.6605 (1.67) 8.3650 (5.10) 1;0 1.2373 (0.60) 5 3 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.58.2] 466.5861 (1.0) 486.1498 (1.0) 471.8526 (1.0) 8.1564 (1.26) 469.5612 (1.0) 7.4903 (1.0) 1;1 2.1193 (1.0) 5 3 test_plots-plots-diff-json[3.10.0] 1,089.6366 (2.34) 1,120.6083 (2.31) 1,105.1749 (2.34) 12.2387 (1.89) 1,109.2585 (2.36) 18.0768 (2.41) 2;0 0.9048 (0.43) 5 3 test_plots-plots-diff-json[3.53.2] 865.2974 (1.85) 878.4825 (1.81) 871.7733 (1.85) 6.4796 (1.0) 871.0146 (1.85) 12.7996 (1.71) 2;0 1.1471 (0.54) 5 3 test_plots-plots-diff-json[main] 873.4684 (1.87) 891.3559 (1.83) 882.9225 (1.87) 6.6049 (1.02) 883.2448 (1.88) 8.3905 (1.12) 2;0 1.1326 (0.53) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_plots-plots-show[2.58.2] 443.9463 (1.0) 452.4627 (1.0) 448.2189 (1.0) 3.0155 (1.07) 448.1528 (1.0) 2.4611 (1.0) 2;0 2.2311 (1.0) 5 3 test_plots-plots-show[3.10.0] 706.6198 (1.59) 714.1806 (1.58) 711.2139 (1.59) 2.8159 (1.0) 711.6200 (1.59) 2.8966 (1.18) 2;0 1.4060 (0.63) 5 3 test_plots-plots-show[3.53.2] 647.7867 (1.46) 666.4081 (1.47) 658.3103 (1.47) 6.7030 (2.38) 658.7375 (1.47) 5.8265 (2.37) 2;0 1.5190 (0.68) 5 3 test_plots-plots-show[main] 648.6427 (1.46) 717.2441 (1.59) 669.9795 (1.49) 27.8833 (9.90) 661.2509 (1.48) 32.0231 (13.01) 1;0 1.4926 (0.67) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.58.2] 454.2586 (1.0) 468.7001 (1.0) 462.3679 (1.0) 5.3392 (1.17) 462.7761 (1.0) 6.4301 (1.43) 2;0 2.1628 (1.0) 5 3 test_plots-plots-show-json[3.10.0] 820.6561 (1.81) 831.6481 (1.77) 828.5764 (1.79) 4.5664 (1.0) 830.8601 (1.80) 4.5020 (1.0) 1;0 1.2069 (0.56) 5 3 test_plots-plots-show-json[3.53.2] 699.2893 (1.54) 713.3962 (1.52) 707.9561 (1.53) 5.4265 (1.19) 708.1427 (1.53) 6.6049 (1.47) 2;0 1.4125 (0.65) 5 3 test_plots-plots-show-json[main] 699.7274 (1.54) 714.8904 (1.53) 709.3555 (1.53) 5.8572 (1.28) 709.7357 (1.53) 6.5673 (1.46) 1;0 1.4097 (0.65) 5 3 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.58.2] 2.4012 (1.58) 2.4012 (1.58) 2.4012 (1.58) 0.0000 (1.0) 2.4012 (1.58) 0.0000 (1.0) 0;0 0.4165 (0.63) 1 1 test_push-push[3.10.0] 2.1041 (1.38) 2.1041 (1.38) 2.1041 (1.38) 0.0000 (1.0) 2.1041 (1.38) 0.0000 (1.0) 0;0 0.4753 (0.72) 1 1 test_push-push[3.53.2] 1.6166 (1.06) 1.6166 (1.06) 1.6166 (1.06) 0.0000 (1.0) 1.6166 (1.06) 0.0000 (1.0) 0;0 0.6186 (0.94) 1 1 test_push-push[main] 1.5199 (1.0) 1.5199 (1.0) 1.5199 (1.0) 0.0000 (1.0) 1.5199 (1.0) 0.0000 (1.0) 0;0 0.6579 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-fetch[2.58.2] 2.6468 (1.80) 2.6468 (1.80) 2.6468 (1.80) 0.0000 (1.0) 2.6468 (1.80) 0.0000 (1.0) 0;0 0.3778 (0.56) 1 1 test_sharing-fetch[3.10.0] 2.9527 (2.01) 2.9527 (2.01) 2.9527 (2.01) 0.0000 (1.0) 2.9527 (2.01) 0.0000 (1.0) 0;0 0.3387 (0.50) 1 1 test_sharing-fetch[3.53.2] 1.8133 (1.23) 1.8133 (1.23) 1.8133 (1.23) 0.0000 (1.0) 1.8133 (1.23) 0.0000 (1.0) 0;0 0.5515 (0.81) 1 1 test_sharing-fetch[main] 1.4700 (1.0) 1.4700 (1.0) 1.4700 (1.0) 0.0000 (1.0) 1.4700 (1.0) 0.0000 (1.0) 0;0 0.6803 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing-fetch-noop[2.58.2] 523.0627 (1.0) 523.0627 (1.0) 523.0627 (1.0) 0.0000 (1.0) 523.0627 (1.0) 0.0000 (1.0) 0;0 1.9118 (1.0) 1 1 test_sharing-fetch-noop[3.10.0] 572.2995 (1.09) 572.2995 (1.09) 572.2995 (1.09) 0.0000 (1.0) 572.2995 (1.09) 0.0000 (1.0) 0;0 1.7473 (0.91) 1 1 test_sharing-fetch-noop[3.53.2] 837.6738 (1.60) 837.6738 (1.60) 837.6738 (1.60) 0.0000 (1.0) 837.6738 (1.60) 0.0000 (1.0) 0;0 1.1938 (0.62) 1 1 test_sharing-fetch-noop[main] 854.4522 (1.63) 854.4522 (1.63) 854.4522 (1.63) 0.0000 (1.0) 854.4522 (1.63) 0.0000 (1.0) 0;0 1.1703 (0.61) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.58.2] 2.3344 (1.47) 2.3344 (1.47) 2.3344 (1.47) 0.0000 (1.0) 2.3344 (1.47) 0.0000 (1.0) 0;0 0.4284 (0.68) 1 1 test_sharing-push[3.10.0] 2.1582 (1.36) 2.1582 (1.36) 2.1582 (1.36) 0.0000 (1.0) 2.1582 (1.36) 0.0000 (1.0) 0;0 0.4634 (0.73) 1 1 test_sharing-push[3.53.2] 1.6473 (1.04) 1.6473 (1.04) 1.6473 (1.04) 0.0000 (1.0) 1.6473 (1.04) 0.0000 (1.0) 0;0 0.6070 (0.96) 1 1 test_sharing-push[main] 1.5836 (1.0) 1.5836 (1.0) 1.5836 (1.0) 0.0000 (1.0) 1.5836 (1.0) 0.0000 (1.0) 0;0 0.6315 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.58.2] 516.1584 (1.01) 516.1584 (1.01) 516.1584 (1.01) 0.0000 (1.0) 516.1584 (1.01) 0.0000 (1.0) 0;0 1.9374 (0.99) 1 1 test_sharing-push-noop[3.10.0] 509.1130 (1.0) 509.1130 (1.0) 509.1130 (1.0) 0.0000 (1.0) 509.1130 (1.0) 0.0000 (1.0) 0;0 1.9642 (1.0) 1 1 test_sharing-push-noop[3.53.2] 873.1684 (1.72) 873.1684 (1.72) 873.1684 (1.72) 0.0000 (1.0) 873.1684 (1.72) 0.0000 (1.0) 0;0 1.1453 (0.58) 1 1 test_sharing-push-noop[main] 832.5043 (1.64) 832.5043 (1.64) 832.5043 (1.64) 0.0000 (1.0) 832.5043 (1.64) 0.0000 (1.0) 0;0 1.2012 (0.61) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.58.2] 1.3764 (1.66) 1.3764 (1.66) 1.3764 (1.66) 0.0000 (1.0) 1.3764 (1.66) 0.0000 (1.0) 0;0 0.7266 (0.60) 1 1 test_status-status[3.10.0] 1.5623 (1.88) 1.5623 (1.88) 1.5623 (1.88) 0.0000 (1.0) 1.5623 (1.88) 0.0000 (1.0) 0;0 0.6401 (0.53) 1 1 test_status-status[3.53.2] 1.8024 (2.17) 1.8024 (2.17) 1.8024 (2.17) 0.0000 (1.0) 1.8024 (2.17) 0.0000 (1.0) 0;0 0.5548 (0.46) 1 1 test_status-status[main] 0.8292 (1.0) 0.8292 (1.0) 0.8292 (1.0) 0.0000 (1.0) 0.8292 (1.0) 0.0000 (1.0) 0;0 1.2060 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.58.2] 551.2537 (1.16) 551.2537 (1.16) 551.2537 (1.16) 0.0000 (1.0) 551.2537 (1.16) 0.0000 (1.0) 0;0 1.8140 (0.86) 1 1 test_status-status-changed[3.10.0] 558.4371 (1.18) 558.4371 (1.18) 558.4371 (1.18) 0.0000 (1.0) 558.4371 (1.18) 0.0000 (1.0) 0;0 1.7907 (0.85) 1 1 test_status-status-changed[3.53.2] 563.4122 (1.19) 563.4122 (1.19) 563.4122 (1.19) 0.0000 (1.0) 563.4122 (1.19) 0.0000 (1.0) 0;0 1.7749 (0.84) 1 1 test_status-status-changed[main] 474.2895 (1.0) 474.2895 (1.0) 474.2895 (1.0) 0.0000 (1.0) 474.2895 (1.0) 0.0000 (1.0) 0;0 2.1084 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.58.2] 550.6274 (1.17) 550.6274 (1.17) 550.6274 (1.17) 0.0000 (1.0) 550.6274 (1.17) 0.0000 (1.0) 0;0 1.8161 (0.85) 1 1 test_status-status-changed-noop[3.10.0] 555.3811 (1.18) 555.3811 (1.18) 555.3811 (1.18) 0.0000 (1.0) 555.3811 (1.18) 0.0000 (1.0) 0;0 1.8006 (0.85) 1 1 test_status-status-changed-noop[3.53.2] 557.7709 (1.18) 557.7709 (1.18) 557.7709 (1.18) 0.0000 (1.0) 557.7709 (1.18) 0.0000 (1.0) 0;0 1.7929 (0.84) 1 1 test_status-status-changed-noop[main] 470.7355 (1.0) 470.7355 (1.0) 470.7355 (1.0) 0.0000 (1.0) 470.7355 (1.0) 0.0000 (1.0) 0;0 2.1243 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.58.2] 559.0202 (1.20) 559.0202 (1.20) 559.0202 (1.20) 0.0000 (1.0) 559.0202 (1.20) 0.0000 (1.0) 0;0 1.7888 (0.83) 1 1 test_status-status-noop[3.10.0] 556.4499 (1.20) 556.4499 (1.20) 556.4499 (1.20) 0.0000 (1.0) 556.4499 (1.20) 0.0000 (1.0) 0;0 1.7971 (0.84) 1 1 test_status-status-noop[3.53.2] 541.2578 (1.16) 541.2578 (1.16) 541.2578 (1.16) 0.0000 (1.0) 541.2578 (1.16) 0.0000 (1.0) 0;0 1.8475 (0.86) 1 1 test_status-status-noop[main] 465.0785 (1.0) 465.0785 (1.0) 465.0785 (1.0) 0.0000 (1.0) 465.0785 (1.0) 0.0000 (1.0) 0;0 2.1502 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-import-url[2.58.2] 6.3346 (2.15) 6.3346 (2.15) 6.3346 (2.15) 0.0000 (1.0) 6.3346 (2.15) 0.0000 (1.0) 0;0 0.1579 (0.46) 1 1 test_update-import-url[3.10.0] 6.1641 (2.09) 6.1641 (2.09) 6.1641 (2.09) 0.0000 (1.0) 6.1641 (2.09) 0.0000 (1.0) 0;0 0.1622 (0.48) 1 1 test_update-import-url[3.53.2] 4.9885 (1.69) 4.9885 (1.69) 4.9885 (1.69) 0.0000 (1.0) 4.9885 (1.69) 0.0000 (1.0) 0;0 0.2005 (0.59) 1 1 test_update-import-url[main] 2.9444 (1.0) 2.9444 (1.0) 2.9444 (1.0) 0.0000 (1.0) 2.9444 (1.0) 0.0000 (1.0) 0;0 0.3396 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.58.2] 5.3061 (3.03) 5.3061 (3.03) 5.3061 (3.03) 0.0000 (1.0) 5.3061 (3.03) 0.0000 (1.0) 0;0 0.1885 (0.33) 1 1 test_update-update[3.10.0] 5.1704 (2.95) 5.1704 (2.95) 5.1704 (2.95) 0.0000 (1.0) 5.1704 (2.95) 0.0000 (1.0) 0;0 0.1934 (0.34) 1 1 test_update-update[3.53.2] 4.1313 (2.36) 4.1313 (2.36) 4.1313 (2.36) 0.0000 (1.0) 4.1313 (2.36) 0.0000 (1.0) 0;0 0.2421 (0.42) 1 1 test_update-update[main] 1.7515 (1.0) 1.7515 (1.0) 1.7515 (1.0) 0.0000 (1.0) 1.7515 (1.0) 0.0000 (1.0) 0;0 0.5710 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_update-update-noop[2.58.2] 974.6150 (1.56) 974.6150 (1.56) 974.6150 (1.56) 0.0000 (1.0) 974.6150 (1.56) 0.0000 (1.0) 0;0 1.0260 (0.64) 1 1 test_update-update-noop[3.10.0] 969.6774 (1.55) 969.6774 (1.55) 969.6774 (1.55) 0.0000 (1.0) 969.6774 (1.55) 0.0000 (1.0) 0;0 1.0313 (0.64) 1 1 test_update-update-noop[3.53.2] 911.2966 (1.46) 911.2966 (1.46) 911.2966 (1.46) 0.0000 (1.0) 911.2966 (1.46) 0.0000 (1.0) 0;0 1.0973 (0.69) 1 1 test_update-update-noop[main] 624.2925 (1.0) 624.2925 (1.0) 624.2925 (1.0) 0.0000 (1.0) 624.2925 (1.0) 0.0000 (1.0) 0;0 1.6018 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
3 weeks ago 
github-actions[bot]
commented
3 weeks ago