Closed skshetry closed 1 month ago
Tue Aug 13 12:43:23 UTC 2024 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add[2.58.2] 3.8603 (2.51) 3.8603 (2.51) 3.8603 (2.51) 0.0000 (1.0) 3.8603 (2.51) 0.0000 (1.0) 0;0 0.2590 (0.40) 1 1 test_add_copy-add[3.10.0] 3.7715 (2.45) 3.7715 (2.45) 3.7715 (2.45) 0.0000 (1.0) 3.7715 (2.45) 0.0000 (1.0) 0;0 0.2651 (0.41) 1 1 test_add_copy-add[3.53.2] 3.3179 (2.16) 3.3179 (2.16) 3.3179 (2.16) 0.0000 (1.0) 3.3179 (2.16) 0.0000 (1.0) 0;0 0.3014 (0.46) 1 1 test_add_copy-add[main] 1.5393 (1.0) 1.5393 (1.0) 1.5393 (1.0) 0.0000 (1.0) 1.5393 (1.0) 0.0000 (1.0) 0;0 0.6496 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add-noop[2.58.2] 1.5831 (2.17) 1.5831 (2.17) 1.5831 (2.17) 0.0000 (1.0) 1.5831 (2.17) 0.0000 (1.0) 0;0 0.6317 (0.46) 1 1 test_add_copy-add-noop[3.10.0] 1.4907 (2.04) 1.4907 (2.04) 1.4907 (2.04) 0.0000 (1.0) 1.4907 (2.04) 0.0000 (1.0) 0;0 0.6708 (0.49) 1 1 test_add_copy-add-noop[3.53.2] 1.4158 (1.94) 1.4158 (1.94) 1.4158 (1.94) 0.0000 (1.0) 1.4158 (1.94) 0.0000 (1.0) 0;0 0.7063 (0.52) 1 1 test_add_copy-add-noop[main] 0.7308 (1.0) 0.7308 (1.0) 0.7308 (1.0) 0.0000 (1.0) 0.7308 (1.0) 0.0000 (1.0) 0;0 1.3683 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add[2.58.2] 3.0230 (1.69) 3.0230 (1.69) 3.0230 (1.69) 0.0000 (1.0) 3.0230 (1.69) 0.0000 (1.0) 0;0 0.3308 (0.59) 1 1 test_add_hardlink-add[3.10.0] 2.8467 (1.59) 2.8467 (1.59) 2.8467 (1.59) 0.0000 (1.0) 2.8467 (1.59) 0.0000 (1.0) 0;0 0.3513 (0.63) 1 1 test_add_hardlink-add[3.53.2] 2.6413 (1.47) 2.6413 (1.47) 2.6413 (1.47) 0.0000 (1.0) 2.6413 (1.47) 0.0000 (1.0) 0;0 0.3786 (0.68) 1 1 test_add_hardlink-add[main] 1.7937 (1.0) 1.7937 (1.0) 1.7937 (1.0) 0.0000 (1.0) 1.7937 (1.0) 0.0000 (1.0) 0;0 0.5575 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add-noop[2.58.2] 1.7073 (2.45) 1.7073 (2.45) 1.7073 (2.45) 0.0000 (1.0) 1.7073 (2.45) 0.0000 (1.0) 0;0 0.5857 (0.41) 1 1 test_add_hardlink-add-noop[3.10.0] 1.7071 (2.45) 1.7071 (2.45) 1.7071 (2.45) 0.0000 (1.0) 1.7071 (2.45) 0.0000 (1.0) 0;0 0.5858 (0.41) 1 1 test_add_hardlink-add-noop[3.53.2] 1.5857 (2.28) 1.5857 (2.28) 1.5857 (2.28) 0.0000 (1.0) 1.5857 (2.28) 0.0000 (1.0) 0;0 0.6306 (0.44) 1 1 test_add_hardlink-add-noop[main] 0.6970 (1.0) 0.6970 (1.0) 0.6970 (1.0) 0.0000 (1.0) 0.6970 (1.0) 0.0000 (1.0) 0;0 1.4348 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_symlink-add[2.58.2] 3.1781 (1.74) 3.1781 (1.74) 3.1781 (1.74) 0.0000 (1.0) 3.1781 (1.74) 0.0000 (1.0) 0;0 0.3147 (0.57) 1 1 test_add_symlink-add[3.10.0] 2.9887 (1.64) 2.9887 (1.64) 2.9887 (1.64) 0.0000 (1.0) 2.9887 (1.64) 0.0000 (1.0) 0;0 0.3346 (0.61) 1 1 test_add_symlink-add[3.53.2] 2.8111 (1.54) 2.8111 (1.54) 2.8111 (1.54) 0.0000 (1.0) 2.8111 (1.54) 0.0000 (1.0) 0;0 0.3557 (0.65) 1 1 test_add_symlink-add[main] 1.8255 (1.0) 1.8255 (1.0) 1.8255 (1.0) 0.0000 (1.0) 1.8255 (1.0) 0.0000 (1.0) 0;0 0.5478 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_add_symlink-add-noop[2.58.2] 2.0963 (2.89) 2.0963 (2.89) 2.0963 (2.89) 0.0000 (1.0) 2.0963 (2.89) 0.0000 (1.0) 0;0 0.4770 (0.35) 1 1 test_add_symlink-add-noop[3.10.0] 1.9326 (2.66) 1.9326 (2.66) 1.9326 (2.66) 0.0000 (1.0) 1.9326 (2.66) 0.0000 (1.0) 0;0 0.5174 (0.38) 1 1 test_add_symlink-add-noop[3.53.2] 1.8313 (2.52) 1.8313 (2.52) 1.8313 (2.52) 0.0000 (1.0) 1.8313 (2.52) 0.0000 (1.0) 0;0 0.5461 (0.40) 1 1 test_add_symlink-add-noop[main] 0.7257 (1.0) 0.7257 (1.0) 0.7257 (1.0) 0.0000 (1.0) 0.7257 (1.0) 0.0000 (1.0) 0;0 1.3781 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.58.2] 1.9884 (1.52) 1.9884 (1.52) 1.9884 (1.52) 0.0000 (1.0) 1.9884 (1.52) 0.0000 (1.0) 0;0 0.5029 (0.66) 1 1 test_checkout_copy-checkout[3.10.0] 3.8172 (2.91) 3.8172 (2.91) 3.8172 (2.91) 0.0000 (1.0) 3.8172 (2.91) 0.0000 (1.0) 0;0 0.2620 (0.34) 1 1 test_checkout_copy-checkout[3.53.2] 1.5613 (1.19) 1.5613 (1.19) 1.5613 (1.19) 0.0000 (1.0) 1.5613 (1.19) 0.0000 (1.0) 0;0 0.6405 (0.84) 1 1 test_checkout_copy-checkout[main] 1.3106 (1.0) 1.3106 (1.0) 1.3106 (1.0) 0.0000 (1.0) 1.3106 (1.0) 0.0000 (1.0) 0;0 0.7630 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.58.2] 592.4820 (1.23) 592.4820 (1.23) 592.4820 (1.23) 0.0000 (1.0) 592.4820 (1.23) 0.0000 (1.0) 0;0 1.6878 (0.81) 1 1 test_checkout_copy-checkout-noop[3.10.0] 602.8515 (1.25) 602.8515 (1.25) 602.8515 (1.25) 0.0000 (1.0) 602.8515 (1.25) 0.0000 (1.0) 0;0 1.6588 (0.80) 1 1 test_checkout_copy-checkout-noop[3.53.2] 565.2066 (1.17) 565.2066 (1.17) 565.2066 (1.17) 0.0000 (1.0) 565.2066 (1.17) 0.0000 (1.0) 0;0 1.7693 (0.85) 1 1 test_checkout_copy-checkout-noop[main] 481.0969 (1.0) 481.0969 (1.0) 481.0969 (1.0) 0.0000 (1.0) 481.0969 (1.0) 0.0000 (1.0) 0;0 2.0786 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.58.2] 724.7317 (1.31) 724.7317 (1.31) 724.7317 (1.31) 0.0000 (1.0) 724.7317 (1.31) 0.0000 (1.0) 0;0 1.3798 (0.76) 1 1 test_checkout_copy-checkout-update[3.10.0] 671.4184 (1.21) 671.4184 (1.21) 671.4184 (1.21) 0.0000 (1.0) 671.4184 (1.21) 0.0000 (1.0) 0;0 1.4894 (0.82) 1 1 test_checkout_copy-checkout-update[3.53.2] 621.6852 (1.12) 621.6852 (1.12) 621.6852 (1.12) 0.0000 (1.0) 621.6852 (1.12) 0.0000 (1.0) 0;0 1.6085 (0.89) 1 1 test_checkout_copy-checkout-update[main] 552.8893 (1.0) 552.8893 (1.0) 552.8893 (1.0) 0.0000 (1.0) 552.8893 (1.0) 0.0000 (1.0) 0;0 1.8087 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.58.2] 1.2819 (1.62) 1.2819 (1.62) 1.2819 (1.62) 0.0000 (1.0) 1.2819 (1.62) 0.0000 (1.0) 0;0 0.7801 (0.62) 1 1 test_checkout_hardlink-checkout[3.10.0] 1.1205 (1.42) 1.1205 (1.42) 1.1205 (1.42) 0.0000 (1.0) 1.1205 (1.42) 0.0000 (1.0) 0;0 0.8925 (0.71) 1 1 test_checkout_hardlink-checkout[3.53.2] 1.0775 (1.36) 1.0775 (1.36) 1.0775 (1.36) 0.0000 (1.0) 1.0775 (1.36) 0.0000 (1.0) 0;0 0.9281 (0.73) 1 1 test_checkout_hardlink-checkout[main] 0.7902 (1.0) 0.7902 (1.0) 0.7902 (1.0) 0.0000 (1.0) 0.7902 (1.0) 0.0000 (1.0) 0;0 1.2655 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.58.2] 602.6466 (1.17) 602.6466 (1.17) 602.6466 (1.17) 0.0000 (1.0) 602.6466 (1.17) 0.0000 (1.0) 0;0 1.6593 (0.86) 1 1 test_checkout_hardlink-checkout-noop[3.10.0] 624.8937 (1.21) 624.8937 (1.21) 624.8937 (1.21) 0.0000 (1.0) 624.8937 (1.21) 0.0000 (1.0) 0;0 1.6003 (0.83) 1 1 test_checkout_hardlink-checkout-noop[3.53.2] 603.5976 (1.17) 603.5976 (1.17) 603.5976 (1.17) 0.0000 (1.0) 603.5976 (1.17) 0.0000 (1.0) 0;0 1.6567 (0.86) 1 1 test_checkout_hardlink-checkout-noop[main] 516.3602 (1.0) 516.3602 (1.0) 516.3602 (1.0) 0.0000 (1.0) 516.3602 (1.0) 0.0000 (1.0) 0;0 1.9366 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.58.2] 730.7897 (1.30) 730.7897 (1.30) 730.7897 (1.30) 0.0000 (1.0) 730.7897 (1.30) 0.0000 (1.0) 0;0 1.3684 (0.77) 1 1 test_checkout_hardlink-checkout-update[3.10.0] 661.6948 (1.18) 661.6948 (1.18) 661.6948 (1.18) 0.0000 (1.0) 661.6948 (1.18) 0.0000 (1.0) 0;0 1.5113 (0.85) 1 1 test_checkout_hardlink-checkout-update[3.53.2] 639.1351 (1.14) 639.1351 (1.14) 639.1351 (1.14) 0.0000 (1.0) 639.1351 (1.14) 0.0000 (1.0) 0;0 1.5646 (0.88) 1 1 test_checkout_hardlink-checkout-update[main] 560.1941 (1.0) 560.1941 (1.0) 560.1941 (1.0) 0.0000 (1.0) 560.1941 (1.0) 0.0000 (1.0) 0;0 1.7851 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.58.2] 1.4660 (1.62) 1.4660 (1.62) 1.4660 (1.62) 0.0000 (1.0) 1.4660 (1.62) 0.0000 (1.0) 0;0 0.6821 (0.62) 1 1 test_checkout_symlink-checkout[3.10.0] 1.2789 (1.41) 1.2789 (1.41) 1.2789 (1.41) 0.0000 (1.0) 1.2789 (1.41) 0.0000 (1.0) 0;0 0.7819 (0.71) 1 1 test_checkout_symlink-checkout[3.53.2] 1.1800 (1.30) 1.1800 (1.30) 1.1800 (1.30) 0.0000 (1.0) 1.1800 (1.30) 0.0000 (1.0) 0;0 0.8475 (0.77) 1 1 test_checkout_symlink-checkout[main] 0.9056 (1.0) 0.9056 (1.0) 0.9056 (1.0) 0.0000 (1.0) 0.9056 (1.0) 0.0000 (1.0) 0;0 1.1043 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.58.2] 684.9755 (1.19) 684.9755 (1.19) 684.9755 (1.19) 0.0000 (1.0) 684.9755 (1.19) 0.0000 (1.0) 0;0 1.4599 (0.84) 1 1 test_checkout_symlink-checkout-noop[3.10.0] 685.3692 (1.19) 685.3692 (1.19) 685.3692 (1.19) 0.0000 (1.0) 685.3692 (1.19) 0.0000 (1.0) 0;0 1.4591 (0.84) 1 1 test_checkout_symlink-checkout-noop[3.53.2] 673.8223 (1.17) 673.8223 (1.17) 673.8223 (1.17) 0.0000 (1.0) 673.8223 (1.17) 0.0000 (1.0) 0;0 1.4841 (0.86) 1 1 test_checkout_symlink-checkout-noop[main] 576.7559 (1.0) 576.7559 (1.0) 576.7559 (1.0) 0.0000 (1.0) 576.7559 (1.0) 0.0000 (1.0) 0;0 1.7338 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout-update[2.58.2] 845.2579 (1.28) 845.2579 (1.28) 845.2579 (1.28) 0.0000 (1.0) 845.2579 (1.28) 0.0000 (1.0) 0;0 1.1831 (0.78) 1 1 test_checkout_symlink-checkout-update[3.10.0] 800.4455 (1.21) 800.4455 (1.21) 800.4455 (1.21) 0.0000 (1.0) 800.4455 (1.21) 0.0000 (1.0) 0;0 1.2493 (0.82) 1 1 test_checkout_symlink-checkout-update[3.53.2] 739.1307 (1.12) 739.1307 (1.12) 739.1307 (1.12) 0.0000 (1.0) 739.1307 (1.12) 0.0000 (1.0) 0;0 1.3529 (0.89) 1 1 test_checkout_symlink-checkout-update[main] 659.9437 (1.0) 659.9437 (1.0) 659.9437 (1.0) 0.0000 (1.0) 659.9437 (1.0) 0.0000 (1.0) 0;0 1.5153 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.58.2] 615.6879 (1.20) 615.6879 (1.20) 615.6879 (1.20) 0.0000 (1.0) 615.6879 (1.20) 0.0000 (1.0) 0;0 1.6242 (0.83) 1 1 test_data_status-data-changed[3.10.0] 601.3531 (1.17) 601.3531 (1.17) 601.3531 (1.17) 0.0000 (1.0) 601.3531 (1.17) 0.0000 (1.0) 0;0 1.6629 (0.85) 1 1 test_data_status-data-changed[3.53.2] 582.0653 (1.14) 582.0653 (1.14) 582.0653 (1.14) 0.0000 (1.0) 582.0653 (1.14) 0.0000 (1.0) 0;0 1.7180 (0.88) 1 1 test_data_status-data-changed[main] 512.6575 (1.0) 512.6575 (1.0) 512.6575 (1.0) 0.0000 (1.0) 512.6575 (1.0) 0.0000 (1.0) 0;0 1.9506 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.58.2] 621.1553 (1.22) 621.1553 (1.22) 621.1553 (1.22) 0.0000 (1.0) 621.1553 (1.22) 0.0000 (1.0) 0;0 1.6099 (0.82) 1 1 test_data_status-data-changed-noop[3.10.0] 610.3517 (1.20) 610.3517 (1.20) 610.3517 (1.20) 0.0000 (1.0) 610.3517 (1.20) 0.0000 (1.0) 0;0 1.6384 (0.84) 1 1 test_data_status-data-changed-noop[3.53.2] 579.9276 (1.14) 579.9276 (1.14) 579.9276 (1.14) 0.0000 (1.0) 579.9276 (1.14) 0.0000 (1.0) 0;0 1.7244 (0.88) 1 1 test_data_status-data-changed-noop[main] 510.2255 (1.0) 510.2255 (1.0) 510.2255 (1.0) 0.0000 (1.0) 510.2255 (1.0) 0.0000 (1.0) 0;0 1.9599 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.58.2] 1.3013 (1.65) 1.3013 (1.65) 1.3013 (1.65) 0.0000 (1.0) 1.3013 (1.65) 0.0000 (1.0) 0;0 0.7684 (0.61) 1 1 test_data_status-data-new[3.10.0] 1.2658 (1.60) 1.2658 (1.60) 1.2658 (1.60) 0.0000 (1.0) 1.2658 (1.60) 0.0000 (1.0) 0;0 0.7900 (0.62) 1 1 test_data_status-data-new[3.53.2] 1.2458 (1.58) 1.2458 (1.58) 1.2458 (1.58) 0.0000 (1.0) 1.2458 (1.58) 0.0000 (1.0) 0;0 0.8027 (0.63) 1 1 test_data_status-data-new[main] 0.7904 (1.0) 0.7904 (1.0) 0.7904 (1.0) 0.0000 (1.0) 0.7904 (1.0) 0.0000 (1.0) 0;0 1.2652 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.58.2] 618.5286 (1.21) 618.5286 (1.21) 618.5286 (1.21) 0.0000 (1.0) 618.5286 (1.21) 0.0000 (1.0) 0;0 1.6167 (0.82) 1 1 test_data_status-data-noop[3.10.0] 606.5687 (1.19) 606.5687 (1.19) 606.5687 (1.19) 0.0000 (1.0) 606.5687 (1.19) 0.0000 (1.0) 0;0 1.6486 (0.84) 1 1 test_data_status-data-noop[3.53.2] 584.5385 (1.15) 584.5385 (1.15) 584.5385 (1.15) 0.0000 (1.0) 584.5385 (1.15) 0.0000 (1.0) 0;0 1.7108 (0.87) 1 1 test_data_status-data-noop[main] 509.3753 (1.0) 509.3753 (1.0) 509.3753 (1.0) 0.0000 (1.0) 509.3753 (1.0) 0.0000 (1.0) 0;0 1.9632 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.58.2] 1.0925 (1.12) 1.0925 (1.12) 1.0925 (1.12) 0.0000 (1.0) 1.0925 (1.12) 0.0000 (1.0) 0;0 0.9154 (0.89) 1 1 test_data_status_all_flags-data-changed[3.10.0] 1.0637 (1.09) 1.0637 (1.09) 1.0637 (1.09) 0.0000 (1.0) 1.0637 (1.09) 0.0000 (1.0) 0;0 0.9401 (0.92) 1 1 test_data_status_all_flags-data-changed[3.53.2] 1.0490 (1.07) 1.0490 (1.07) 1.0490 (1.07) 0.0000 (1.0) 1.0490 (1.07) 0.0000 (1.0) 0;0 0.9533 (0.93) 1 1 test_data_status_all_flags-data-changed[main] 0.9761 (1.0) 0.9761 (1.0) 0.9761 (1.0) 0.0000 (1.0) 0.9761 (1.0) 0.0000 (1.0) 0;0 1.0245 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.58.2] 1.1037 (1.12) 1.1037 (1.12) 1.1037 (1.12) 0.0000 (1.0) 1.1037 (1.12) 0.0000 (1.0) 0;0 0.9061 (0.89) 1 1 test_data_status_all_flags-data-changed-noop[3.10.0] 1.0599 (1.08) 1.0599 (1.08) 1.0599 (1.08) 0.0000 (1.0) 1.0599 (1.08) 0.0000 (1.0) 0;0 0.9435 (0.93) 1 1 test_data_status_all_flags-data-changed-noop[3.53.2] 1.0577 (1.08) 1.0577 (1.08) 1.0577 (1.08) 0.0000 (1.0) 1.0577 (1.08) 0.0000 (1.0) 0;0 0.9454 (0.93) 1 1 test_data_status_all_flags-data-changed-noop[main] 0.9811 (1.0) 0.9811 (1.0) 0.9811 (1.0) 0.0000 (1.0) 0.9811 (1.0) 0.0000 (1.0) 0;0 1.0193 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.58.2] 1.8157 (1.47) 1.8157 (1.47) 1.8157 (1.47) 0.0000 (1.0) 1.8157 (1.47) 0.0000 (1.0) 0;0 0.5507 (0.68) 1 1 test_data_status_all_flags-data-new[3.10.0] 1.7016 (1.38) 1.7016 (1.38) 1.7016 (1.38) 0.0000 (1.0) 1.7016 (1.38) 0.0000 (1.0) 0;0 0.5877 (0.72) 1 1 test_data_status_all_flags-data-new[3.53.2] 1.7008 (1.38) 1.7008 (1.38) 1.7008 (1.38) 0.0000 (1.0) 1.7008 (1.38) 0.0000 (1.0) 0;0 0.5879 (0.72) 1 1 test_data_status_all_flags-data-new[main] 1.2327 (1.0) 1.2327 (1.0) 1.2327 (1.0) 0.0000 (1.0) 1.2327 (1.0) 0.0000 (1.0) 0;0 0.8112 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.58.2] 1.0900 (1.14) 1.0900 (1.14) 1.0900 (1.14) 0.0000 (1.0) 1.0900 (1.14) 0.0000 (1.0) 0;0 0.9174 (0.88) 1 1 test_data_status_all_flags-data-noop[3.10.0] 1.0961 (1.14) 1.0961 (1.14) 1.0961 (1.14) 0.0000 (1.0) 1.0961 (1.14) 0.0000 (1.0) 0;0 0.9123 (0.87) 1 1 test_data_status_all_flags-data-noop[3.53.2] 1.0354 (1.08) 1.0354 (1.08) 1.0354 (1.08) 0.0000 (1.0) 1.0354 (1.08) 0.0000 (1.0) 0;0 0.9658 (0.92) 1 1 test_data_status_all_flags-data-noop[main] 0.9576 (1.0) 0.9576 (1.0) 0.9576 (1.0) 0.0000 (1.0) 0.9576 (1.0) 0.0000 (1.0) 0;0 1.0443 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.58.2] 1.2627 (1.52) 1.2627 (1.52) 1.2627 (1.52) 0.0000 (1.0) 1.2627 (1.52) 0.0000 (1.0) 0;0 0.7919 (0.66) 1 1 test_diff-diff[3.10.0] 1.2524 (1.51) 1.2524 (1.51) 1.2524 (1.51) 0.0000 (1.0) 1.2524 (1.51) 0.0000 (1.0) 0;0 0.7985 (0.66) 1 1 test_diff-diff[3.53.2] 1.2227 (1.47) 1.2227 (1.47) 1.2227 (1.47) 0.0000 (1.0) 1.2227 (1.47) 0.0000 (1.0) 0;0 0.8178 (0.68) 1 1 test_diff-diff[main] 0.8292 (1.0) 0.8292 (1.0) 0.8292 (1.0) 0.0000 (1.0) 0.8292 (1.0) 0.0000 (1.0) 0;0 1.2059 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.58.2] 673.3927 (1.19) 673.3927 (1.19) 673.3927 (1.19) 0.0000 (1.0) 673.3927 (1.19) 0.0000 (1.0) 0;0 1.4850 (0.84) 1 1 test_diff-diff-changed[3.10.0] 683.5157 (1.21) 683.5157 (1.21) 683.5157 (1.21) 0.0000 (1.0) 683.5157 (1.21) 0.0000 (1.0) 0;0 1.4630 (0.83) 1 1 test_diff-diff-changed[3.53.2] 630.8795 (1.12) 630.8795 (1.12) 630.8795 (1.12) 0.0000 (1.0) 630.8795 (1.12) 0.0000 (1.0) 0;0 1.5851 (0.89) 1 1 test_diff-diff-changed[main] 564.5759 (1.0) 564.5759 (1.0) 564.5759 (1.0) 0.0000 (1.0) 564.5759 (1.0) 0.0000 (1.0) 0;0 1.7712 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.58.2] 648.2448 (1.16) 648.2448 (1.16) 648.2448 (1.16) 0.0000 (1.0) 648.2448 (1.16) 0.0000 (1.0) 0;0 1.5426 (0.86) 1 1 test_diff-diff-changed-noop[3.10.0] 651.7250 (1.16) 651.7250 (1.16) 651.7250 (1.16) 0.0000 (1.0) 651.7250 (1.16) 0.0000 (1.0) 0;0 1.5344 (0.86) 1 1 test_diff-diff-changed-noop[3.53.2] 611.4773 (1.09) 611.4773 (1.09) 611.4773 (1.09) 0.0000 (1.0) 611.4773 (1.09) 0.0000 (1.0) 0;0 1.6354 (0.92) 1 1 test_diff-diff-changed-noop[main] 560.5809 (1.0) 560.5809 (1.0) 560.5809 (1.0) 0.0000 (1.0) 560.5809 (1.0) 0.0000 (1.0) 0;0 1.7839 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.58.2] 617.1439 (1.10) 617.1439 (1.10) 617.1439 (1.10) 0.0000 (1.0) 617.1439 (1.10) 0.0000 (1.0) 0;0 1.6204 (0.91) 1 1 test_diff-diff-noop[3.10.0] 615.3994 (1.09) 615.3994 (1.09) 615.3994 (1.09) 0.0000 (1.0) 615.3994 (1.09) 0.0000 (1.0) 0;0 1.6250 (0.92) 1 1 test_diff-diff-noop[3.53.2] 630.9320 (1.12) 630.9320 (1.12) 630.9320 (1.12) 0.0000 (1.0) 630.9320 (1.12) 0.0000 (1.0) 0;0 1.5850 (0.89) 1 1 test_diff-diff-noop[main] 563.2057 (1.0) 563.2057 (1.0) 563.2057 (1.0) 0.0000 (1.0) 563.2057 (1.0) 0.0000 (1.0) 0;0 1.7756 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests ---------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_exp_show-exp[2.58.2] 940.1007 (1.0) 940.1007 (1.0) 940.1007 (1.0) 0.0000 (1.0) 940.1007 (1.0) 0.0000 (1.0) 0;0 1.0637 (1.0) 1 1 test_exp_show-exp[3.10.0] 14,204.7059 (15.11) 14,204.7059 (15.11) 14,204.7059 (15.11) 0.0000 (1.0) 14,204.7059 (15.11) 0.0000 (1.0) 0;0 0.0704 (0.07) 1 1 test_exp_show-exp[3.53.2] 10,418.8317 (11.08) 10,418.8317 (11.08) 10,418.8317 (11.08) 0.0000 (1.0) 10,418.8317 (11.08) 0.0000 (1.0) 0;0 0.0960 (0.09) 1 1 test_exp_show-exp[main] 10,800.1398 (11.49) 10,800.1398 (11.49) 10,800.1398 (11.49) 0.0000 (1.0) 10,800.1398 (11.49) 0.0000 (1.0) 0;0 0.0926 (0.09) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_fetch-fetch[2.58.2] 3.7932 (2.73) 3.7932 (2.73) 3.7932 (2.73) 0.0000 (1.0) 3.7932 (2.73) 0.0000 (1.0) 0;0 0.2636 (0.37) 1 1 test_fetch-fetch[3.10.0] 4.0768 (2.93) 4.0768 (2.93) 4.0768 (2.93) 0.0000 (1.0) 4.0768 (2.93) 0.0000 (1.0) 0;0 0.2453 (0.34) 1 1 test_fetch-fetch[3.53.2] 1.7142 (1.23) 1.7142 (1.23) 1.7142 (1.23) 0.0000 (1.0) 1.7142 (1.23) 0.0000 (1.0) 0;0 0.5834 (0.81) 1 1 test_fetch-fetch[main] 1.3907 (1.0) 1.3907 (1.0) 1.3907 (1.0) 0.0000 (1.0) 1.3907 (1.0) 0.0000 (1.0) 0;0 0.7190 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.58.2] 487.8444 (1.02) 487.8444 (1.02) 487.8444 (1.02) 0.0000 (1.0) 487.8444 (1.02) 0.0000 (1.0) 0;0 2.0498 (0.98) 1 1 test_gc-gc[3.10.0] 492.7199 (1.03) 492.7199 (1.03) 492.7199 (1.03) 0.0000 (1.0) 492.7199 (1.03) 0.0000 (1.0) 0;0 2.0296 (0.97) 1 1 test_gc-gc[3.53.2] 477.2815 (1.0) 477.2815 (1.0) 477.2815 (1.0) 0.0000 (1.0) 477.2815 (1.0) 0.0000 (1.0) 0;0 2.0952 (1.0) 1 1 test_gc-gc[main] 479.9778 (1.01) 479.9778 (1.01) 479.9778 (1.01) 0.0000 (1.0) 479.9778 (1.01) 0.0000 (1.0) 0;0 2.0834 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.58.2] 5.6009 (1.14) 5.6009 (1.14) 5.6009 (1.14) 0.0000 (1.0) 5.6009 (1.14) 0.0000 (1.0) 0;0 0.1785 (0.88) 1 1 test_get-get[3.10.0] 6.6858 (1.36) 6.6858 (1.36) 6.6858 (1.36) 0.0000 (1.0) 6.6858 (1.36) 0.0000 (1.0) 0;0 0.1496 (0.73) 1 1 test_get-get[3.53.2] 4.9145 (1.00) 4.9145 (1.00) 4.9145 (1.00) 0.0000 (1.0) 4.9145 (1.00) 0.0000 (1.0) 0;0 0.2035 (1.00) 1 1 test_get-get[main] 4.9033 (1.0) 4.9033 (1.0) 4.9033 (1.0) 0.0000 (1.0) 4.9033 (1.0) 0.0000 (1.0) 0;0 0.2039 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.58.2] 3.0353 (3.26) 3.0353 (3.26) 3.0353 (3.26) 0.0000 (1.0) 3.0353 (3.26) 0.0000 (1.0) 0;0 0.3295 (0.31) 1 1 test_get_url-get-url[3.10.0] 3.2121 (3.45) 3.2121 (3.45) 3.2121 (3.45) 0.0000 (1.0) 3.2121 (3.45) 0.0000 (1.0) 0;0 0.3113 (0.29) 1 1 test_get_url-get-url[3.53.2] 0.9307 (1.0) 0.9307 (1.0) 0.9307 (1.0) 0.0000 (1.0) 0.9307 (1.0) 0.0000 (1.0) 0;0 1.0745 (1.0) 1 1 test_get_url-get-url[main] 0.9416 (1.01) 0.9416 (1.01) 0.9416 (1.01) 0.0000 (1.0) 0.9416 (1.01) 0.0000 (1.0) 0;0 1.0620 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.58.2] 123.6222 (1.02) 134.6044 (1.07) 124.9239 (1.02) 1.2725 (1.95) 124.7034 (1.02) 1.0288 (1.64) 8;3 8.0049 (0.98) 100 1 test_help---help[3.10.0] 120.9163 (1.0) 125.4314 (1.0) 122.7612 (1.0) 0.6515 (1.0) 122.6944 (1.0) 0.6264 (1.0) 21;7 8.1459 (1.0) 100 1 test_help---help[3.53.2] 123.1561 (1.02) 127.4036 (1.02) 124.5506 (1.01) 0.7780 (1.19) 124.4872 (1.01) 1.0345 (1.65) 29;1 8.0289 (0.99) 100 1 test_help---help[main] 123.0802 (1.02) 132.3893 (1.06) 124.5271 (1.01) 1.2695 (1.95) 124.2599 (1.01) 0.7042 (1.12) 11;7 8.0304 (0.99) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.58.2] 9.2211 (1.0) 9.2211 (1.0) 9.2211 (1.0) 0.0000 (1.0) 9.2211 (1.0) 0.0000 (1.0) 0;0 0.1084 (1.0) 1 1 test_import-import[3.10.0] 10.0788 (1.09) 10.0788 (1.09) 10.0788 (1.09) 0.0000 (1.0) 10.0788 (1.09) 0.0000 (1.0) 0;0 0.0992 (0.91) 1 1 test_import-import[3.53.2] 13.1921 (1.43) 13.1921 (1.43) 13.1921 (1.43) 0.0000 (1.0) 13.1921 (1.43) 0.0000 (1.0) 0;0 0.0758 (0.70) 1 1 test_import-import[main] 9.8384 (1.07) 9.8384 (1.07) 9.8384 (1.07) 0.0000 (1.0) 9.8384 (1.07) 0.0000 (1.0) 0;0 0.1016 (0.94) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.58.2] 7.6163 (3.17) 7.6163 (3.17) 7.6163 (3.17) 0.0000 (1.0) 7.6163 (3.17) 0.0000 (1.0) 0;0 0.1313 (0.32) 1 1 test_import_url-import-url[3.10.0] 7.3954 (3.08) 7.3954 (3.08) 7.3954 (3.08) 0.0000 (1.0) 7.3954 (3.08) 0.0000 (1.0) 0;0 0.1352 (0.32) 1 1 test_import_url-import-url[3.53.2] 4.7926 (2.00) 4.7926 (2.00) 4.7926 (2.00) 0.0000 (1.0) 4.7926 (2.00) 0.0000 (1.0) 0;0 0.2087 (0.50) 1 1 test_import_url-import-url[main] 2.4009 (1.0) 2.4009 (1.0) 2.4009 (1.0) 0.0000 (1.0) 2.4009 (1.0) 0.0000 (1.0) 0;0 0.4165 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.58.2] 393.3458 (1.0) 441.7719 (1.0) 404.1293 (1.0) 6.6530 (1.12) 402.7257 (1.0) 5.7767 (1.06) 17;5 2.4745 (1.0) 100 1 test_init-init[3.10.0] 410.1357 (1.04) 446.7625 (1.01) 419.2106 (1.04) 5.9370 (1.0) 417.9299 (1.04) 5.4682 (1.0) 19;7 2.3854 (0.96) 100 1 test_init-init[3.53.2] 401.1002 (1.02) 467.0794 (1.06) 409.4183 (1.01) 8.8950 (1.50) 407.0467 (1.01) 5.8156 (1.06) 8;7 2.4425 (0.99) 100 1 test_init-init[main] 400.5966 (1.02) 457.5360 (1.04) 411.6281 (1.02) 8.1377 (1.37) 409.9803 (1.02) 5.8401 (1.07) 8;5 2.4294 (0.98) 100 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.58.2] 491.7302 (1.15) 491.7302 (1.15) 491.7302 (1.15) 0.0000 (1.0) 491.7302 (1.15) 0.0000 (1.0) 0;0 2.0336 (0.87) 1 1 test_list-list[3.10.0] 487.0306 (1.13) 487.0306 (1.13) 487.0306 (1.13) 0.0000 (1.0) 487.0306 (1.13) 0.0000 (1.0) 0;0 2.0533 (0.88) 1 1 test_list-list[3.53.2] 429.8799 (1.00) 429.8799 (1.00) 429.8799 (1.00) 0.0000 (1.0) 429.8799 (1.00) 0.0000 (1.0) 0;0 2.3262 (1.00) 1 1 test_list-list[main] 429.3302 (1.0) 429.3302 (1.0) 429.3302 (1.0) 0.0000 (1.0) 429.3302 (1.0) 0.0000 (1.0) 0;0 2.3292 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.58.2] 458.2384 (1.08) 458.2384 (1.08) 458.2384 (1.08) 0.0000 (1.0) 458.2384 (1.08) 0.0000 (1.0) 0;0 2.1823 (0.92) 1 1 test_list-list-dvc-only[3.10.0] 453.6027 (1.07) 453.6027 (1.07) 453.6027 (1.07) 0.0000 (1.0) 453.6027 (1.07) 0.0000 (1.0) 0;0 2.2046 (0.93) 1 1 test_list-list-dvc-only[3.53.2] 423.1216 (1.0) 423.1216 (1.0) 423.1216 (1.0) 0.0000 (1.0) 423.1216 (1.0) 0.0000 (1.0) 0;0 2.3634 (1.0) 1 1 test_list-list-dvc-only[main] 426.9414 (1.01) 426.9414 (1.01) 426.9414 (1.01) 0.0000 (1.0) 426.9414 (1.01) 0.0000 (1.0) 0;0 2.3422 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.58.2] 545.2493 (1.08) 545.2493 (1.08) 545.2493 (1.08) 0.0000 (1.0) 545.2493 (1.08) 0.0000 (1.0) 0;0 1.8340 (0.92) 1 1 test_list-list-recursive[3.10.0] 538.5082 (1.07) 538.5082 (1.07) 538.5082 (1.07) 0.0000 (1.0) 538.5082 (1.07) 0.0000 (1.0) 0;0 1.8570 (0.93) 1 1 test_list-list-recursive[3.53.2] 502.7206 (1.0) 502.7206 (1.0) 502.7206 (1.0) 0.0000 (1.0) 502.7206 (1.0) 0.0000 (1.0) 0;0 1.9892 (1.0) 1 1 test_list-list-recursive[main] 505.8641 (1.01) 505.8641 (1.01) 505.8641 (1.01) 0.0000 (1.0) 505.8641 (1.01) 0.0000 (1.0) 0;0 1.9768 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.58.2] 467.8465 (1.10) 467.8465 (1.10) 467.8465 (1.10) 0.0000 (1.0) 467.8465 (1.10) 0.0000 (1.0) 0;0 2.1375 (0.91) 1 1 test_list-list-shallow[3.10.0] 472.2112 (1.11) 472.2112 (1.11) 472.2112 (1.11) 0.0000 (1.0) 472.2112 (1.11) 0.0000 (1.0) 0;0 2.1177 (0.90) 1 1 test_list-list-shallow[3.53.2] 441.4484 (1.04) 441.4484 (1.04) 441.4484 (1.04) 0.0000 (1.0) 441.4484 (1.04) 0.0000 (1.0) 0;0 2.2653 (0.96) 1 1 test_list-list-shallow[main] 423.9546 (1.0) 423.9546 (1.0) 423.9546 (1.0) 0.0000 (1.0) 423.9546 (1.0) 0.0000 (1.0) 0;0 2.3587 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add[2.58.2] 2.1429 (2.06) 2.1429 (2.06) 2.1429 (2.06) 0.0000 (1.0) 2.1429 (2.06) 0.0000 (1.0) 0;0 0.4667 (0.49) 1 1 test_partial_add-add[3.10.0] 2.2501 (2.16) 2.2501 (2.16) 2.2501 (2.16) 0.0000 (1.0) 2.2501 (2.16) 0.0000 (1.0) 0;0 0.4444 (0.46) 1 1 test_partial_add-add[3.53.2] 2.2149 (2.13) 2.2149 (2.13) 2.2149 (2.13) 0.0000 (1.0) 2.2149 (2.13) 0.0000 (1.0) 0;0 0.4515 (0.47) 1 1 test_partial_add-add[main] 1.0414 (1.0) 1.0414 (1.0) 1.0414 (1.0) 0.0000 (1.0) 1.0414 (1.0) 0.0000 (1.0) 0;0 0.9603 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial[2.58.2] 3.1583 (2.78) 3.1583 (2.78) 3.1583 (2.78) 0.0000 (1.0) 3.1583 (2.78) 0.0000 (1.0) 0;0 0.3166 (0.36) 1 1 test_partial_add-add-partial[3.10.0] 3.0566 (2.69) 3.0566 (2.69) 3.0566 (2.69) 0.0000 (1.0) 3.0566 (2.69) 0.0000 (1.0) 0;0 0.3272 (0.37) 1 1 test_partial_add-add-partial[3.53.2] 2.7792 (2.45) 2.7792 (2.45) 2.7792 (2.45) 0.0000 (1.0) 2.7792 (2.45) 0.0000 (1.0) 0;0 0.3598 (0.41) 1 1 test_partial_add-add-partial[main] 1.1354 (1.0) 1.1354 (1.0) 1.1354 (1.0) 0.0000 (1.0) 1.1354 (1.0) 0.0000 (1.0) 0;0 0.8807 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.58.2] 608.5328 (1.0) 608.5328 (1.0) 608.5328 (1.0) 0.0000 (1.0) 608.5328 (1.0) 0.0000 (1.0) 0;0 1.6433 (1.0) 1 1 test_partial_add-gc-cloud-noop[3.10.0] 652.1037 (1.07) 652.1037 (1.07) 652.1037 (1.07) 0.0000 (1.0) 652.1037 (1.07) 0.0000 (1.0) 0;0 1.5335 (0.93) 1 1 test_partial_add-gc-cloud-noop[3.53.2] 675.3550 (1.11) 675.3550 (1.11) 675.3550 (1.11) 0.0000 (1.0) 675.3550 (1.11) 0.0000 (1.0) 0;0 1.4807 (0.90) 1 1 test_partial_add-gc-cloud-noop[main] 664.2621 (1.09) 664.2621 (1.09) 664.2621 (1.09) 0.0000 (1.0) 664.2621 (1.09) 0.0000 (1.0) 0;0 1.5054 (0.92) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.58.2] 533.0216 (1.0) 533.0216 (1.0) 533.0216 (1.0) 0.0000 (1.0) 533.0216 (1.0) 0.0000 (1.0) 0;0 1.8761 (1.0) 1 1 test_partial_add-gc-noop[3.10.0] 580.5108 (1.09) 580.5108 (1.09) 580.5108 (1.09) 0.0000 (1.0) 580.5108 (1.09) 0.0000 (1.0) 0;0 1.7226 (0.92) 1 1 test_partial_add-gc-noop[3.53.2] 573.4885 (1.08) 573.4885 (1.08) 573.4885 (1.08) 0.0000 (1.0) 573.4885 (1.08) 0.0000 (1.0) 0;0 1.7437 (0.93) 1 1 test_partial_add-gc-noop[main] 563.9224 (1.06) 563.9224 (1.06) 563.9224 (1.06) 0.0000 (1.0) 563.9224 (1.06) 0.0000 (1.0) 0;0 1.7733 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push[2.58.2] 2.0225 (1.84) 2.0225 (1.84) 2.0225 (1.84) 0.0000 (1.0) 2.0225 (1.84) 0.0000 (1.0) 0;0 0.4944 (0.54) 1 1 test_partial_add-push[3.10.0] 1.2086 (1.10) 1.2086 (1.10) 1.2086 (1.10) 0.0000 (1.0) 1.2086 (1.10) 0.0000 (1.0) 0;0 0.8274 (0.91) 1 1 test_partial_add-push[3.53.2] 1.1064 (1.01) 1.1064 (1.01) 1.1064 (1.01) 0.0000 (1.0) 1.1064 (1.01) 0.0000 (1.0) 0;0 0.9038 (0.99) 1 1 test_partial_add-push[main] 1.0992 (1.0) 1.0992 (1.0) 1.0992 (1.0) 0.0000 (1.0) 1.0992 (1.0) 0.0000 (1.0) 0;0 0.9098 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial[2.58.2] 2.0611 (1.71) 2.0611 (1.71) 2.0611 (1.71) 0.0000 (1.0) 2.0611 (1.71) 0.0000 (1.0) 0;0 0.4852 (0.58) 1 1 test_partial_add-push-partial[3.10.0] 1.2689 (1.05) 1.2689 (1.05) 1.2689 (1.05) 0.0000 (1.0) 1.2689 (1.05) 0.0000 (1.0) 0;0 0.7881 (0.95) 1 1 test_partial_add-push-partial[3.53.2] 1.2176 (1.01) 1.2176 (1.01) 1.2176 (1.01) 0.0000 (1.0) 1.2176 (1.01) 0.0000 (1.0) 0;0 0.8213 (0.99) 1 1 test_partial_add-push-partial[main] 1.2050 (1.0) 1.2050 (1.0) 1.2050 (1.0) 0.0000 (1.0) 1.2050 (1.0) 0.0000 (1.0) 0;0 0.8298 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.58.2] 3.5998 (2.44) 3.5998 (2.44) 3.5998 (2.44) 0.0000 (1.0) 3.5998 (2.44) 0.0000 (1.0) 0;0 0.2778 (0.41) 1 1 test_partial_remove-add[3.10.0] 3.4585 (2.35) 3.4585 (2.35) 3.4585 (2.35) 0.0000 (1.0) 3.4585 (2.35) 0.0000 (1.0) 0;0 0.2891 (0.43) 1 1 test_partial_remove-add[3.53.2] 3.1674 (2.15) 3.1674 (2.15) 3.1674 (2.15) 0.0000 (1.0) 3.1674 (2.15) 0.0000 (1.0) 0;0 0.3157 (0.47) 1 1 test_partial_remove-add[main] 1.4740 (1.0) 1.4740 (1.0) 1.4740 (1.0) 0.0000 (1.0) 1.4740 (1.0) 0.0000 (1.0) 0;0 0.6784 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add-update[2.58.2] 1.5046 (2.48) 1.5046 (2.48) 1.5046 (2.48) 0.0000 (1.0) 1.5046 (2.48) 0.0000 (1.0) 0;0 0.6646 (0.40) 1 1 test_partial_remove-add-update[3.10.0] 1.4573 (2.40) 1.4573 (2.40) 1.4573 (2.40) 0.0000 (1.0) 1.4573 (2.40) 0.0000 (1.0) 0;0 0.6862 (0.42) 1 1 test_partial_remove-add-update[3.53.2] 1.3410 (2.21) 1.3410 (2.21) 1.3410 (2.21) 0.0000 (1.0) 1.3410 (2.21) 0.0000 (1.0) 0;0 0.7457 (0.45) 1 1 test_partial_remove-add-update[main] 0.6071 (1.0) 0.6071 (1.0) 0.6071 (1.0) 0.0000 (1.0) 0.6071 (1.0) 0.0000 (1.0) 0;0 1.6473 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.58.2] 502.9401 (1.0) 502.9401 (1.0) 502.9401 (1.0) 0.0000 (1.0) 502.9401 (1.0) 0.0000 (1.0) 0;0 1.9883 (1.0) 1 1 test_partial_remove-gc[3.10.0] 541.3733 (1.08) 541.3733 (1.08) 541.3733 (1.08) 0.0000 (1.0) 541.3733 (1.08) 0.0000 (1.0) 0;0 1.8472 (0.93) 1 1 test_partial_remove-gc[3.53.2] 539.4449 (1.07) 539.4449 (1.07) 539.4449 (1.07) 0.0000 (1.0) 539.4449 (1.07) 0.0000 (1.0) 0;0 1.8538 (0.93) 1 1 test_partial_remove-gc[main] 519.5831 (1.03) 519.5831 (1.03) 519.5831 (1.03) 0.0000 (1.0) 519.5831 (1.03) 0.0000 (1.0) 0;0 1.9246 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.58.2] 579.1721 (1.0) 579.1721 (1.0) 579.1721 (1.0) 0.0000 (1.0) 579.1721 (1.0) 0.0000 (1.0) 0;0 1.7266 (1.0) 1 1 test_partial_remove-gc-cloud[3.10.0] 590.4169 (1.02) 590.4169 (1.02) 590.4169 (1.02) 0.0000 (1.0) 590.4169 (1.02) 0.0000 (1.0) 0;0 1.6937 (0.98) 1 1 test_partial_remove-gc-cloud[3.53.2] 616.5634 (1.06) 616.5634 (1.06) 616.5634 (1.06) 0.0000 (1.0) 616.5634 (1.06) 0.0000 (1.0) 0;0 1.6219 (0.94) 1 1 test_partial_remove-gc-cloud[main] 609.9428 (1.05) 609.9428 (1.05) 609.9428 (1.05) 0.0000 (1.0) 609.9428 (1.05) 0.0000 (1.0) 0;0 1.6395 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.58.2] 3.3787 (2.33) 3.3787 (2.33) 3.3787 (2.33) 0.0000 (1.0) 3.3787 (2.33) 0.0000 (1.0) 0;0 0.2960 (0.43) 1 1 test_partial_remove-push[3.10.0] 1.8766 (1.29) 1.8766 (1.29) 1.8766 (1.29) 0.0000 (1.0) 1.8766 (1.29) 0.0000 (1.0) 0;0 0.5329 (0.77) 1 1 test_partial_remove-push[3.53.2] 1.4519 (1.0) 1.4519 (1.0) 1.4519 (1.0) 0.0000 (1.0) 1.4519 (1.0) 0.0000 (1.0) 0;0 0.6887 (1.0) 1 1 test_partial_remove-push[main] 1.4793 (1.02) 1.4793 (1.02) 1.4793 (1.02) 0.0000 (1.0) 1.4793 (1.02) 0.0000 (1.0) 0;0 0.6760 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push-update[2.58.2] 540.4131 (1.09) 540.4131 (1.09) 540.4131 (1.09) 0.0000 (1.0) 540.4131 (1.09) 0.0000 (1.0) 0;0 1.8504 (0.91) 1 1 test_partial_remove-push-update[3.10.0] 494.0241 (1.0) 494.0241 (1.0) 494.0241 (1.0) 0.0000 (1.0) 494.0241 (1.0) 0.0000 (1.0) 0;0 2.0242 (1.0) 1 1 test_partial_remove-push-update[3.53.2] 816.0996 (1.65) 816.0996 (1.65) 816.0996 (1.65) 0.0000 (1.0) 816.0996 (1.65) 0.0000 (1.0) 0;0 1.2253 (0.61) 1 1 test_partial_remove-push-update[main] 863.4403 (1.75) 863.4403 (1.75) 863.4403 (1.75) 0.0000 (1.0) 863.4403 (1.75) 0.0000 (1.0) 0;0 1.1582 (0.57) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_plots-plots-diff[2.58.2] 466.9268 (1.0) 498.6569 (1.0) 479.5039 (1.0) 12.6304 (2.23) 477.9736 (1.0) 18.4336 (3.39) 1;0 2.0855 (1.0) 5 3 test_plots-plots-diff[3.10.0] 850.5932 (1.82) 869.0134 (1.74) 857.3574 (1.79) 7.1399 (1.26) 855.0006 (1.79) 8.5061 (1.56) 1;0 1.1664 (0.56) 5 3 test_plots-plots-diff[3.53.2] 795.3319 (1.70) 809.4979 (1.62) 801.3562 (1.67) 5.6559 (1.0) 801.7039 (1.68) 8.5409 (1.57) 2;0 1.2479 (0.60) 5 3 test_plots-plots-diff[main] 796.4887 (1.71) 811.4911 (1.63) 800.6344 (1.67) 6.1787 (1.09) 798.6686 (1.67) 5.4363 (1.0) 1;1 1.2490 (0.60) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.58.2] 485.8424 (1.0) 501.6909 (1.0) 494.8460 (1.0) 6.5325 (1.0) 496.1330 (1.0) 10.7320 (1.0) 2;0 2.0208 (1.0) 5 3 test_plots-plots-diff-json[3.10.0] 1,065.7523 (2.19) 1,083.7038 (2.16) 1,074.5235 (2.17) 8.3359 (1.28) 1,072.4720 (2.16) 15.6716 (1.46) 2;0 0.9306 (0.46) 5 3 test_plots-plots-diff-json[3.53.2] 865.3956 (1.78) 893.4192 (1.78) 880.5427 (1.78) 10.5987 (1.62) 882.8166 (1.78) 14.4243 (1.34) 2;0 1.1357 (0.56) 5 3 test_plots-plots-diff-json[main] 867.5029 (1.79) 896.4077 (1.79) 882.1817 (1.78) 11.4616 (1.75) 881.0957 (1.78) 18.1083 (1.69) 2;0 1.1336 (0.56) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_plots-plots-show[2.58.2] 436.8190 (1.0) 445.4080 (1.0) 440.8427 (1.0) 3.6621 (1.84) 442.0476 (1.0) 6.0638 (1.89) 2;0 2.2684 (1.0) 5 3 test_plots-plots-show[3.10.0] 696.7133 (1.59) 726.3354 (1.63) 714.7908 (1.62) 11.7477 (5.89) 717.5973 (1.62) 16.7210 (5.21) 1;0 1.3990 (0.62) 5 3 test_plots-plots-show[3.53.2] 661.9204 (1.52) 666.7114 (1.50) 663.8280 (1.51) 1.9940 (1.0) 663.3395 (1.50) 3.2087 (1.0) 1;0 1.5064 (0.66) 5 3 test_plots-plots-show[main] 661.1808 (1.51) 669.1406 (1.50) 665.1919 (1.51) 3.0835 (1.55) 665.4083 (1.51) 4.6503 (1.45) 2;0 1.5033 (0.66) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ----------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.58.2] 454.7739 (1.0) 469.3798 (1.0) 462.2859 (1.0) 6.7243 (1.83) 464.4411 (1.0) 12.3951 (2.27) 2;0 2.1632 (1.0) 5 3 test_plots-plots-show-json[3.10.0] 829.1511 (1.82) 858.7443 (1.83) 847.5689 (1.83) 11.5593 (3.14) 851.1765 (1.83) 14.9540 (2.74) 1;0 1.1798 (0.55) 5 3 test_plots-plots-show-json[3.53.2] 707.6182 (1.56) 716.6097 (1.53) 713.2950 (1.54) 3.6830 (1.0) 714.3010 (1.54) 5.4496 (1.0) 1;0 1.4019 (0.65) 5 3 test_plots-plots-show-json[main] 706.9191 (1.55) 715.8872 (1.53) 711.7271 (1.54) 4.3548 (1.18) 714.0346 (1.54) 7.9273 (1.45) 2;0 1.4050 (0.65) 5 3 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.58.2] 3.4156 (2.45) 3.4156 (2.45) 3.4156 (2.45) 0.0000 (1.0) 3.4156 (2.45) 0.0000 (1.0) 0;0 0.2928 (0.41) 1 1 test_push-push[3.10.0] 1.8831 (1.35) 1.8831 (1.35) 1.8831 (1.35) 0.0000 (1.0) 1.8831 (1.35) 0.0000 (1.0) 0;0 0.5310 (0.74) 1 1 test_push-push[3.53.2] 1.4100 (1.01) 1.4100 (1.01) 1.4100 (1.01) 0.0000 (1.0) 1.4100 (1.01) 0.0000 (1.0) 0;0 0.7092 (0.99) 1 1 test_push-push[main] 1.3942 (1.0) 1.3942 (1.0) 1.3942 (1.0) 0.0000 (1.0) 1.3942 (1.0) 0.0000 (1.0) 0;0 0.7173 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.58.2] 3.7045 (2.53) 3.7045 (2.53) 3.7045 (2.53) 0.0000 (1.0) 3.7045 (2.53) 0.0000 (1.0) 0;0 0.2699 (0.40) 1 1 test_sharing-add[3.10.0] 3.5487 (2.42) 3.5487 (2.42) 3.5487 (2.42) 0.0000 (1.0) 3.5487 (2.42) 0.0000 (1.0) 0;0 0.2818 (0.41) 1 1 test_sharing-add[3.53.2] 3.2790 (2.24) 3.2790 (2.24) 3.2790 (2.24) 0.0000 (1.0) 3.2790 (2.24) 0.0000 (1.0) 0;0 0.3050 (0.45) 1 1 test_sharing-add[main] 1.4652 (1.0) 1.4652 (1.0) 1.4652 (1.0) 0.0000 (1.0) 1.4652 (1.0) 0.0000 (1.0) 0;0 0.6825 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.58.2] 2.4842 (3.82) 2.4842 (3.82) 2.4842 (3.82) 0.0000 (1.0) 2.4842 (3.82) 0.0000 (1.0) 0;0 0.4025 (0.26) 1 1 test_sharing-add-noop[3.10.0] 2.4382 (3.75) 2.4382 (3.75) 2.4382 (3.75) 0.0000 (1.0) 2.4382 (3.75) 0.0000 (1.0) 0;0 0.4101 (0.27) 1 1 test_sharing-add-noop[3.53.2] 2.0942 (3.22) 2.0942 (3.22) 2.0942 (3.22) 0.0000 (1.0) 2.0942 (3.22) 0.0000 (1.0) 0;0 0.4775 (0.31) 1 1 test_sharing-add-noop[main] 0.6498 (1.0) 0.6498 (1.0) 0.6498 (1.0) 0.0000 (1.0) 0.6498 (1.0) 0.0000 (1.0) 0;0 1.5390 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout[2.58.2] 1.7915 (1.62) 1.7915 (1.62) 1.7915 (1.62) 0.0000 (1.0) 1.7915 (1.62) 0.0000 (1.0) 0;0 0.5582 (0.62) 1 1 test_sharing-checkout[3.10.0] 3.6042 (3.25) 3.6042 (3.25) 3.6042 (3.25) 0.0000 (1.0) 3.6042 (3.25) 0.0000 (1.0) 0;0 0.2775 (0.31) 1 1 test_sharing-checkout[3.53.2] 1.3335 (1.20) 1.3335 (1.20) 1.3335 (1.20) 0.0000 (1.0) 1.3335 (1.20) 0.0000 (1.0) 0;0 0.7499 (0.83) 1 1 test_sharing-checkout[main] 1.1087 (1.0) 1.1087 (1.0) 1.1087 (1.0) 0.0000 (1.0) 1.1087 (1.0) 0.0000 (1.0) 0;0 0.9020 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.58.2] 575.4255 (1.20) 575.4255 (1.20) 575.4255 (1.20) 0.0000 (1.0) 575.4255 (1.20) 0.0000 (1.0) 0;0 1.7378 (0.83) 1 1 test_sharing-checkout-noop[3.10.0] 581.4064 (1.22) 581.4064 (1.22) 581.4064 (1.22) 0.0000 (1.0) 581.4064 (1.22) 0.0000 (1.0) 0;0 1.7200 (0.82) 1 1 test_sharing-checkout-noop[3.53.2] 554.1988 (1.16) 554.1988 (1.16) 554.1988 (1.16) 0.0000 (1.0) 554.1988 (1.16) 0.0000 (1.0) 0;0 1.8044 (0.86) 1 1 test_sharing-checkout-noop[main] 477.9542 (1.0) 477.9542 (1.0) 477.9542 (1.0) 0.0000 (1.0) 477.9542 (1.0) 0.0000 (1.0) 0;0 2.0923 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-fetch[2.58.2] 3.8679 (2.75) 3.8679 (2.75) 3.8679 (2.75) 0.0000 (1.0) 3.8679 (2.75) 0.0000 (1.0) 0;0 0.2585 (0.36) 1 1 test_sharing-fetch[3.10.0] 4.1590 (2.96) 4.1590 (2.96) 4.1590 (2.96) 0.0000 (1.0) 4.1590 (2.96) 0.0000 (1.0) 0;0 0.2404 (0.34) 1 1 test_sharing-fetch[3.53.2] 1.7727 (1.26) 1.7727 (1.26) 1.7727 (1.26) 0.0000 (1.0) 1.7727 (1.26) 0.0000 (1.0) 0;0 0.5641 (0.79) 1 1 test_sharing-fetch[main] 1.4070 (1.0) 1.4070 (1.0) 1.4070 (1.0) 0.0000 (1.0) 1.4070 (1.0) 0.0000 (1.0) 0;0 0.7107 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing-fetch-noop[2.58.2] 441.1412 (1.0) 441.1412 (1.0) 441.1412 (1.0) 0.0000 (1.0) 441.1412 (1.0) 0.0000 (1.0) 0;0 2.2668 (1.0) 1 1 test_sharing-fetch-noop[3.10.0] 534.5117 (1.21) 534.5117 (1.21) 534.5117 (1.21) 0.0000 (1.0) 534.5117 (1.21) 0.0000 (1.0) 0;0 1.8709 (0.83) 1 1 test_sharing-fetch-noop[3.53.2] 791.7474 (1.79) 791.7474 (1.79) 791.7474 (1.79) 0.0000 (1.0) 791.7474 (1.79) 0.0000 (1.0) 0;0 1.2630 (0.56) 1 1 test_sharing-fetch-noop[main] 809.0640 (1.83) 809.0640 (1.83) 809.0640 (1.83) 0.0000 (1.0) 809.0640 (1.83) 0.0000 (1.0) 0;0 1.2360 (0.55) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.58.2] 3.4305 (2.40) 3.4305 (2.40) 3.4305 (2.40) 0.0000 (1.0) 3.4305 (2.40) 0.0000 (1.0) 0;0 0.2915 (0.42) 1 1 test_sharing-push[3.10.0] 1.8646 (1.31) 1.8646 (1.31) 1.8646 (1.31) 0.0000 (1.0) 1.8646 (1.31) 0.0000 (1.0) 0;0 0.5363 (0.77) 1 1 test_sharing-push[3.53.2] 1.4276 (1.00) 1.4276 (1.00) 1.4276 (1.00) 0.0000 (1.0) 1.4276 (1.00) 0.0000 (1.0) 0;0 0.7005 (1.00) 1 1 test_sharing-push[main] 1.4275 (1.0) 1.4275 (1.0) 1.4275 (1.0) 0.0000 (1.0) 1.4275 (1.0) 0.0000 (1.0) 0;0 0.7005 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.58.2] 466.7383 (1.01) 466.7383 (1.01) 466.7383 (1.01) 0.0000 (1.0) 466.7383 (1.01) 0.0000 (1.0) 0;0 2.1425 (0.99) 1 1 test_sharing-push-noop[3.10.0] 461.1724 (1.0) 461.1724 (1.0) 461.1724 (1.0) 0.0000 (1.0) 461.1724 (1.0) 0.0000 (1.0) 0;0 2.1684 (1.0) 1 1 test_sharing-push-noop[3.53.2] 839.5601 (1.82) 839.5601 (1.82) 839.5601 (1.82) 0.0000 (1.0) 839.5601 (1.82) 0.0000 (1.0) 0;0 1.1911 (0.55) 1 1 test_sharing-push-noop[main] 801.6619 (1.74) 801.6619 (1.74) 801.6619 (1.74) 0.0000 (1.0) 801.6619 (1.74) 0.0000 (1.0) 0;0 1.2474 (0.58) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.58.2] 1.2321 (1.71) 1.2321 (1.71) 1.2321 (1.71) 0.0000 (1.0) 1.2321 (1.71) 0.0000 (1.0) 0;0 0.8116 (0.58) 1 1 test_status-status[3.10.0] 1.2425 (1.73) 1.2425 (1.73) 1.2425 (1.73) 0.0000 (1.0) 1.2425 (1.73) 0.0000 (1.0) 0;0 0.8048 (0.58) 1 1 test_status-status[3.53.2] 1.1485 (1.60) 1.1485 (1.60) 1.1485 (1.60) 0.0000 (1.0) 1.1485 (1.60) 0.0000 (1.0) 0;0 0.8707 (0.63) 1 1 test_status-status[main] 0.7186 (1.0) 0.7186 (1.0) 0.7186 (1.0) 0.0000 (1.0) 0.7186 (1.0) 0.0000 (1.0) 0;0 1.3915 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.58.2] 584.2065 (1.21) 584.2065 (1.21) 584.2065 (1.21) 0.0000 (1.0) 584.2065 (1.21) 0.0000 (1.0) 0;0 1.7117 (0.82) 1 1 test_status-status-changed[3.10.0] 570.1056 (1.18) 570.1056 (1.18) 570.1056 (1.18) 0.0000 (1.0) 570.1056 (1.18) 0.0000 (1.0) 0;0 1.7541 (0.84) 1 1 test_status-status-changed[3.53.2] 602.9857 (1.25) 602.9857 (1.25) 602.9857 (1.25) 0.0000 (1.0) 602.9857 (1.25) 0.0000 (1.0) 0;0 1.6584 (0.80) 1 1 test_status-status-changed[main] 481.1714 (1.0) 481.1714 (1.0) 481.1714 (1.0) 0.0000 (1.0) 481.1714 (1.0) 0.0000 (1.0) 0;0 2.0783 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.58.2] 569.6099 (1.18) 569.6099 (1.18) 569.6099 (1.18) 0.0000 (1.0) 569.6099 (1.18) 0.0000 (1.0) 0;0 1.7556 (0.85) 1 1 test_status-status-changed-noop[3.10.0] 578.3698 (1.19) 578.3698 (1.19) 578.3698 (1.19) 0.0000 (1.0) 578.3698 (1.19) 0.0000 (1.0) 0;0 1.7290 (0.84) 1 1 test_status-status-changed-noop[3.53.2] 545.5318 (1.13) 545.5318 (1.13) 545.5318 (1.13) 0.0000 (1.0) 545.5318 (1.13) 0.0000 (1.0) 0;0 1.8331 (0.89) 1 1 test_status-status-changed-noop[main] 484.2166 (1.0) 484.2166 (1.0) 484.2166 (1.0) 0.0000 (1.0) 484.2166 (1.0) 0.0000 (1.0) 0;0 2.0652 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.58.2] 571.3846 (1.18) 571.3846 (1.18) 571.3846 (1.18) 0.0000 (1.0) 571.3846 (1.18) 0.0000 (1.0) 0;0 1.7501 (0.85) 1 1 test_status-status-noop[3.10.0] 581.4765 (1.20) 581.4765 (1.20) 581.4765 (1.20) 0.0000 (1.0) 581.4765 (1.20) 0.0000 (1.0) 0;0 1.7198 (0.83) 1 1 test_status-status-noop[3.53.2] 544.7616 (1.13) 544.7616 (1.13) 544.7616 (1.13) 0.0000 (1.0) 544.7616 (1.13) 0.0000 (1.0) 0;0 1.8357 (0.89) 1 1 test_status-status-noop[main] 483.4863 (1.0) 483.4863 (1.0) 483.4863 (1.0) 0.0000 (1.0) 483.4863 (1.0) 0.0000 (1.0) 0;0 2.0683 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-import-url[2.58.2] 7.3695 (3.02) 7.3695 (3.02) 7.3695 (3.02) 0.0000 (1.0) 7.3695 (3.02) 0.0000 (1.0) 0;0 0.1357 (0.33) 1 1 test_update-import-url[3.10.0] 7.1713 (2.94) 7.1713 (2.94) 7.1713 (2.94) 0.0000 (1.0) 7.1713 (2.94) 0.0000 (1.0) 0;0 0.1394 (0.34) 1 1 test_update-import-url[3.53.2] 4.7517 (1.95) 4.7517 (1.95) 4.7517 (1.95) 0.0000 (1.0) 4.7517 (1.95) 0.0000 (1.0) 0;0 0.2105 (0.51) 1 1 test_update-import-url[main] 2.4397 (1.0) 2.4397 (1.0) 2.4397 (1.0) 0.0000 (1.0) 2.4397 (1.0) 0.0000 (1.0) 0;0 0.4099 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.58.2] 6.6552 (3.80) 6.6552 (3.80) 6.6552 (3.80) 0.0000 (1.0) 6.6552 (3.80) 0.0000 (1.0) 0;0 0.1503 (0.26) 1 1 test_update-update[3.10.0] 6.3920 (3.65) 6.3920 (3.65) 6.3920 (3.65) 0.0000 (1.0) 6.3920 (3.65) 0.0000 (1.0) 0;0 0.1564 (0.27) 1 1 test_update-update[3.53.2] 4.1349 (2.36) 4.1349 (2.36) 4.1349 (2.36) 0.0000 (1.0) 4.1349 (2.36) 0.0000 (1.0) 0;0 0.2418 (0.42) 1 1 test_update-update[main] 1.7513 (1.0) 1.7513 (1.0) 1.7513 (1.0) 0.0000 (1.0) 1.7513 (1.0) 0.0000 (1.0) 0;0 0.5710 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_update-update-noop[2.58.2] 997.1116 (1.61) 997.1116 (1.61) 997.1116 (1.61) 0.0000 (1.0) 997.1116 (1.61) 0.0000 (1.0) 0;0 1.0029 (0.62) 1 1 test_update-update-noop[3.10.0] 973.7738 (1.58) 973.7738 (1.58) 973.7738 (1.58) 0.0000 (1.0) 973.7738 (1.58) 0.0000 (1.0) 0;0 1.0269 (0.63) 1 1 test_update-update-noop[3.53.2] 908.2380 (1.47) 908.2380 (1.47) 908.2380 (1.47) 0.0000 (1.0) 908.2380 (1.47) 0.0000 (1.0) 0;0 1.1010 (0.68) 1 1 test_update-update-noop[main] 617.8952 (1.0) 617.8952 (1.0) 617.8952 (1.0) 0.0000 (1.0) 617.8952 (1.0) 0.0000 (1.0) 0;0 1.6184 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 month ago 
github-actions[bot]
commented
1 month ago