Closed skshetry closed 1 month ago
Tue Aug 13 13:27:43 UTC 2024 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add[2.58.2] 3.7155 (2.45) 3.7155 (2.45) 3.7155 (2.45) 0.0000 (1.0) 3.7155 (2.45) 0.0000 (1.0) 0;0 0.2691 (0.41) 1 1 test_add_copy-add[3.10.0] 3.5263 (2.33) 3.5263 (2.33) 3.5263 (2.33) 0.0000 (1.0) 3.5263 (2.33) 0.0000 (1.0) 0;0 0.2836 (0.43) 1 1 test_add_copy-add[3.53.2] 3.1320 (2.07) 3.1320 (2.07) 3.1320 (2.07) 0.0000 (1.0) 3.1320 (2.07) 0.0000 (1.0) 0;0 0.3193 (0.48) 1 1 test_add_copy-add[main] 1.5164 (1.0) 1.5164 (1.0) 1.5164 (1.0) 0.0000 (1.0) 1.5164 (1.0) 0.0000 (1.0) 0;0 0.6595 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add-noop[2.58.2] 1.5225 (2.19) 1.5225 (2.19) 1.5225 (2.19) 0.0000 (1.0) 1.5225 (2.19) 0.0000 (1.0) 0;0 0.6568 (0.46) 1 1 test_add_copy-add-noop[3.10.0] 1.4497 (2.08) 1.4497 (2.08) 1.4497 (2.08) 0.0000 (1.0) 1.4497 (2.08) 0.0000 (1.0) 0;0 0.6898 (0.48) 1 1 test_add_copy-add-noop[3.53.2] 1.3663 (1.96) 1.3663 (1.96) 1.3663 (1.96) 0.0000 (1.0) 1.3663 (1.96) 0.0000 (1.0) 0;0 0.7319 (0.51) 1 1 test_add_copy-add-noop[main] 0.6959 (1.0) 0.6959 (1.0) 0.6959 (1.0) 0.0000 (1.0) 0.6959 (1.0) 0.0000 (1.0) 0;0 1.4370 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add[2.58.2] 2.8774 (1.68) 2.8774 (1.68) 2.8774 (1.68) 0.0000 (1.0) 2.8774 (1.68) 0.0000 (1.0) 0;0 0.3475 (0.60) 1 1 test_add_hardlink-add[3.10.0] 2.7855 (1.62) 2.7855 (1.62) 2.7855 (1.62) 0.0000 (1.0) 2.7855 (1.62) 0.0000 (1.0) 0;0 0.3590 (0.62) 1 1 test_add_hardlink-add[3.53.2] 2.5764 (1.50) 2.5764 (1.50) 2.5764 (1.50) 0.0000 (1.0) 2.5764 (1.50) 0.0000 (1.0) 0;0 0.3881 (0.67) 1 1 test_add_hardlink-add[main] 1.7175 (1.0) 1.7175 (1.0) 1.7175 (1.0) 0.0000 (1.0) 1.7175 (1.0) 0.0000 (1.0) 0;0 0.5822 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add-noop[2.58.2] 1.7309 (2.66) 1.7309 (2.66) 1.7309 (2.66) 0.0000 (1.0) 1.7309 (2.66) 0.0000 (1.0) 0;0 0.5777 (0.38) 1 1 test_add_hardlink-add-noop[3.10.0] 1.5717 (2.42) 1.5717 (2.42) 1.5717 (2.42) 0.0000 (1.0) 1.5717 (2.42) 0.0000 (1.0) 0;0 0.6362 (0.41) 1 1 test_add_hardlink-add-noop[3.53.2] 1.5142 (2.33) 1.5142 (2.33) 1.5142 (2.33) 0.0000 (1.0) 1.5142 (2.33) 0.0000 (1.0) 0;0 0.6604 (0.43) 1 1 test_add_hardlink-add-noop[main] 0.6499 (1.0) 0.6499 (1.0) 0.6499 (1.0) 0.0000 (1.0) 0.6499 (1.0) 0.0000 (1.0) 0;0 1.5387 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_symlink-add[2.58.2] 3.1138 (1.70) 3.1138 (1.70) 3.1138 (1.70) 0.0000 (1.0) 3.1138 (1.70) 0.0000 (1.0) 0;0 0.3212 (0.59) 1 1 test_add_symlink-add[3.10.0] 3.0461 (1.66) 3.0461 (1.66) 3.0461 (1.66) 0.0000 (1.0) 3.0461 (1.66) 0.0000 (1.0) 0;0 0.3283 (0.60) 1 1 test_add_symlink-add[3.53.2] 2.7321 (1.49) 2.7321 (1.49) 2.7321 (1.49) 0.0000 (1.0) 2.7321 (1.49) 0.0000 (1.0) 0;0 0.3660 (0.67) 1 1 test_add_symlink-add[main] 1.8367 (1.0) 1.8367 (1.0) 1.8367 (1.0) 0.0000 (1.0) 1.8367 (1.0) 0.0000 (1.0) 0;0 0.5445 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_add_symlink-add-noop[2.58.2] 2.0695 (2.76) 2.0695 (2.76) 2.0695 (2.76) 0.0000 (1.0) 2.0695 (2.76) 0.0000 (1.0) 0;0 0.4832 (0.36) 1 1 test_add_symlink-add-noop[3.10.0] 1.9848 (2.65) 1.9848 (2.65) 1.9848 (2.65) 0.0000 (1.0) 1.9848 (2.65) 0.0000 (1.0) 0;0 0.5038 (0.38) 1 1 test_add_symlink-add-noop[3.53.2] 1.8185 (2.43) 1.8185 (2.43) 1.8185 (2.43) 0.0000 (1.0) 1.8185 (2.43) 0.0000 (1.0) 0;0 0.5499 (0.41) 1 1 test_add_symlink-add-noop[main] 0.7495 (1.0) 0.7495 (1.0) 0.7495 (1.0) 0.0000 (1.0) 0.7495 (1.0) 0.0000 (1.0) 0;0 1.3341 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.58.2] 2.0301 (1.59) 2.0301 (1.59) 2.0301 (1.59) 0.0000 (1.0) 2.0301 (1.59) 0.0000 (1.0) 0;0 0.4926 (0.63) 1 1 test_checkout_copy-checkout[3.10.0] 3.7961 (2.97) 3.7961 (2.97) 3.7961 (2.97) 0.0000 (1.0) 3.7961 (2.97) 0.0000 (1.0) 0;0 0.2634 (0.34) 1 1 test_checkout_copy-checkout[3.53.2] 1.5763 (1.23) 1.5763 (1.23) 1.5763 (1.23) 0.0000 (1.0) 1.5763 (1.23) 0.0000 (1.0) 0;0 0.6344 (0.81) 1 1 test_checkout_copy-checkout[main] 1.2802 (1.0) 1.2802 (1.0) 1.2802 (1.0) 0.0000 (1.0) 1.2802 (1.0) 0.0000 (1.0) 0;0 0.7812 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.58.2] 587.3695 (1.21) 587.3695 (1.21) 587.3695 (1.21) 0.0000 (1.0) 587.3695 (1.21) 0.0000 (1.0) 0;0 1.7025 (0.83) 1 1 test_checkout_copy-checkout-noop[3.10.0] 582.8824 (1.20) 582.8824 (1.20) 582.8824 (1.20) 0.0000 (1.0) 582.8824 (1.20) 0.0000 (1.0) 0;0 1.7156 (0.83) 1 1 test_checkout_copy-checkout-noop[3.53.2] 580.4251 (1.20) 580.4251 (1.20) 580.4251 (1.20) 0.0000 (1.0) 580.4251 (1.20) 0.0000 (1.0) 0;0 1.7229 (0.84) 1 1 test_checkout_copy-checkout-noop[main] 484.7332 (1.0) 484.7332 (1.0) 484.7332 (1.0) 0.0000 (1.0) 484.7332 (1.0) 0.0000 (1.0) 0;0 2.0630 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.58.2] 736.4041 (1.35) 736.4041 (1.35) 736.4041 (1.35) 0.0000 (1.0) 736.4041 (1.35) 0.0000 (1.0) 0;0 1.3580 (0.74) 1 1 test_checkout_copy-checkout-update[3.10.0] 637.9265 (1.17) 637.9265 (1.17) 637.9265 (1.17) 0.0000 (1.0) 637.9265 (1.17) 0.0000 (1.0) 0;0 1.5676 (0.85) 1 1 test_checkout_copy-checkout-update[3.53.2] 636.4483 (1.17) 636.4483 (1.17) 636.4483 (1.17) 0.0000 (1.0) 636.4483 (1.17) 0.0000 (1.0) 0;0 1.5712 (0.86) 1 1 test_checkout_copy-checkout-update[main] 544.9794 (1.0) 544.9794 (1.0) 544.9794 (1.0) 0.0000 (1.0) 544.9794 (1.0) 0.0000 (1.0) 0;0 1.8349 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.58.2] 1.2695 (1.71) 1.2695 (1.71) 1.2695 (1.71) 0.0000 (1.0) 1.2695 (1.71) 0.0000 (1.0) 0;0 0.7877 (0.59) 1 1 test_checkout_hardlink-checkout[3.10.0] 1.1010 (1.48) 1.1010 (1.48) 1.1010 (1.48) 0.0000 (1.0) 1.1010 (1.48) 0.0000 (1.0) 0;0 0.9083 (0.67) 1 1 test_checkout_hardlink-checkout[3.53.2] 1.0401 (1.40) 1.0401 (1.40) 1.0401 (1.40) 0.0000 (1.0) 1.0401 (1.40) 0.0000 (1.0) 0;0 0.9614 (0.71) 1 1 test_checkout_hardlink-checkout[main] 0.7428 (1.0) 0.7428 (1.0) 0.7428 (1.0) 0.0000 (1.0) 0.7428 (1.0) 0.0000 (1.0) 0;0 1.3462 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.58.2] 588.7348 (1.23) 588.7348 (1.23) 588.7348 (1.23) 0.0000 (1.0) 588.7348 (1.23) 0.0000 (1.0) 0;0 1.6986 (0.81) 1 1 test_checkout_hardlink-checkout-noop[3.10.0] 592.2725 (1.24) 592.2725 (1.24) 592.2725 (1.24) 0.0000 (1.0) 592.2725 (1.24) 0.0000 (1.0) 0;0 1.6884 (0.81) 1 1 test_checkout_hardlink-checkout-noop[3.53.2] 570.3752 (1.19) 570.3752 (1.19) 570.3752 (1.19) 0.0000 (1.0) 570.3752 (1.19) 0.0000 (1.0) 0;0 1.7532 (0.84) 1 1 test_checkout_hardlink-checkout-noop[main] 477.6612 (1.0) 477.6612 (1.0) 477.6612 (1.0) 0.0000 (1.0) 477.6612 (1.0) 0.0000 (1.0) 0;0 2.0935 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.58.2] 727.4028 (1.38) 727.4028 (1.38) 727.4028 (1.38) 0.0000 (1.0) 727.4028 (1.38) 0.0000 (1.0) 0;0 1.3748 (0.72) 1 1 test_checkout_hardlink-checkout-update[3.10.0] 637.8622 (1.21) 637.8622 (1.21) 637.8622 (1.21) 0.0000 (1.0) 637.8622 (1.21) 0.0000 (1.0) 0;0 1.5677 (0.83) 1 1 test_checkout_hardlink-checkout-update[3.53.2] 628.5787 (1.19) 628.5787 (1.19) 628.5787 (1.19) 0.0000 (1.0) 628.5787 (1.19) 0.0000 (1.0) 0;0 1.5909 (0.84) 1 1 test_checkout_hardlink-checkout-update[main] 527.0426 (1.0) 527.0426 (1.0) 527.0426 (1.0) 0.0000 (1.0) 527.0426 (1.0) 0.0000 (1.0) 0;0 1.8974 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.58.2] 1.3679 (1.54) 1.3679 (1.54) 1.3679 (1.54) 0.0000 (1.0) 1.3679 (1.54) 0.0000 (1.0) 0;0 0.7310 (0.65) 1 1 test_checkout_symlink-checkout[3.10.0] 1.2021 (1.36) 1.2021 (1.36) 1.2021 (1.36) 0.0000 (1.0) 1.2021 (1.36) 0.0000 (1.0) 0;0 0.8319 (0.74) 1 1 test_checkout_symlink-checkout[3.53.2] 1.1506 (1.30) 1.1506 (1.30) 1.1506 (1.30) 0.0000 (1.0) 1.1506 (1.30) 0.0000 (1.0) 0;0 0.8691 (0.77) 1 1 test_checkout_symlink-checkout[main] 0.8862 (1.0) 0.8862 (1.0) 0.8862 (1.0) 0.0000 (1.0) 0.8862 (1.0) 0.0000 (1.0) 0;0 1.1285 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.58.2] 620.7986 (1.18) 620.7986 (1.18) 620.7986 (1.18) 0.0000 (1.0) 620.7986 (1.18) 0.0000 (1.0) 0;0 1.6108 (0.85) 1 1 test_checkout_symlink-checkout-noop[3.10.0] 630.8744 (1.20) 630.8744 (1.20) 630.8744 (1.20) 0.0000 (1.0) 630.8744 (1.20) 0.0000 (1.0) 0;0 1.5851 (0.83) 1 1 test_checkout_symlink-checkout-noop[3.53.2] 602.3439 (1.15) 602.3439 (1.15) 602.3439 (1.15) 0.0000 (1.0) 602.3439 (1.15) 0.0000 (1.0) 0;0 1.6602 (0.87) 1 1 test_checkout_symlink-checkout-noop[main] 525.2003 (1.0) 525.2003 (1.0) 525.2003 (1.0) 0.0000 (1.0) 525.2003 (1.0) 0.0000 (1.0) 0;0 1.9040 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout-update[2.58.2] 832.2242 (1.38) 832.2242 (1.38) 832.2242 (1.38) 0.0000 (1.0) 832.2242 (1.38) 0.0000 (1.0) 0;0 1.2016 (0.73) 1 1 test_checkout_symlink-checkout-update[3.10.0] 725.6672 (1.20) 725.6672 (1.20) 725.6672 (1.20) 0.0000 (1.0) 725.6672 (1.20) 0.0000 (1.0) 0;0 1.3780 (0.83) 1 1 test_checkout_symlink-checkout-update[3.53.2] 706.0273 (1.17) 706.0273 (1.17) 706.0273 (1.17) 0.0000 (1.0) 706.0273 (1.17) 0.0000 (1.0) 0;0 1.4164 (0.86) 1 1 test_checkout_symlink-checkout-update[main] 605.2437 (1.0) 605.2437 (1.0) 605.2437 (1.0) 0.0000 (1.0) 605.2437 (1.0) 0.0000 (1.0) 0;0 1.6522 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.58.2] 668.8477 (1.29) 668.8477 (1.29) 668.8477 (1.29) 0.0000 (1.0) 668.8477 (1.29) 0.0000 (1.0) 0;0 1.4951 (0.77) 1 1 test_data_status-data-changed[3.10.0] 615.3018 (1.19) 615.3018 (1.19) 615.3018 (1.19) 0.0000 (1.0) 615.3018 (1.19) 0.0000 (1.0) 0;0 1.6252 (0.84) 1 1 test_data_status-data-changed[3.53.2] 625.7108 (1.21) 625.7108 (1.21) 625.7108 (1.21) 0.0000 (1.0) 625.7108 (1.21) 0.0000 (1.0) 0;0 1.5982 (0.83) 1 1 test_data_status-data-changed[main] 516.8506 (1.0) 516.8506 (1.0) 516.8506 (1.0) 0.0000 (1.0) 516.8506 (1.0) 0.0000 (1.0) 0;0 1.9348 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.58.2] 656.5066 (1.25) 656.5066 (1.25) 656.5066 (1.25) 0.0000 (1.0) 656.5066 (1.25) 0.0000 (1.0) 0;0 1.5232 (0.80) 1 1 test_data_status-data-changed-noop[3.10.0] 622.4583 (1.18) 622.4583 (1.18) 622.4583 (1.18) 0.0000 (1.0) 622.4583 (1.18) 0.0000 (1.0) 0;0 1.6065 (0.85) 1 1 test_data_status-data-changed-noop[3.53.2] 670.7626 (1.27) 670.7626 (1.27) 670.7626 (1.27) 0.0000 (1.0) 670.7626 (1.27) 0.0000 (1.0) 0;0 1.4908 (0.78) 1 1 test_data_status-data-changed-noop[main] 526.2003 (1.0) 526.2003 (1.0) 526.2003 (1.0) 0.0000 (1.0) 526.2003 (1.0) 0.0000 (1.0) 0;0 1.9004 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.58.2] 1.3517 (1.72) 1.3517 (1.72) 1.3517 (1.72) 0.0000 (1.0) 1.3517 (1.72) 0.0000 (1.0) 0;0 0.7398 (0.58) 1 1 test_data_status-data-new[3.10.0] 1.2829 (1.63) 1.2829 (1.63) 1.2829 (1.63) 0.0000 (1.0) 1.2829 (1.63) 0.0000 (1.0) 0;0 0.7795 (0.61) 1 1 test_data_status-data-new[3.53.2] 1.3315 (1.69) 1.3315 (1.69) 1.3315 (1.69) 0.0000 (1.0) 1.3315 (1.69) 0.0000 (1.0) 0;0 0.7511 (0.59) 1 1 test_data_status-data-new[main] 0.7879 (1.0) 0.7879 (1.0) 0.7879 (1.0) 0.0000 (1.0) 0.7879 (1.0) 0.0000 (1.0) 0;0 1.2693 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.58.2] 671.8592 (1.29) 671.8592 (1.29) 671.8592 (1.29) 0.0000 (1.0) 671.8592 (1.29) 0.0000 (1.0) 0;0 1.4884 (0.78) 1 1 test_data_status-data-noop[3.10.0] 621.1662 (1.19) 621.1662 (1.19) 621.1662 (1.19) 0.0000 (1.0) 621.1662 (1.19) 0.0000 (1.0) 0;0 1.6099 (0.84) 1 1 test_data_status-data-noop[3.53.2] 630.5585 (1.21) 630.5585 (1.21) 630.5585 (1.21) 0.0000 (1.0) 630.5585 (1.21) 0.0000 (1.0) 0;0 1.5859 (0.83) 1 1 test_data_status-data-noop[main] 520.7091 (1.0) 520.7091 (1.0) 520.7091 (1.0) 0.0000 (1.0) 520.7091 (1.0) 0.0000 (1.0) 0;0 1.9205 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.58.2] 1.1448 (1.15) 1.1448 (1.15) 1.1448 (1.15) 0.0000 (1.0) 1.1448 (1.15) 0.0000 (1.0) 0;0 0.8735 (0.87) 1 1 test_data_status_all_flags-data-changed[3.10.0] 1.1413 (1.14) 1.1413 (1.14) 1.1413 (1.14) 0.0000 (1.0) 1.1413 (1.14) 0.0000 (1.0) 0;0 0.8762 (0.87) 1 1 test_data_status_all_flags-data-changed[3.53.2] 1.0687 (1.07) 1.0687 (1.07) 1.0687 (1.07) 0.0000 (1.0) 1.0687 (1.07) 0.0000 (1.0) 0;0 0.9358 (0.93) 1 1 test_data_status_all_flags-data-changed[main] 0.9977 (1.0) 0.9977 (1.0) 0.9977 (1.0) 0.0000 (1.0) 0.9977 (1.0) 0.0000 (1.0) 0;0 1.0023 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.58.2] 1.1532 (1.17) 1.1532 (1.17) 1.1532 (1.17) 0.0000 (1.0) 1.1532 (1.17) 0.0000 (1.0) 0;0 0.8672 (0.86) 1 1 test_data_status_all_flags-data-changed-noop[3.10.0] 1.1242 (1.14) 1.1242 (1.14) 1.1242 (1.14) 0.0000 (1.0) 1.1242 (1.14) 0.0000 (1.0) 0;0 0.8895 (0.88) 1 1 test_data_status_all_flags-data-changed-noop[3.53.2] 1.0676 (1.08) 1.0676 (1.08) 1.0676 (1.08) 0.0000 (1.0) 1.0676 (1.08) 0.0000 (1.0) 0;0 0.9367 (0.93) 1 1 test_data_status_all_flags-data-changed-noop[main] 0.9885 (1.0) 0.9885 (1.0) 0.9885 (1.0) 0.0000 (1.0) 0.9885 (1.0) 0.0000 (1.0) 0;0 1.0117 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.58.2] 1.7868 (1.41) 1.7868 (1.41) 1.7868 (1.41) 0.0000 (1.0) 1.7868 (1.41) 0.0000 (1.0) 0;0 0.5597 (0.71) 1 1 test_data_status_all_flags-data-new[3.10.0] 1.7696 (1.39) 1.7696 (1.39) 1.7696 (1.39) 0.0000 (1.0) 1.7696 (1.39) 0.0000 (1.0) 0;0 0.5651 (0.72) 1 1 test_data_status_all_flags-data-new[3.53.2] 1.7529 (1.38) 1.7529 (1.38) 1.7529 (1.38) 0.0000 (1.0) 1.7529 (1.38) 0.0000 (1.0) 0;0 0.5705 (0.73) 1 1 test_data_status_all_flags-data-new[main] 1.2713 (1.0) 1.2713 (1.0) 1.2713 (1.0) 0.0000 (1.0) 1.2713 (1.0) 0.0000 (1.0) 0;0 0.7866 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.58.2] 1.0976 (1.12) 1.0976 (1.12) 1.0976 (1.12) 0.0000 (1.0) 1.0976 (1.12) 0.0000 (1.0) 0;0 0.9111 (0.90) 1 1 test_data_status_all_flags-data-noop[3.10.0] 1.1748 (1.20) 1.1748 (1.20) 1.1748 (1.20) 0.0000 (1.0) 1.1748 (1.20) 0.0000 (1.0) 0;0 0.8512 (0.84) 1 1 test_data_status_all_flags-data-noop[3.53.2] 1.1023 (1.12) 1.1023 (1.12) 1.1023 (1.12) 0.0000 (1.0) 1.1023 (1.12) 0.0000 (1.0) 0;0 0.9072 (0.89) 1 1 test_data_status_all_flags-data-noop[main] 0.9826 (1.0) 0.9826 (1.0) 0.9826 (1.0) 0.0000 (1.0) 0.9826 (1.0) 0.0000 (1.0) 0;0 1.0177 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.58.2] 1.3376 (1.55) 1.3376 (1.55) 1.3376 (1.55) 0.0000 (1.0) 1.3376 (1.55) 0.0000 (1.0) 0;0 0.7476 (0.64) 1 1 test_diff-diff[3.10.0] 1.4725 (1.71) 1.4725 (1.71) 1.4725 (1.71) 0.0000 (1.0) 1.4725 (1.71) 0.0000 (1.0) 0;0 0.6791 (0.58) 1 1 test_diff-diff[3.53.2] 1.2915 (1.50) 1.2915 (1.50) 1.2915 (1.50) 0.0000 (1.0) 1.2915 (1.50) 0.0000 (1.0) 0;0 0.7743 (0.67) 1 1 test_diff-diff[main] 0.8607 (1.0) 0.8607 (1.0) 0.8607 (1.0) 0.0000 (1.0) 0.8607 (1.0) 0.0000 (1.0) 0;0 1.1619 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.58.2] 707.5660 (1.24) 707.5660 (1.24) 707.5660 (1.24) 0.0000 (1.0) 707.5660 (1.24) 0.0000 (1.0) 0;0 1.4133 (0.81) 1 1 test_diff-diff-changed[3.10.0] 722.0096 (1.26) 722.0096 (1.26) 722.0096 (1.26) 0.0000 (1.0) 722.0096 (1.26) 0.0000 (1.0) 0;0 1.3850 (0.79) 1 1 test_diff-diff-changed[3.53.2] 659.8504 (1.15) 659.8504 (1.15) 659.8504 (1.15) 0.0000 (1.0) 659.8504 (1.15) 0.0000 (1.0) 0;0 1.5155 (0.87) 1 1 test_diff-diff-changed[main] 571.9255 (1.0) 571.9255 (1.0) 571.9255 (1.0) 0.0000 (1.0) 571.9255 (1.0) 0.0000 (1.0) 0;0 1.7485 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.58.2] 681.6250 (1.16) 681.6250 (1.16) 681.6250 (1.16) 0.0000 (1.0) 681.6250 (1.16) 0.0000 (1.0) 0;0 1.4671 (0.86) 1 1 test_diff-diff-changed-noop[3.10.0] 682.7237 (1.16) 682.7237 (1.16) 682.7237 (1.16) 0.0000 (1.0) 682.7237 (1.16) 0.0000 (1.0) 0;0 1.4647 (0.86) 1 1 test_diff-diff-changed-noop[3.53.2] 654.5224 (1.12) 654.5224 (1.12) 654.5224 (1.12) 0.0000 (1.0) 654.5224 (1.12) 0.0000 (1.0) 0;0 1.5278 (0.90) 1 1 test_diff-diff-changed-noop[main] 586.5095 (1.0) 586.5095 (1.0) 586.5095 (1.0) 0.0000 (1.0) 586.5095 (1.0) 0.0000 (1.0) 0;0 1.7050 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.58.2] 662.7892 (1.15) 662.7892 (1.15) 662.7892 (1.15) 0.0000 (1.0) 662.7892 (1.15) 0.0000 (1.0) 0;0 1.5088 (0.87) 1 1 test_diff-diff-noop[3.10.0] 658.5028 (1.15) 658.5028 (1.15) 658.5028 (1.15) 0.0000 (1.0) 658.5028 (1.15) 0.0000 (1.0) 0;0 1.5186 (0.87) 1 1 test_diff-diff-noop[3.53.2] 650.5019 (1.13) 650.5019 (1.13) 650.5019 (1.13) 0.0000 (1.0) 650.5019 (1.13) 0.0000 (1.0) 0;0 1.5373 (0.88) 1 1 test_diff-diff-noop[main] 574.4189 (1.0) 574.4189 (1.0) 574.4189 (1.0) 0.0000 (1.0) 574.4189 (1.0) 0.0000 (1.0) 0;0 1.7409 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------------- benchmark 'test_exp_show-exp': 4 tests ---------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_exp_show-exp[2.58.2] 944.3221 (1.0) 944.3221 (1.0) 944.3221 (1.0) 0.0000 (1.0) 944.3221 (1.0) 0.0000 (1.0) 0;0 1.0590 (1.0) 1 1 test_exp_show-exp[3.10.0] 14,942.4103 (15.82) 14,942.4103 (15.82) 14,942.4103 (15.82) 0.0000 (1.0) 14,942.4103 (15.82) 0.0000 (1.0) 0;0 0.0669 (0.06) 1 1 test_exp_show-exp[3.53.2] 10,359.0660 (10.97) 10,359.0660 (10.97) 10,359.0660 (10.97) 0.0000 (1.0) 10,359.0660 (10.97) 0.0000 (1.0) 0;0 0.0965 (0.09) 1 1 test_exp_show-exp[main] 11,055.4963 (11.71) 11,055.4963 (11.71) 11,055.4963 (11.71) 0.0000 (1.0) 11,055.4963 (11.71) 0.0000 (1.0) 0;0 0.0905 (0.09) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_fetch-fetch[2.58.2] 3.9218 (2.73) 3.9218 (2.73) 3.9218 (2.73) 0.0000 (1.0) 3.9218 (2.73) 0.0000 (1.0) 0;0 0.2550 (0.37) 1 1 test_fetch-fetch[3.10.0] 4.3092 (3.00) 4.3092 (3.00) 4.3092 (3.00) 0.0000 (1.0) 4.3092 (3.00) 0.0000 (1.0) 0;0 0.2321 (0.33) 1 1 test_fetch-fetch[3.53.2] 1.8004 (1.25) 1.8004 (1.25) 1.8004 (1.25) 0.0000 (1.0) 1.8004 (1.25) 0.0000 (1.0) 0;0 0.5554 (0.80) 1 1 test_fetch-fetch[main] 1.4372 (1.0) 1.4372 (1.0) 1.4372 (1.0) 0.0000 (1.0) 1.4372 (1.0) 0.0000 (1.0) 0;0 0.6958 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.58.2] 504.3831 (1.01) 504.3831 (1.01) 504.3831 (1.01) 0.0000 (1.0) 504.3831 (1.01) 0.0000 (1.0) 0;0 1.9826 (0.99) 1 1 test_gc-gc[3.10.0] 523.4765 (1.05) 523.4765 (1.05) 523.4765 (1.05) 0.0000 (1.0) 523.4765 (1.05) 0.0000 (1.0) 0;0 1.9103 (0.95) 1 1 test_gc-gc[3.53.2] 502.5237 (1.01) 502.5237 (1.01) 502.5237 (1.01) 0.0000 (1.0) 502.5237 (1.01) 0.0000 (1.0) 0;0 1.9900 (0.99) 1 1 test_gc-gc[main] 499.0643 (1.0) 499.0643 (1.0) 499.0643 (1.0) 0.0000 (1.0) 499.0643 (1.0) 0.0000 (1.0) 0;0 2.0037 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.58.2] 5.6824 (1.15) 5.6824 (1.15) 5.6824 (1.15) 0.0000 (1.0) 5.6824 (1.15) 0.0000 (1.0) 0;0 0.1760 (0.87) 1 1 test_get-get[3.10.0] 6.7537 (1.37) 6.7537 (1.37) 6.7537 (1.37) 0.0000 (1.0) 6.7537 (1.37) 0.0000 (1.0) 0;0 0.1481 (0.73) 1 1 test_get-get[3.53.2] 4.9539 (1.00) 4.9539 (1.00) 4.9539 (1.00) 0.0000 (1.0) 4.9539 (1.00) 0.0000 (1.0) 0;0 0.2019 (1.00) 1 1 test_get-get[main] 4.9382 (1.0) 4.9382 (1.0) 4.9382 (1.0) 0.0000 (1.0) 4.9382 (1.0) 0.0000 (1.0) 0;0 0.2025 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.58.2] 3.0116 (3.24) 3.0116 (3.24) 3.0116 (3.24) 0.0000 (1.0) 3.0116 (3.24) 0.0000 (1.0) 0;0 0.3320 (0.31) 1 1 test_get_url-get-url[3.10.0] 3.2085 (3.46) 3.2085 (3.46) 3.2085 (3.46) 0.0000 (1.0) 3.2085 (3.46) 0.0000 (1.0) 0;0 0.3117 (0.29) 1 1 test_get_url-get-url[3.53.2] 0.9560 (1.03) 0.9560 (1.03) 0.9560 (1.03) 0.0000 (1.0) 0.9560 (1.03) 0.0000 (1.0) 0;0 1.0460 (0.97) 1 1 test_get_url-get-url[main] 0.9286 (1.0) 0.9286 (1.0) 0.9286 (1.0) 0.0000 (1.0) 0.9286 (1.0) 0.0000 (1.0) 0;0 1.0769 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.58.2] 125.4178 (1.01) 139.2256 (1.02) 128.9884 (1.00) 2.2634 (1.17) 128.7105 (1.0) 2.4399 (1.14) 26;4 7.7526 (1.00) 100 1 test_help---help[3.10.0] 123.6430 (1.0) 136.3569 (1.00) 128.6833 (1.0) 2.0836 (1.08) 128.8804 (1.00) 2.6721 (1.25) 28;1 7.7710 (1.0) 100 1 test_help---help[3.53.2] 125.3722 (1.01) 135.9330 (1.0) 129.0628 (1.00) 1.9331 (1.0) 128.7835 (1.00) 2.1575 (1.01) 24;4 7.7482 (1.00) 100 1 test_help---help[main] 126.6298 (1.02) 144.5702 (1.06) 130.1725 (1.01) 2.5541 (1.32) 129.8517 (1.01) 2.1462 (1.0) 13;4 7.6821 (0.99) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.58.2] 9.3252 (1.0) 9.3252 (1.0) 9.3252 (1.0) 0.0000 (1.0) 9.3252 (1.0) 0.0000 (1.0) 0;0 0.1072 (1.0) 1 1 test_import-import[3.10.0] 9.9919 (1.07) 9.9919 (1.07) 9.9919 (1.07) 0.0000 (1.0) 9.9919 (1.07) 0.0000 (1.0) 0;0 0.1001 (0.93) 1 1 test_import-import[3.53.2] 12.9510 (1.39) 12.9510 (1.39) 12.9510 (1.39) 0.0000 (1.0) 12.9510 (1.39) 0.0000 (1.0) 0;0 0.0772 (0.72) 1 1 test_import-import[main] 9.7156 (1.04) 9.7156 (1.04) 9.7156 (1.04) 0.0000 (1.0) 9.7156 (1.04) 0.0000 (1.0) 0;0 0.1029 (0.96) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.58.2] 7.5411 (3.05) 7.5411 (3.05) 7.5411 (3.05) 0.0000 (1.0) 7.5411 (3.05) 0.0000 (1.0) 0;0 0.1326 (0.33) 1 1 test_import_url-import-url[3.10.0] 7.5607 (3.06) 7.5607 (3.06) 7.5607 (3.06) 0.0000 (1.0) 7.5607 (3.06) 0.0000 (1.0) 0;0 0.1323 (0.33) 1 1 test_import_url-import-url[3.53.2] 4.7223 (1.91) 4.7223 (1.91) 4.7223 (1.91) 0.0000 (1.0) 4.7223 (1.91) 0.0000 (1.0) 0;0 0.2118 (0.52) 1 1 test_import_url-import-url[main] 2.4746 (1.0) 2.4746 (1.0) 2.4746 (1.0) 0.0000 (1.0) 2.4746 (1.0) 0.0000 (1.0) 0;0 0.4041 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.58.2] 401.6148 (1.0) 455.8628 (1.03) 416.1130 (1.0) 7.0438 (1.11) 415.2537 (1.0) 7.5513 (1.0) 22;2 2.4032 (1.0) 100 1 test_init-init[3.10.0] 416.4241 (1.04) 471.9842 (1.07) 429.8440 (1.03) 7.2175 (1.14) 429.0481 (1.03) 8.0490 (1.07) 19;3 2.3264 (0.97) 100 1 test_init-init[3.53.2] 404.8597 (1.01) 462.0632 (1.04) 419.6920 (1.01) 8.6759 (1.37) 418.7417 (1.01) 11.1741 (1.48) 29;1 2.3827 (0.99) 100 1 test_init-init[main] 407.5269 (1.01) 442.2225 (1.0) 418.8731 (1.01) 6.3249 (1.0) 418.2833 (1.01) 8.2893 (1.10) 31;2 2.3874 (0.99) 100 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.58.2] 445.4824 (1.07) 445.4824 (1.07) 445.4824 (1.07) 0.0000 (1.0) 445.4824 (1.07) 0.0000 (1.0) 0;0 2.2448 (0.93) 1 1 test_list-list[3.10.0] 467.0566 (1.13) 467.0566 (1.13) 467.0566 (1.13) 0.0000 (1.0) 467.0566 (1.13) 0.0000 (1.0) 0;0 2.1411 (0.89) 1 1 test_list-list[3.53.2] 414.9011 (1.0) 414.9011 (1.0) 414.9011 (1.0) 0.0000 (1.0) 414.9011 (1.0) 0.0000 (1.0) 0;0 2.4102 (1.0) 1 1 test_list-list[main] 423.0270 (1.02) 423.0270 (1.02) 423.0270 (1.02) 0.0000 (1.0) 423.0270 (1.02) 0.0000 (1.0) 0;0 2.3639 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.58.2] 464.0538 (1.14) 464.0538 (1.14) 464.0538 (1.14) 0.0000 (1.0) 464.0538 (1.14) 0.0000 (1.0) 0;0 2.1549 (0.88) 1 1 test_list-list-dvc-only[3.10.0] 443.5594 (1.09) 443.5594 (1.09) 443.5594 (1.09) 0.0000 (1.0) 443.5594 (1.09) 0.0000 (1.0) 0;0 2.2545 (0.92) 1 1 test_list-list-dvc-only[3.53.2] 408.6248 (1.0) 408.6248 (1.0) 408.6248 (1.0) 0.0000 (1.0) 408.6248 (1.0) 0.0000 (1.0) 0;0 2.4472 (1.0) 1 1 test_list-list-dvc-only[main] 410.8702 (1.01) 410.8702 (1.01) 410.8702 (1.01) 0.0000 (1.0) 410.8702 (1.01) 0.0000 (1.0) 0;0 2.4339 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.58.2] 537.5412 (1.10) 537.5412 (1.10) 537.5412 (1.10) 0.0000 (1.0) 537.5412 (1.10) 0.0000 (1.0) 0;0 1.8603 (0.91) 1 1 test_list-list-recursive[3.10.0] 536.8130 (1.10) 536.8130 (1.10) 536.8130 (1.10) 0.0000 (1.0) 536.8130 (1.10) 0.0000 (1.0) 0;0 1.8628 (0.91) 1 1 test_list-list-recursive[3.53.2] 490.1103 (1.0) 490.1103 (1.0) 490.1103 (1.0) 0.0000 (1.0) 490.1103 (1.0) 0.0000 (1.0) 0;0 2.0404 (1.0) 1 1 test_list-list-recursive[main] 491.8526 (1.00) 491.8526 (1.00) 491.8526 (1.00) 0.0000 (1.0) 491.8526 (1.00) 0.0000 (1.0) 0;0 2.0331 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.58.2] 448.1581 (1.08) 448.1581 (1.08) 448.1581 (1.08) 0.0000 (1.0) 448.1581 (1.08) 0.0000 (1.0) 0;0 2.2314 (0.93) 1 1 test_list-list-shallow[3.10.0] 464.5402 (1.12) 464.5402 (1.12) 464.5402 (1.12) 0.0000 (1.0) 464.5402 (1.12) 0.0000 (1.0) 0;0 2.1527 (0.89) 1 1 test_list-list-shallow[3.53.2] 436.9704 (1.05) 436.9704 (1.05) 436.9704 (1.05) 0.0000 (1.0) 436.9704 (1.05) 0.0000 (1.0) 0;0 2.2885 (0.95) 1 1 test_list-list-shallow[main] 415.6249 (1.0) 415.6249 (1.0) 415.6249 (1.0) 0.0000 (1.0) 415.6249 (1.0) 0.0000 (1.0) 0;0 2.4060 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add[2.58.2] 2.0773 (1.91) 2.0773 (1.91) 2.0773 (1.91) 0.0000 (1.0) 2.0773 (1.91) 0.0000 (1.0) 0;0 0.4814 (0.52) 1 1 test_partial_add-add[3.10.0] 2.1313 (1.96) 2.1313 (1.96) 2.1313 (1.96) 0.0000 (1.0) 2.1313 (1.96) 0.0000 (1.0) 0;0 0.4692 (0.51) 1 1 test_partial_add-add[3.53.2] 1.8860 (1.74) 1.8860 (1.74) 1.8860 (1.74) 0.0000 (1.0) 1.8860 (1.74) 0.0000 (1.0) 0;0 0.5302 (0.58) 1 1 test_partial_add-add[main] 1.0869 (1.0) 1.0869 (1.0) 1.0869 (1.0) 0.0000 (1.0) 1.0869 (1.0) 0.0000 (1.0) 0;0 0.9200 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial[2.58.2] 3.2755 (2.73) 3.2755 (2.73) 3.2755 (2.73) 0.0000 (1.0) 3.2755 (2.73) 0.0000 (1.0) 0;0 0.3053 (0.37) 1 1 test_partial_add-add-partial[3.10.0] 2.9990 (2.50) 2.9990 (2.50) 2.9990 (2.50) 0.0000 (1.0) 2.9990 (2.50) 0.0000 (1.0) 0;0 0.3334 (0.40) 1 1 test_partial_add-add-partial[3.53.2] 2.7469 (2.29) 2.7469 (2.29) 2.7469 (2.29) 0.0000 (1.0) 2.7469 (2.29) 0.0000 (1.0) 0;0 0.3640 (0.44) 1 1 test_partial_add-add-partial[main] 1.1978 (1.0) 1.1978 (1.0) 1.1978 (1.0) 0.0000 (1.0) 1.1978 (1.0) 0.0000 (1.0) 0;0 0.8348 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.58.2] 602.6187 (1.0) 602.6187 (1.0) 602.6187 (1.0) 0.0000 (1.0) 602.6187 (1.0) 0.0000 (1.0) 0;0 1.6594 (1.0) 1 1 test_partial_add-gc-cloud-noop[3.10.0] 614.7846 (1.02) 614.7846 (1.02) 614.7846 (1.02) 0.0000 (1.0) 614.7846 (1.02) 0.0000 (1.0) 0;0 1.6266 (0.98) 1 1 test_partial_add-gc-cloud-noop[3.53.2] 637.3018 (1.06) 637.3018 (1.06) 637.3018 (1.06) 0.0000 (1.0) 637.3018 (1.06) 0.0000 (1.0) 0;0 1.5691 (0.95) 1 1 test_partial_add-gc-cloud-noop[main] 694.1135 (1.15) 694.1135 (1.15) 694.1135 (1.15) 0.0000 (1.0) 694.1135 (1.15) 0.0000 (1.0) 0;0 1.4407 (0.87) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.58.2] 500.5362 (1.0) 500.5362 (1.0) 500.5362 (1.0) 0.0000 (1.0) 500.5362 (1.0) 0.0000 (1.0) 0;0 1.9979 (1.0) 1 1 test_partial_add-gc-noop[3.10.0] 541.3849 (1.08) 541.3849 (1.08) 541.3849 (1.08) 0.0000 (1.0) 541.3849 (1.08) 0.0000 (1.0) 0;0 1.8471 (0.92) 1 1 test_partial_add-gc-noop[3.53.2] 532.4027 (1.06) 532.4027 (1.06) 532.4027 (1.06) 0.0000 (1.0) 532.4027 (1.06) 0.0000 (1.0) 0;0 1.8783 (0.94) 1 1 test_partial_add-gc-noop[main] 602.8956 (1.20) 602.8956 (1.20) 602.8956 (1.20) 0.0000 (1.0) 602.8956 (1.20) 0.0000 (1.0) 0;0 1.6587 (0.83) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push[2.58.2] 1.9233 (1.68) 1.9233 (1.68) 1.9233 (1.68) 0.0000 (1.0) 1.9233 (1.68) 0.0000 (1.0) 0;0 0.5199 (0.59) 1 1 test_partial_add-push[3.10.0] 1.1570 (1.01) 1.1570 (1.01) 1.1570 (1.01) 0.0000 (1.0) 1.1570 (1.01) 0.0000 (1.0) 0;0 0.8643 (0.99) 1 1 test_partial_add-push[3.53.2] 1.1416 (1.0) 1.1416 (1.0) 1.1416 (1.0) 0.0000 (1.0) 1.1416 (1.0) 0.0000 (1.0) 0;0 0.8760 (1.0) 1 1 test_partial_add-push[main] 1.1805 (1.03) 1.1805 (1.03) 1.1805 (1.03) 0.0000 (1.0) 1.1805 (1.03) 0.0000 (1.0) 0;0 0.8471 (0.97) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial[2.58.2] 1.9816 (1.61) 1.9816 (1.61) 1.9816 (1.61) 0.0000 (1.0) 1.9816 (1.61) 0.0000 (1.0) 0;0 0.5047 (0.62) 1 1 test_partial_add-push-partial[3.10.0] 1.2317 (1.0) 1.2317 (1.0) 1.2317 (1.0) 0.0000 (1.0) 1.2317 (1.0) 0.0000 (1.0) 0;0 0.8119 (1.0) 1 1 test_partial_add-push-partial[3.53.2] 1.2925 (1.05) 1.2925 (1.05) 1.2925 (1.05) 0.0000 (1.0) 1.2925 (1.05) 0.0000 (1.0) 0;0 0.7737 (0.95) 1 1 test_partial_add-push-partial[main] 1.3129 (1.07) 1.3129 (1.07) 1.3129 (1.07) 0.0000 (1.0) 1.3129 (1.07) 0.0000 (1.0) 0;0 0.7617 (0.94) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.58.2] 3.6041 (2.44) 3.6041 (2.44) 3.6041 (2.44) 0.0000 (1.0) 3.6041 (2.44) 0.0000 (1.0) 0;0 0.2775 (0.41) 1 1 test_partial_remove-add[3.10.0] 3.5212 (2.39) 3.5212 (2.39) 3.5212 (2.39) 0.0000 (1.0) 3.5212 (2.39) 0.0000 (1.0) 0;0 0.2840 (0.42) 1 1 test_partial_remove-add[3.53.2] 3.3118 (2.25) 3.3118 (2.25) 3.3118 (2.25) 0.0000 (1.0) 3.3118 (2.25) 0.0000 (1.0) 0;0 0.3020 (0.45) 1 1 test_partial_remove-add[main] 1.4751 (1.0) 1.4751 (1.0) 1.4751 (1.0) 0.0000 (1.0) 1.4751 (1.0) 0.0000 (1.0) 0;0 0.6779 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add-update[2.58.2] 1.5084 (2.50) 1.5084 (2.50) 1.5084 (2.50) 0.0000 (1.0) 1.5084 (2.50) 0.0000 (1.0) 0;0 0.6630 (0.40) 1 1 test_partial_remove-add-update[3.10.0] 1.4731 (2.44) 1.4731 (2.44) 1.4731 (2.44) 0.0000 (1.0) 1.4731 (2.44) 0.0000 (1.0) 0;0 0.6788 (0.41) 1 1 test_partial_remove-add-update[3.53.2] 1.3234 (2.19) 1.3234 (2.19) 1.3234 (2.19) 0.0000 (1.0) 1.3234 (2.19) 0.0000 (1.0) 0;0 0.7556 (0.46) 1 1 test_partial_remove-add-update[main] 0.6036 (1.0) 0.6036 (1.0) 0.6036 (1.0) 0.0000 (1.0) 0.6036 (1.0) 0.0000 (1.0) 0;0 1.6569 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.58.2] 512.2271 (1.0) 512.2271 (1.0) 512.2271 (1.0) 0.0000 (1.0) 512.2271 (1.0) 0.0000 (1.0) 0;0 1.9523 (1.0) 1 1 test_partial_remove-gc[3.10.0] 542.3741 (1.06) 542.3741 (1.06) 542.3741 (1.06) 0.0000 (1.0) 542.3741 (1.06) 0.0000 (1.0) 0;0 1.8437 (0.94) 1 1 test_partial_remove-gc[3.53.2] 526.7713 (1.03) 526.7713 (1.03) 526.7713 (1.03) 0.0000 (1.0) 526.7713 (1.03) 0.0000 (1.0) 0;0 1.8984 (0.97) 1 1 test_partial_remove-gc[main] 526.1646 (1.03) 526.1646 (1.03) 526.1646 (1.03) 0.0000 (1.0) 526.1646 (1.03) 0.0000 (1.0) 0;0 1.9005 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.58.2] 579.2536 (1.0) 579.2536 (1.0) 579.2536 (1.0) 0.0000 (1.0) 579.2536 (1.0) 0.0000 (1.0) 0;0 1.7264 (1.0) 1 1 test_partial_remove-gc-cloud[3.10.0] 591.3728 (1.02) 591.3728 (1.02) 591.3728 (1.02) 0.0000 (1.0) 591.3728 (1.02) 0.0000 (1.0) 0;0 1.6910 (0.98) 1 1 test_partial_remove-gc-cloud[3.53.2] 598.0389 (1.03) 598.0389 (1.03) 598.0389 (1.03) 0.0000 (1.0) 598.0389 (1.03) 0.0000 (1.0) 0;0 1.6721 (0.97) 1 1 test_partial_remove-gc-cloud[main] 596.2381 (1.03) 596.2381 (1.03) 596.2381 (1.03) 0.0000 (1.0) 596.2381 (1.03) 0.0000 (1.0) 0;0 1.6772 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.58.2] 3.3974 (2.35) 3.3974 (2.35) 3.3974 (2.35) 0.0000 (1.0) 3.3974 (2.35) 0.0000 (1.0) 0;0 0.2943 (0.43) 1 1 test_partial_remove-push[3.10.0] 1.8823 (1.30) 1.8823 (1.30) 1.8823 (1.30) 0.0000 (1.0) 1.8823 (1.30) 0.0000 (1.0) 0;0 0.5313 (0.77) 1 1 test_partial_remove-push[3.53.2] 1.4926 (1.03) 1.4926 (1.03) 1.4926 (1.03) 0.0000 (1.0) 1.4926 (1.03) 0.0000 (1.0) 0;0 0.6700 (0.97) 1 1 test_partial_remove-push[main] 1.4469 (1.0) 1.4469 (1.0) 1.4469 (1.0) 0.0000 (1.0) 1.4469 (1.0) 0.0000 (1.0) 0;0 0.6911 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push-update[2.58.2] 519.4161 (1.03) 519.4161 (1.03) 519.4161 (1.03) 0.0000 (1.0) 519.4161 (1.03) 0.0000 (1.0) 0;0 1.9252 (0.97) 1 1 test_partial_remove-push-update[3.10.0] 505.2519 (1.0) 505.2519 (1.0) 505.2519 (1.0) 0.0000 (1.0) 505.2519 (1.0) 0.0000 (1.0) 0;0 1.9792 (1.0) 1 1 test_partial_remove-push-update[3.53.2] 849.0796 (1.68) 849.0796 (1.68) 849.0796 (1.68) 0.0000 (1.0) 849.0796 (1.68) 0.0000 (1.0) 0;0 1.1777 (0.60) 1 1 test_partial_remove-push-update[main] 823.0641 (1.63) 823.0641 (1.63) 823.0641 (1.63) 0.0000 (1.0) 823.0641 (1.63) 0.0000 (1.0) 0;0 1.2150 (0.61) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.58.2] 457.2686 (1.0) 473.3643 (1.0) 463.5412 (1.0) 6.6505 (2.21) 461.3414 (1.0) 10.3279 (2.44) 1;0 2.1573 (1.0) 5 3 test_plots-plots-diff[3.10.0] 816.8275 (1.79) 824.1720 (1.74) 821.5842 (1.77) 3.0033 (1.0) 822.1108 (1.78) 4.2386 (1.0) 1;0 1.2172 (0.56) 5 3 test_plots-plots-diff[3.53.2] 776.4773 (1.70) 786.7952 (1.66) 781.5293 (1.69) 4.8654 (1.62) 780.7678 (1.69) 9.3467 (2.21) 2;0 1.2795 (0.59) 5 3 test_plots-plots-diff[main] 779.8177 (1.71) 795.1433 (1.68) 784.8339 (1.69) 6.3899 (2.13) 782.8224 (1.70) 8.8566 (2.09) 1;0 1.2742 (0.59) 5 3 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.58.2] 471.4774 (1.0) 489.4333 (1.0) 477.7052 (1.0) 6.8608 (4.65) 475.6570 (1.0) 5.9088 (2.38) 1;1 2.0933 (1.0) 5 3 test_plots-plots-diff-json[3.10.0] 1,045.8897 (2.22) 1,049.3205 (2.14) 1,047.7884 (2.19) 1.4749 (1.0) 1,047.4245 (2.20) 2.4837 (1.0) 2;0 0.9544 (0.46) 5 3 test_plots-plots-diff-json[3.53.2] 849.7233 (1.80) 855.6333 (1.75) 851.5051 (1.78) 2.4151 (1.64) 850.4454 (1.79) 2.6209 (1.06) 1;0 1.1744 (0.56) 5 3 test_plots-plots-diff-json[main] 850.9593 (1.80) 859.2201 (1.76) 855.3605 (1.79) 3.1566 (2.14) 856.0943 (1.80) 4.4446 (1.79) 2;0 1.1691 (0.56) 5 3 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show[2.58.2] 420.1710 (1.0) 429.1993 (1.0) 425.0670 (1.0) 4.2131 (1.93) 426.9352 (1.0) 7.6503 (3.96) 1;0 2.3526 (1.0) 5 3 test_plots-plots-show[3.10.0] 674.0744 (1.60) 687.3573 (1.60) 678.8567 (1.60) 5.4219 (2.49) 676.9416 (1.59) 7.7148 (4.00) 1;0 1.4731 (0.63) 5 3 test_plots-plots-show[3.53.2] 648.8718 (1.54) 656.6160 (1.53) 652.1353 (1.53) 2.9356 (1.35) 651.8522 (1.53) 3.8415 (1.99) 2;0 1.5334 (0.65) 5 3 test_plots-plots-show[main] 648.4852 (1.54) 654.4857 (1.52) 651.9822 (1.53) 2.1789 (1.0) 652.2929 (1.53) 1.9297 (1.0) 2;0 1.5338 (0.65) 5 3 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.58.2] 438.5140 (1.0) 443.7984 (1.0) 440.4178 (1.0) 2.0763 (1.0) 439.8657 (1.0) 2.6017 (1.0) 1;0 2.2706 (1.0) 5 3 test_plots-plots-show-json[3.10.0] 796.2032 (1.82) 808.4807 (1.82) 802.6523 (1.82) 4.9816 (2.40) 802.8314 (1.83) 8.2193 (3.16) 2;0 1.2459 (0.55) 5 3 test_plots-plots-show-json[3.53.2] 690.2184 (1.57) 703.1408 (1.58) 695.3073 (1.58) 5.1601 (2.49) 696.0208 (1.58) 7.0189 (2.70) 1;0 1.4382 (0.63) 5 3 test_plots-plots-show-json[main] 694.3597 (1.58) 709.9465 (1.60) 702.2457 (1.59) 6.6032 (3.18) 699.6119 (1.59) 10.7713 (4.14) 2;0 1.4240 (0.63) 5 3 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.58.2] 3.4400 (2.32) 3.4400 (2.32) 3.4400 (2.32) 0.0000 (1.0) 3.4400 (2.32) 0.0000 (1.0) 0;0 0.2907 (0.43) 1 1 test_push-push[3.10.0] 1.9075 (1.29) 1.9075 (1.29) 1.9075 (1.29) 0.0000 (1.0) 1.9075 (1.29) 0.0000 (1.0) 0;0 0.5242 (0.78) 1 1 test_push-push[3.53.2] 1.4836 (1.0) 1.4836 (1.0) 1.4836 (1.0) 0.0000 (1.0) 1.4836 (1.0) 0.0000 (1.0) 0;0 0.6740 (1.0) 1 1 test_push-push[main] 1.5051 (1.01) 1.5051 (1.01) 1.5051 (1.01) 0.0000 (1.0) 1.5051 (1.01) 0.0000 (1.0) 0;0 0.6644 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.58.2] 3.5654 (2.46) 3.5654 (2.46) 3.5654 (2.46) 0.0000 (1.0) 3.5654 (2.46) 0.0000 (1.0) 0;0 0.2805 (0.41) 1 1 test_sharing-add[3.10.0] 3.4291 (2.37) 3.4291 (2.37) 3.4291 (2.37) 0.0000 (1.0) 3.4291 (2.37) 0.0000 (1.0) 0;0 0.2916 (0.42) 1 1 test_sharing-add[3.53.2] 3.0929 (2.14) 3.0929 (2.14) 3.0929 (2.14) 0.0000 (1.0) 3.0929 (2.14) 0.0000 (1.0) 0;0 0.3233 (0.47) 1 1 test_sharing-add[main] 1.4486 (1.0) 1.4486 (1.0) 1.4486 (1.0) 0.0000 (1.0) 1.4486 (1.0) 0.0000 (1.0) 0;0 0.6903 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.58.2] 2.4713 (3.82) 2.4713 (3.82) 2.4713 (3.82) 0.0000 (1.0) 2.4713 (3.82) 0.0000 (1.0) 0;0 0.4047 (0.26) 1 1 test_sharing-add-noop[3.10.0] 2.4322 (3.76) 2.4322 (3.76) 2.4322 (3.76) 0.0000 (1.0) 2.4322 (3.76) 0.0000 (1.0) 0;0 0.4111 (0.27) 1 1 test_sharing-add-noop[3.53.2] 2.1284 (3.29) 2.1284 (3.29) 2.1284 (3.29) 0.0000 (1.0) 2.1284 (3.29) 0.0000 (1.0) 0;0 0.4698 (0.30) 1 1 test_sharing-add-noop[main] 0.6462 (1.0) 0.6462 (1.0) 0.6462 (1.0) 0.0000 (1.0) 0.6462 (1.0) 0.0000 (1.0) 0;0 1.5476 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout[2.58.2] 1.8168 (1.66) 1.8168 (1.66) 1.8168 (1.66) 0.0000 (1.0) 1.8168 (1.66) 0.0000 (1.0) 0;0 0.5504 (0.60) 1 1 test_sharing-checkout[3.10.0] 3.6129 (3.29) 3.6129 (3.29) 3.6129 (3.29) 0.0000 (1.0) 3.6129 (3.29) 0.0000 (1.0) 0;0 0.2768 (0.30) 1 1 test_sharing-checkout[3.53.2] 1.3306 (1.21) 1.3306 (1.21) 1.3306 (1.21) 0.0000 (1.0) 1.3306 (1.21) 0.0000 (1.0) 0;0 0.7515 (0.82) 1 1 test_sharing-checkout[main] 1.0967 (1.0) 1.0967 (1.0) 1.0967 (1.0) 0.0000 (1.0) 1.0967 (1.0) 0.0000 (1.0) 0;0 0.9119 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.58.2] 582.2717 (1.23) 582.2717 (1.23) 582.2717 (1.23) 0.0000 (1.0) 582.2717 (1.23) 0.0000 (1.0) 0;0 1.7174 (0.81) 1 1 test_sharing-checkout-noop[3.10.0] 597.1200 (1.26) 597.1200 (1.26) 597.1200 (1.26) 0.0000 (1.0) 597.1200 (1.26) 0.0000 (1.0) 0;0 1.6747 (0.79) 1 1 test_sharing-checkout-noop[3.53.2] 548.5968 (1.16) 548.5968 (1.16) 548.5968 (1.16) 0.0000 (1.0) 548.5968 (1.16) 0.0000 (1.0) 0;0 1.8228 (0.86) 1 1 test_sharing-checkout-noop[main] 473.9931 (1.0) 473.9931 (1.0) 473.9931 (1.0) 0.0000 (1.0) 473.9931 (1.0) 0.0000 (1.0) 0;0 2.1097 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-fetch[2.58.2] 3.8550 (2.64) 3.8550 (2.64) 3.8550 (2.64) 0.0000 (1.0) 3.8550 (2.64) 0.0000 (1.0) 0;0 0.2594 (0.38) 1 1 test_sharing-fetch[3.10.0] 4.1945 (2.87) 4.1945 (2.87) 4.1945 (2.87) 0.0000 (1.0) 4.1945 (2.87) 0.0000 (1.0) 0;0 0.2384 (0.35) 1 1 test_sharing-fetch[3.53.2] 1.7776 (1.22) 1.7776 (1.22) 1.7776 (1.22) 0.0000 (1.0) 1.7776 (1.22) 0.0000 (1.0) 0;0 0.5626 (0.82) 1 1 test_sharing-fetch[main] 1.4596 (1.0) 1.4596 (1.0) 1.4596 (1.0) 0.0000 (1.0) 1.4596 (1.0) 0.0000 (1.0) 0;0 0.6851 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing-fetch-noop[2.58.2] 441.8975 (1.0) 441.8975 (1.0) 441.8975 (1.0) 0.0000 (1.0) 441.8975 (1.0) 0.0000 (1.0) 0;0 2.2630 (1.0) 1 1 test_sharing-fetch-noop[3.10.0] 521.7389 (1.18) 521.7389 (1.18) 521.7389 (1.18) 0.0000 (1.0) 521.7389 (1.18) 0.0000 (1.0) 0;0 1.9167 (0.85) 1 1 test_sharing-fetch-noop[3.53.2] 920.8697 (2.08) 920.8697 (2.08) 920.8697 (2.08) 0.0000 (1.0) 920.8697 (2.08) 0.0000 (1.0) 0;0 1.0859 (0.48) 1 1 test_sharing-fetch-noop[main] 824.5593 (1.87) 824.5593 (1.87) 824.5593 (1.87) 0.0000 (1.0) 824.5593 (1.87) 0.0000 (1.0) 0;0 1.2128 (0.54) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.58.2] 3.3861 (2.37) 3.3861 (2.37) 3.3861 (2.37) 0.0000 (1.0) 3.3861 (2.37) 0.0000 (1.0) 0;0 0.2953 (0.42) 1 1 test_sharing-push[3.10.0] 1.8636 (1.31) 1.8636 (1.31) 1.8636 (1.31) 0.0000 (1.0) 1.8636 (1.31) 0.0000 (1.0) 0;0 0.5366 (0.77) 1 1 test_sharing-push[3.53.2] 1.4449 (1.01) 1.4449 (1.01) 1.4449 (1.01) 0.0000 (1.0) 1.4449 (1.01) 0.0000 (1.0) 0;0 0.6921 (0.99) 1 1 test_sharing-push[main] 1.4264 (1.0) 1.4264 (1.0) 1.4264 (1.0) 0.0000 (1.0) 1.4264 (1.0) 0.0000 (1.0) 0;0 0.7010 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.58.2] 465.7873 (1.01) 465.7873 (1.01) 465.7873 (1.01) 0.0000 (1.0) 465.7873 (1.01) 0.0000 (1.0) 0;0 2.1469 (0.99) 1 1 test_sharing-push-noop[3.10.0] 460.1658 (1.0) 460.1658 (1.0) 460.1658 (1.0) 0.0000 (1.0) 460.1658 (1.0) 0.0000 (1.0) 0;0 2.1731 (1.0) 1 1 test_sharing-push-noop[3.53.2] 817.3364 (1.78) 817.3364 (1.78) 817.3364 (1.78) 0.0000 (1.0) 817.3364 (1.78) 0.0000 (1.0) 0;0 1.2235 (0.56) 1 1 test_sharing-push-noop[main] 824.3910 (1.79) 824.3910 (1.79) 824.3910 (1.79) 0.0000 (1.0) 824.3910 (1.79) 0.0000 (1.0) 0;0 1.2130 (0.56) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.58.2] 1.2338 (1.78) 1.2338 (1.78) 1.2338 (1.78) 0.0000 (1.0) 1.2338 (1.78) 0.0000 (1.0) 0;0 0.8105 (0.56) 1 1 test_status-status[3.10.0] 1.2008 (1.74) 1.2008 (1.74) 1.2008 (1.74) 0.0000 (1.0) 1.2008 (1.74) 0.0000 (1.0) 0;0 0.8328 (0.58) 1 1 test_status-status[3.53.2] 1.1083 (1.60) 1.1083 (1.60) 1.1083 (1.60) 0.0000 (1.0) 1.1083 (1.60) 0.0000 (1.0) 0;0 0.9023 (0.62) 1 1 test_status-status[main] 0.6915 (1.0) 0.6915 (1.0) 0.6915 (1.0) 0.0000 (1.0) 0.6915 (1.0) 0.0000 (1.0) 0;0 1.4461 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.58.2] 605.6743 (1.32) 605.6743 (1.32) 605.6743 (1.32) 0.0000 (1.0) 605.6743 (1.32) 0.0000 (1.0) 0;0 1.6511 (0.75) 1 1 test_status-status-changed[3.10.0] 567.7336 (1.24) 567.7336 (1.24) 567.7336 (1.24) 0.0000 (1.0) 567.7336 (1.24) 0.0000 (1.0) 0;0 1.7614 (0.81) 1 1 test_status-status-changed[3.53.2] 532.8192 (1.17) 532.8192 (1.17) 532.8192 (1.17) 0.0000 (1.0) 532.8192 (1.17) 0.0000 (1.0) 0;0 1.8768 (0.86) 1 1 test_status-status-changed[main] 457.1960 (1.0) 457.1960 (1.0) 457.1960 (1.0) 0.0000 (1.0) 457.1960 (1.0) 0.0000 (1.0) 0;0 2.1872 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.58.2] 546.8276 (1.22) 546.8276 (1.22) 546.8276 (1.22) 0.0000 (1.0) 546.8276 (1.22) 0.0000 (1.0) 0;0 1.8287 (0.82) 1 1 test_status-status-changed-noop[3.10.0] 563.6608 (1.25) 563.6608 (1.25) 563.6608 (1.25) 0.0000 (1.0) 563.6608 (1.25) 0.0000 (1.0) 0;0 1.7741 (0.80) 1 1 test_status-status-changed-noop[3.53.2] 518.6331 (1.15) 518.6331 (1.15) 518.6331 (1.15) 0.0000 (1.0) 518.6331 (1.15) 0.0000 (1.0) 0;0 1.9281 (0.87) 1 1 test_status-status-changed-noop[main] 449.4292 (1.0) 449.4292 (1.0) 449.4292 (1.0) 0.0000 (1.0) 449.4292 (1.0) 0.0000 (1.0) 0;0 2.2250 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.58.2] 546.2312 (1.22) 546.2312 (1.22) 546.2312 (1.22) 0.0000 (1.0) 546.2312 (1.22) 0.0000 (1.0) 0;0 1.8307 (0.82) 1 1 test_status-status-noop[3.10.0] 550.4246 (1.22) 550.4246 (1.22) 550.4246 (1.22) 0.0000 (1.0) 550.4246 (1.22) 0.0000 (1.0) 0;0 1.8168 (0.82) 1 1 test_status-status-noop[3.53.2] 522.2230 (1.16) 522.2230 (1.16) 522.2230 (1.16) 0.0000 (1.0) 522.2230 (1.16) 0.0000 (1.0) 0;0 1.9149 (0.86) 1 1 test_status-status-noop[main] 449.4744 (1.0) 449.4744 (1.0) 449.4744 (1.0) 0.0000 (1.0) 449.4744 (1.0) 0.0000 (1.0) 0;0 2.2248 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-import-url[2.58.2] 7.0159 (3.14) 7.0159 (3.14) 7.0159 (3.14) 0.0000 (1.0) 7.0159 (3.14) 0.0000 (1.0) 0;0 0.1425 (0.32) 1 1 test_update-import-url[3.10.0] 6.7979 (3.04) 6.7979 (3.04) 6.7979 (3.04) 0.0000 (1.0) 6.7979 (3.04) 0.0000 (1.0) 0;0 0.1471 (0.33) 1 1 test_update-import-url[3.53.2] 4.3009 (1.92) 4.3009 (1.92) 4.3009 (1.92) 0.0000 (1.0) 4.3009 (1.92) 0.0000 (1.0) 0;0 0.2325 (0.52) 1 1 test_update-import-url[main] 2.2376 (1.0) 2.2376 (1.0) 2.2376 (1.0) 0.0000 (1.0) 2.2376 (1.0) 0.0000 (1.0) 0;0 0.4469 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.58.2] 6.2177 (3.86) 6.2177 (3.86) 6.2177 (3.86) 0.0000 (1.0) 6.2177 (3.86) 0.0000 (1.0) 0;0 0.1608 (0.26) 1 1 test_update-update[3.10.0] 6.0920 (3.79) 6.0920 (3.79) 6.0920 (3.79) 0.0000 (1.0) 6.0920 (3.79) 0.0000 (1.0) 0;0 0.1641 (0.26) 1 1 test_update-update[3.53.2] 4.0155 (2.50) 4.0155 (2.50) 4.0155 (2.50) 0.0000 (1.0) 4.0155 (2.50) 0.0000 (1.0) 0;0 0.2490 (0.40) 1 1 test_update-update[main] 1.6090 (1.0) 1.6090 (1.0) 1.6090 (1.0) 0.0000 (1.0) 1.6090 (1.0) 0.0000 (1.0) 0;0 0.6215 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_update-update-noop[2.58.2] 924.9737 (1.65) 924.9737 (1.65) 924.9737 (1.65) 0.0000 (1.0) 924.9737 (1.65) 0.0000 (1.0) 0;0 1.0811 (0.61) 1 1 test_update-update-noop[3.10.0] 896.5306 (1.60) 896.5306 (1.60) 896.5306 (1.60) 0.0000 (1.0) 896.5306 (1.60) 0.0000 (1.0) 0;0 1.1154 (0.63) 1 1 test_update-update-noop[3.53.2] 826.8707 (1.47) 826.8707 (1.47) 826.8707 (1.47) 0.0000 (1.0) 826.8707 (1.47) 0.0000 (1.0) 0;0 1.2094 (0.68) 1 1 test_update-update-noop[main] 560.6309 (1.0) 560.6309 (1.0) 560.6309 (1.0) 0.0000 (1.0) 560.6309 (1.0) 0.0000 (1.0) 0;0 1.7837 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 month ago 
github-actions[bot]
commented
1 month ago