Closed skshetry closed 3 weeks ago
Tue Aug 20 03:20:41 UTC 2024 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add[2.58.2] 3.7843 (1.87) 3.7843 (1.87) 3.7843 (1.87) 0.0000 (1.0) 3.7843 (1.87) 0.0000 (1.0) 0;0 0.2642 (0.53) 1 1 test_add_copy-add[3.10.0] 4.0039 (1.98) 4.0039 (1.98) 4.0039 (1.98) 0.0000 (1.0) 4.0039 (1.98) 0.0000 (1.0) 0;0 0.2498 (0.51) 1 1 test_add_copy-add[3.53.2] 3.3724 (1.67) 3.3724 (1.67) 3.3724 (1.67) 0.0000 (1.0) 3.3724 (1.67) 0.0000 (1.0) 0;0 0.2965 (0.60) 1 1 test_add_copy-add[main] 2.0233 (1.0) 2.0233 (1.0) 2.0233 (1.0) 0.0000 (1.0) 2.0233 (1.0) 0.0000 (1.0) 0;0 0.4942 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add-noop[2.58.2] 1.5411 (2.30) 1.5411 (2.30) 1.5411 (2.30) 0.0000 (1.0) 1.5411 (2.30) 0.0000 (1.0) 0;0 0.6489 (0.44) 1 1 test_add_copy-add-noop[3.10.0] 1.4803 (2.21) 1.4803 (2.21) 1.4803 (2.21) 0.0000 (1.0) 1.4803 (2.21) 0.0000 (1.0) 0;0 0.6755 (0.45) 1 1 test_add_copy-add-noop[3.53.2] 1.4119 (2.10) 1.4119 (2.10) 1.4119 (2.10) 0.0000 (1.0) 1.4119 (2.10) 0.0000 (1.0) 0;0 0.7083 (0.48) 1 1 test_add_copy-add-noop[main] 0.6708 (1.0) 0.6708 (1.0) 0.6708 (1.0) 0.0000 (1.0) 0.6708 (1.0) 0.0000 (1.0) 0;0 1.4909 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add[2.58.2] 3.0950 (1.40) 3.0950 (1.40) 3.0950 (1.40) 0.0000 (1.0) 3.0950 (1.40) 0.0000 (1.0) 0;0 0.3231 (0.72) 1 1 test_add_hardlink-add[3.10.0] 3.1561 (1.43) 3.1561 (1.43) 3.1561 (1.43) 0.0000 (1.0) 3.1561 (1.43) 0.0000 (1.0) 0;0 0.3168 (0.70) 1 1 test_add_hardlink-add[3.53.2] 2.7640 (1.25) 2.7640 (1.25) 2.7640 (1.25) 0.0000 (1.0) 2.7640 (1.25) 0.0000 (1.0) 0;0 0.3618 (0.80) 1 1 test_add_hardlink-add[main] 2.2136 (1.0) 2.2136 (1.0) 2.2136 (1.0) 0.0000 (1.0) 2.2136 (1.0) 0.0000 (1.0) 0;0 0.4517 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add-noop[2.58.2] 1.7694 (2.51) 1.7694 (2.51) 1.7694 (2.51) 0.0000 (1.0) 1.7694 (2.51) 0.0000 (1.0) 0;0 0.5652 (0.40) 1 1 test_add_hardlink-add-noop[3.10.0] 1.6234 (2.30) 1.6234 (2.30) 1.6234 (2.30) 0.0000 (1.0) 1.6234 (2.30) 0.0000 (1.0) 0;0 0.6160 (0.43) 1 1 test_add_hardlink-add-noop[3.53.2] 1.5266 (2.16) 1.5266 (2.16) 1.5266 (2.16) 0.0000 (1.0) 1.5266 (2.16) 0.0000 (1.0) 0;0 0.6550 (0.46) 1 1 test_add_hardlink-add-noop[main] 0.7059 (1.0) 0.7059 (1.0) 0.7059 (1.0) 0.0000 (1.0) 0.7059 (1.0) 0.0000 (1.0) 0;0 1.4167 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_symlink-add[2.58.2] 3.1720 (1.40) 3.1720 (1.40) 3.1720 (1.40) 0.0000 (1.0) 3.1720 (1.40) 0.0000 (1.0) 0;0 0.3153 (0.71) 1 1 test_add_symlink-add[3.10.0] 3.3690 (1.49) 3.3690 (1.49) 3.3690 (1.49) 0.0000 (1.0) 3.3690 (1.49) 0.0000 (1.0) 0;0 0.2968 (0.67) 1 1 test_add_symlink-add[3.53.2] 2.9844 (1.32) 2.9844 (1.32) 2.9844 (1.32) 0.0000 (1.0) 2.9844 (1.32) 0.0000 (1.0) 0;0 0.3351 (0.76) 1 1 test_add_symlink-add[main] 2.2634 (1.0) 2.2634 (1.0) 2.2634 (1.0) 0.0000 (1.0) 2.2634 (1.0) 0.0000 (1.0) 0;0 0.4418 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_add_symlink-add-noop[2.58.2] 2.0206 (2.89) 2.0206 (2.89) 2.0206 (2.89) 0.0000 (1.0) 2.0206 (2.89) 0.0000 (1.0) 0;0 0.4949 (0.35) 1 1 test_add_symlink-add-noop[3.10.0] 1.9145 (2.74) 1.9145 (2.74) 1.9145 (2.74) 0.0000 (1.0) 1.9145 (2.74) 0.0000 (1.0) 0;0 0.5223 (0.36) 1 1 test_add_symlink-add-noop[3.53.2] 1.8256 (2.61) 1.8256 (2.61) 1.8256 (2.61) 0.0000 (1.0) 1.8256 (2.61) 0.0000 (1.0) 0;0 0.5478 (0.38) 1 1 test_add_symlink-add-noop[main] 0.6985 (1.0) 0.6985 (1.0) 0.6985 (1.0) 0.0000 (1.0) 0.6985 (1.0) 0.0000 (1.0) 0;0 1.4317 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.58.2] 2.0797 (1.23) 2.0797 (1.23) 2.0797 (1.23) 0.0000 (1.0) 2.0797 (1.23) 0.0000 (1.0) 0;0 0.4808 (0.81) 1 1 test_checkout_copy-checkout[3.10.0] 4.0133 (2.38) 4.0133 (2.38) 4.0133 (2.38) 0.0000 (1.0) 4.0133 (2.38) 0.0000 (1.0) 0;0 0.2492 (0.42) 1 1 test_checkout_copy-checkout[3.53.2] 1.6863 (1.0) 1.6863 (1.0) 1.6863 (1.0) 0.0000 (1.0) 1.6863 (1.0) 0.0000 (1.0) 0;0 0.5930 (1.0) 1 1 test_checkout_copy-checkout[main] 1.7823 (1.06) 1.7823 (1.06) 1.7823 (1.06) 0.0000 (1.0) 1.7823 (1.06) 0.0000 (1.0) 0;0 0.5611 (0.95) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.58.2] 709.7301 (1.41) 709.7301 (1.41) 709.7301 (1.41) 0.0000 (1.0) 709.7301 (1.41) 0.0000 (1.0) 0;0 1.4090 (0.71) 1 1 test_checkout_copy-checkout-noop[3.10.0] 582.8273 (1.16) 582.8273 (1.16) 582.8273 (1.16) 0.0000 (1.0) 582.8273 (1.16) 0.0000 (1.0) 0;0 1.7158 (0.86) 1 1 test_checkout_copy-checkout-noop[3.53.2] 552.8532 (1.10) 552.8532 (1.10) 552.8532 (1.10) 0.0000 (1.0) 552.8532 (1.10) 0.0000 (1.0) 0;0 1.8088 (0.91) 1 1 test_checkout_copy-checkout-noop[main] 502.4671 (1.0) 502.4671 (1.0) 502.4671 (1.0) 0.0000 (1.0) 502.4671 (1.0) 0.0000 (1.0) 0;0 1.9902 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.58.2] 704.3877 (1.33) 704.3877 (1.33) 704.3877 (1.33) 0.0000 (1.0) 704.3877 (1.33) 0.0000 (1.0) 0;0 1.4197 (0.75) 1 1 test_checkout_copy-checkout-update[3.10.0] 633.7692 (1.19) 633.7692 (1.19) 633.7692 (1.19) 0.0000 (1.0) 633.7692 (1.19) 0.0000 (1.0) 0;0 1.5779 (0.84) 1 1 test_checkout_copy-checkout-update[3.53.2] 615.3834 (1.16) 615.3834 (1.16) 615.3834 (1.16) 0.0000 (1.0) 615.3834 (1.16) 0.0000 (1.0) 0;0 1.6250 (0.86) 1 1 test_checkout_copy-checkout-update[main] 531.3080 (1.0) 531.3080 (1.0) 531.3080 (1.0) 0.0000 (1.0) 531.3080 (1.0) 0.0000 (1.0) 0;0 1.8821 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.58.2] 1.3716 (1.18) 1.3716 (1.18) 1.3716 (1.18) 0.0000 (1.0) 1.3716 (1.18) 0.0000 (1.0) 0;0 0.7291 (0.85) 1 1 test_checkout_hardlink-checkout[3.10.0] 1.3230 (1.14) 1.3230 (1.14) 1.3230 (1.14) 0.0000 (1.0) 1.3230 (1.14) 0.0000 (1.0) 0;0 0.7559 (0.88) 1 1 test_checkout_hardlink-checkout[3.53.2] 1.1645 (1.0) 1.1645 (1.0) 1.1645 (1.0) 0.0000 (1.0) 1.1645 (1.0) 0.0000 (1.0) 0;0 0.8587 (1.0) 1 1 test_checkout_hardlink-checkout[main] 1.2645 (1.09) 1.2645 (1.09) 1.2645 (1.09) 0.0000 (1.0) 1.2645 (1.09) 0.0000 (1.0) 0;0 0.7908 (0.92) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.58.2] 573.2275 (1.19) 573.2275 (1.19) 573.2275 (1.19) 0.0000 (1.0) 573.2275 (1.19) 0.0000 (1.0) 0;0 1.7445 (0.84) 1 1 test_checkout_hardlink-checkout-noop[3.10.0] 578.5933 (1.20) 578.5933 (1.20) 578.5933 (1.20) 0.0000 (1.0) 578.5933 (1.20) 0.0000 (1.0) 0;0 1.7283 (0.83) 1 1 test_checkout_hardlink-checkout-noop[3.53.2] 548.7208 (1.14) 548.7208 (1.14) 548.7208 (1.14) 0.0000 (1.0) 548.7208 (1.14) 0.0000 (1.0) 0;0 1.8224 (0.88) 1 1 test_checkout_hardlink-checkout-noop[main] 481.6835 (1.0) 481.6835 (1.0) 481.6835 (1.0) 0.0000 (1.0) 481.6835 (1.0) 0.0000 (1.0) 0;0 2.0761 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.58.2] 709.8406 (1.34) 709.8406 (1.34) 709.8406 (1.34) 0.0000 (1.0) 709.8406 (1.34) 0.0000 (1.0) 0;0 1.4088 (0.75) 1 1 test_checkout_hardlink-checkout-update[3.10.0] 637.5717 (1.20) 637.5717 (1.20) 637.5717 (1.20) 0.0000 (1.0) 637.5717 (1.20) 0.0000 (1.0) 0;0 1.5685 (0.83) 1 1 test_checkout_hardlink-checkout-update[3.53.2] 600.3495 (1.13) 600.3495 (1.13) 600.3495 (1.13) 0.0000 (1.0) 600.3495 (1.13) 0.0000 (1.0) 0;0 1.6657 (0.88) 1 1 test_checkout_hardlink-checkout-update[main] 529.6643 (1.0) 529.6643 (1.0) 529.6643 (1.0) 0.0000 (1.0) 529.6643 (1.0) 0.0000 (1.0) 0;0 1.8880 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.58.2] 1.5233 (1.14) 1.5233 (1.14) 1.5233 (1.14) 0.0000 (1.0) 1.5233 (1.14) 0.0000 (1.0) 0;0 0.6565 (0.87) 1 1 test_checkout_symlink-checkout[3.10.0] 1.4969 (1.12) 1.4969 (1.12) 1.4969 (1.12) 0.0000 (1.0) 1.4969 (1.12) 0.0000 (1.0) 0;0 0.6681 (0.89) 1 1 test_checkout_symlink-checkout[3.53.2] 1.3320 (1.0) 1.3320 (1.0) 1.3320 (1.0) 0.0000 (1.0) 1.3320 (1.0) 0.0000 (1.0) 0;0 0.7507 (1.0) 1 1 test_checkout_symlink-checkout[main] 1.3596 (1.02) 1.3596 (1.02) 1.3596 (1.02) 0.0000 (1.0) 1.3596 (1.02) 0.0000 (1.0) 0;0 0.7355 (0.98) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.58.2] 636.5710 (1.22) 636.5710 (1.22) 636.5710 (1.22) 0.0000 (1.0) 636.5710 (1.22) 0.0000 (1.0) 0;0 1.5709 (0.82) 1 1 test_checkout_symlink-checkout-noop[3.10.0] 661.1646 (1.26) 661.1646 (1.26) 661.1646 (1.26) 0.0000 (1.0) 661.1646 (1.26) 0.0000 (1.0) 0;0 1.5125 (0.79) 1 1 test_checkout_symlink-checkout-noop[3.53.2] 601.7085 (1.15) 601.7085 (1.15) 601.7085 (1.15) 0.0000 (1.0) 601.7085 (1.15) 0.0000 (1.0) 0;0 1.6619 (0.87) 1 1 test_checkout_symlink-checkout-noop[main] 523.1892 (1.0) 523.1892 (1.0) 523.1892 (1.0) 0.0000 (1.0) 523.1892 (1.0) 0.0000 (1.0) 0;0 1.9114 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout-update[2.58.2] 856.0216 (1.41) 856.0216 (1.41) 856.0216 (1.41) 0.0000 (1.0) 856.0216 (1.41) 0.0000 (1.0) 0;0 1.1682 (0.71) 1 1 test_checkout_symlink-checkout-update[3.10.0] 719.9392 (1.18) 719.9392 (1.18) 719.9392 (1.18) 0.0000 (1.0) 719.9392 (1.18) 0.0000 (1.0) 0;0 1.3890 (0.84) 1 1 test_checkout_symlink-checkout-update[3.53.2] 691.6176 (1.14) 691.6176 (1.14) 691.6176 (1.14) 0.0000 (1.0) 691.6176 (1.14) 0.0000 (1.0) 0;0 1.4459 (0.88) 1 1 test_checkout_symlink-checkout-update[main] 607.6154 (1.0) 607.6154 (1.0) 607.6154 (1.0) 0.0000 (1.0) 607.6154 (1.0) 0.0000 (1.0) 0;0 1.6458 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.58.2] 715.0642 (1.25) 715.0642 (1.25) 715.0642 (1.25) 0.0000 (1.0) 715.0642 (1.25) 0.0000 (1.0) 0;0 1.3985 (0.80) 1 1 test_data_status-data-changed[3.10.0] 679.3438 (1.19) 679.3438 (1.19) 679.3438 (1.19) 0.0000 (1.0) 679.3438 (1.19) 0.0000 (1.0) 0;0 1.4720 (0.84) 1 1 test_data_status-data-changed[3.53.2] 658.9255 (1.15) 658.9255 (1.15) 658.9255 (1.15) 0.0000 (1.0) 658.9255 (1.15) 0.0000 (1.0) 0;0 1.5176 (0.87) 1 1 test_data_status-data-changed[main] 570.7921 (1.0) 570.7921 (1.0) 570.7921 (1.0) 0.0000 (1.0) 570.7921 (1.0) 0.0000 (1.0) 0;0 1.7520 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.58.2] 730.3217 (1.28) 730.3217 (1.28) 730.3217 (1.28) 0.0000 (1.0) 730.3217 (1.28) 0.0000 (1.0) 0;0 1.3693 (0.78) 1 1 test_data_status-data-changed-noop[3.10.0] 677.6449 (1.19) 677.6449 (1.19) 677.6449 (1.19) 0.0000 (1.0) 677.6449 (1.19) 0.0000 (1.0) 0;0 1.4757 (0.84) 1 1 test_data_status-data-changed-noop[3.53.2] 668.2535 (1.17) 668.2535 (1.17) 668.2535 (1.17) 0.0000 (1.0) 668.2535 (1.17) 0.0000 (1.0) 0;0 1.4964 (0.86) 1 1 test_data_status-data-changed-noop[main] 571.5378 (1.0) 571.5378 (1.0) 571.5378 (1.0) 0.0000 (1.0) 571.5378 (1.0) 0.0000 (1.0) 0;0 1.7497 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.58.2] 1.7666 (1.95) 1.7666 (1.95) 1.7666 (1.95) 0.0000 (1.0) 1.7666 (1.95) 0.0000 (1.0) 0;0 0.5660 (0.51) 1 1 test_data_status-data-new[3.10.0] 1.6115 (1.78) 1.6115 (1.78) 1.6115 (1.78) 0.0000 (1.0) 1.6115 (1.78) 0.0000 (1.0) 0;0 0.6205 (0.56) 1 1 test_data_status-data-new[3.53.2] 1.5092 (1.67) 1.5092 (1.67) 1.5092 (1.67) 0.0000 (1.0) 1.5092 (1.67) 0.0000 (1.0) 0;0 0.6626 (0.60) 1 1 test_data_status-data-new[main] 0.9044 (1.0) 0.9044 (1.0) 0.9044 (1.0) 0.0000 (1.0) 0.9044 (1.0) 0.0000 (1.0) 0;0 1.1057 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.58.2] 727.2391 (1.28) 727.2391 (1.28) 727.2391 (1.28) 0.0000 (1.0) 727.2391 (1.28) 0.0000 (1.0) 0;0 1.3751 (0.78) 1 1 test_data_status-data-noop[3.10.0] 677.3217 (1.19) 677.3217 (1.19) 677.3217 (1.19) 0.0000 (1.0) 677.3217 (1.19) 0.0000 (1.0) 0;0 1.4764 (0.84) 1 1 test_data_status-data-noop[3.53.2] 639.5276 (1.12) 639.5276 (1.12) 639.5276 (1.12) 0.0000 (1.0) 639.5276 (1.12) 0.0000 (1.0) 0;0 1.5637 (0.89) 1 1 test_data_status-data-noop[main] 568.8209 (1.0) 568.8209 (1.0) 568.8209 (1.0) 0.0000 (1.0) 568.8209 (1.0) 0.0000 (1.0) 0;0 1.7580 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.58.2] 1.0870 (1.10) 1.0870 (1.10) 1.0870 (1.10) 0.0000 (1.0) 1.0870 (1.10) 0.0000 (1.0) 0;0 0.9199 (0.91) 1 1 test_data_status_all_flags-data-changed[3.10.0] 1.0688 (1.08) 1.0688 (1.08) 1.0688 (1.08) 0.0000 (1.0) 1.0688 (1.08) 0.0000 (1.0) 0;0 0.9356 (0.93) 1 1 test_data_status_all_flags-data-changed[3.53.2] 1.0963 (1.11) 1.0963 (1.11) 1.0963 (1.11) 0.0000 (1.0) 1.0963 (1.11) 0.0000 (1.0) 0;0 0.9122 (0.90) 1 1 test_data_status_all_flags-data-changed[main] 0.9897 (1.0) 0.9897 (1.0) 0.9897 (1.0) 0.0000 (1.0) 0.9897 (1.0) 0.0000 (1.0) 0;0 1.0104 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.58.2] 1.0952 (1.11) 1.0952 (1.11) 1.0952 (1.11) 0.0000 (1.0) 1.0952 (1.11) 0.0000 (1.0) 0;0 0.9131 (0.90) 1 1 test_data_status_all_flags-data-changed-noop[3.10.0] 1.0718 (1.09) 1.0718 (1.09) 1.0718 (1.09) 0.0000 (1.0) 1.0718 (1.09) 0.0000 (1.0) 0;0 0.9330 (0.92) 1 1 test_data_status_all_flags-data-changed-noop[3.53.2] 1.0651 (1.08) 1.0651 (1.08) 1.0651 (1.08) 0.0000 (1.0) 1.0651 (1.08) 0.0000 (1.0) 0;0 0.9389 (0.92) 1 1 test_data_status_all_flags-data-changed-noop[main] 0.9846 (1.0) 0.9846 (1.0) 0.9846 (1.0) 0.0000 (1.0) 0.9846 (1.0) 0.0000 (1.0) 0;0 1.0156 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.58.2] 1.9591 (1.45) 1.9591 (1.45) 1.9591 (1.45) 0.0000 (1.0) 1.9591 (1.45) 0.0000 (1.0) 0;0 0.5104 (0.69) 1 1 test_data_status_all_flags-data-new[3.10.0] 2.0013 (1.48) 2.0013 (1.48) 2.0013 (1.48) 0.0000 (1.0) 2.0013 (1.48) 0.0000 (1.0) 0;0 0.4997 (0.68) 1 1 test_data_status_all_flags-data-new[3.53.2] 1.8755 (1.39) 1.8755 (1.39) 1.8755 (1.39) 0.0000 (1.0) 1.8755 (1.39) 0.0000 (1.0) 0;0 0.5332 (0.72) 1 1 test_data_status_all_flags-data-new[main] 1.3538 (1.0) 1.3538 (1.0) 1.3538 (1.0) 0.0000 (1.0) 1.3538 (1.0) 0.0000 (1.0) 0;0 0.7387 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.58.2] 1.0945 (1.13) 1.0945 (1.13) 1.0945 (1.13) 0.0000 (1.0) 1.0945 (1.13) 0.0000 (1.0) 0;0 0.9137 (0.89) 1 1 test_data_status_all_flags-data-noop[3.10.0] 1.3050 (1.34) 1.3050 (1.34) 1.3050 (1.34) 0.0000 (1.0) 1.3050 (1.34) 0.0000 (1.0) 0;0 0.7663 (0.75) 1 1 test_data_status_all_flags-data-noop[3.53.2] 1.0350 (1.06) 1.0350 (1.06) 1.0350 (1.06) 0.0000 (1.0) 1.0350 (1.06) 0.0000 (1.0) 0;0 0.9661 (0.94) 1 1 test_data_status_all_flags-data-noop[main] 0.9722 (1.0) 0.9722 (1.0) 0.9722 (1.0) 0.0000 (1.0) 0.9722 (1.0) 0.0000 (1.0) 0;0 1.0285 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.58.2] 1.4232 (1.44) 1.4232 (1.44) 1.4232 (1.44) 0.0000 (1.0) 1.4232 (1.44) 0.0000 (1.0) 0;0 0.7026 (0.70) 1 1 test_diff-diff[3.10.0] 1.5435 (1.56) 1.5435 (1.56) 1.5435 (1.56) 0.0000 (1.0) 1.5435 (1.56) 0.0000 (1.0) 0;0 0.6479 (0.64) 1 1 test_diff-diff[3.53.2] 1.4165 (1.43) 1.4165 (1.43) 1.4165 (1.43) 0.0000 (1.0) 1.4165 (1.43) 0.0000 (1.0) 0;0 0.7060 (0.70) 1 1 test_diff-diff[main] 0.9894 (1.0) 0.9894 (1.0) 0.9894 (1.0) 0.0000 (1.0) 0.9894 (1.0) 0.0000 (1.0) 0;0 1.0107 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.58.2] 668.4625 (1.21) 668.4625 (1.21) 668.4625 (1.21) 0.0000 (1.0) 668.4625 (1.21) 0.0000 (1.0) 0;0 1.4960 (0.83) 1 1 test_diff-diff-changed[3.10.0] 832.4223 (1.51) 832.4223 (1.51) 832.4223 (1.51) 0.0000 (1.0) 832.4223 (1.51) 0.0000 (1.0) 0;0 1.2013 (0.66) 1 1 test_diff-diff-changed[3.53.2] 627.4871 (1.14) 627.4871 (1.14) 627.4871 (1.14) 0.0000 (1.0) 627.4871 (1.14) 0.0000 (1.0) 0;0 1.5937 (0.88) 1 1 test_diff-diff-changed[main] 552.5393 (1.0) 552.5393 (1.0) 552.5393 (1.0) 0.0000 (1.0) 552.5393 (1.0) 0.0000 (1.0) 0;0 1.8098 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.58.2] 714.3222 (1.29) 714.3222 (1.29) 714.3222 (1.29) 0.0000 (1.0) 714.3222 (1.29) 0.0000 (1.0) 0;0 1.3999 (0.78) 1 1 test_diff-diff-changed-noop[3.10.0] 647.9105 (1.17) 647.9105 (1.17) 647.9105 (1.17) 0.0000 (1.0) 647.9105 (1.17) 0.0000 (1.0) 0;0 1.5434 (0.86) 1 1 test_diff-diff-changed-noop[3.53.2] 620.7349 (1.12) 620.7349 (1.12) 620.7349 (1.12) 0.0000 (1.0) 620.7349 (1.12) 0.0000 (1.0) 0;0 1.6110 (0.89) 1 1 test_diff-diff-changed-noop[main] 554.9831 (1.0) 554.9831 (1.0) 554.9831 (1.0) 0.0000 (1.0) 554.9831 (1.0) 0.0000 (1.0) 0;0 1.8019 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.58.2] 617.8005 (1.12) 617.8005 (1.12) 617.8005 (1.12) 0.0000 (1.0) 617.8005 (1.12) 0.0000 (1.0) 0;0 1.6186 (0.89) 1 1 test_diff-diff-noop[3.10.0] 618.6948 (1.12) 618.6948 (1.12) 618.6948 (1.12) 0.0000 (1.0) 618.6948 (1.12) 0.0000 (1.0) 0;0 1.6163 (0.89) 1 1 test_diff-diff-noop[3.53.2] 621.0230 (1.13) 621.0230 (1.13) 621.0230 (1.13) 0.0000 (1.0) 621.0230 (1.13) 0.0000 (1.0) 0;0 1.6102 (0.89) 1 1 test_diff-diff-noop[main] 550.3700 (1.0) 550.3700 (1.0) 550.3700 (1.0) 0.0000 (1.0) 550.3700 (1.0) 0.0000 (1.0) 0;0 1.8170 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.58.2] 1.0588 (1.0) 1.0588 (1.0) 1.0588 (1.0) 0.0000 (1.0) 1.0588 (1.0) 0.0000 (1.0) 0;0 0.9444 (1.0) 1 1 test_exp_show-exp[3.10.0] 8.5991 (8.12) 8.5991 (8.12) 8.5991 (8.12) 0.0000 (1.0) 8.5991 (8.12) 0.0000 (1.0) 0;0 0.1163 (0.12) 1 1 test_exp_show-exp[3.53.2] 5.5393 (5.23) 5.5393 (5.23) 5.5393 (5.23) 0.0000 (1.0) 5.5393 (5.23) 0.0000 (1.0) 0;0 0.1805 (0.19) 1 1 test_exp_show-exp[main] 6.9784 (6.59) 6.9784 (6.59) 6.9784 (6.59) 0.0000 (1.0) 6.9784 (6.59) 0.0000 (1.0) 0;0 0.1433 (0.15) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_fetch-fetch[2.58.2] 4.0350 (2.79) 4.0350 (2.79) 4.0350 (2.79) 0.0000 (1.0) 4.0350 (2.79) 0.0000 (1.0) 0;0 0.2478 (0.36) 1 1 test_fetch-fetch[3.10.0] 4.4657 (3.08) 4.4657 (3.08) 4.4657 (3.08) 0.0000 (1.0) 4.4657 (3.08) 0.0000 (1.0) 0;0 0.2239 (0.32) 1 1 test_fetch-fetch[3.53.2] 1.9880 (1.37) 1.9880 (1.37) 1.9880 (1.37) 0.0000 (1.0) 1.9880 (1.37) 0.0000 (1.0) 0;0 0.5030 (0.73) 1 1 test_fetch-fetch[main] 1.4478 (1.0) 1.4478 (1.0) 1.4478 (1.0) 0.0000 (1.0) 1.4478 (1.0) 0.0000 (1.0) 0;0 0.6907 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.58.2] 615.7343 (1.28) 615.7343 (1.28) 615.7343 (1.28) 0.0000 (1.0) 615.7343 (1.28) 0.0000 (1.0) 0;0 1.6241 (0.78) 1 1 test_gc-gc[3.10.0] 721.4481 (1.50) 721.4481 (1.50) 721.4481 (1.50) 0.0000 (1.0) 721.4481 (1.50) 0.0000 (1.0) 0;0 1.3861 (0.67) 1 1 test_gc-gc[3.53.2] 640.6536 (1.33) 640.6536 (1.33) 640.6536 (1.33) 0.0000 (1.0) 640.6536 (1.33) 0.0000 (1.0) 0;0 1.5609 (0.75) 1 1 test_gc-gc[main] 481.5257 (1.0) 481.5257 (1.0) 481.5257 (1.0) 0.0000 (1.0) 481.5257 (1.0) 0.0000 (1.0) 0;0 2.0767 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.58.2] 5.7169 (1.17) 5.7169 (1.17) 5.7169 (1.17) 0.0000 (1.0) 5.7169 (1.17) 0.0000 (1.0) 0;0 0.1749 (0.85) 1 1 test_get-get[3.10.0] 6.8108 (1.40) 6.8108 (1.40) 6.8108 (1.40) 0.0000 (1.0) 6.8108 (1.40) 0.0000 (1.0) 0;0 0.1468 (0.72) 1 1 test_get-get[3.53.2] 5.0875 (1.04) 5.0875 (1.04) 5.0875 (1.04) 0.0000 (1.0) 5.0875 (1.04) 0.0000 (1.0) 0;0 0.1966 (0.96) 1 1 test_get-get[main] 4.8752 (1.0) 4.8752 (1.0) 4.8752 (1.0) 0.0000 (1.0) 4.8752 (1.0) 0.0000 (1.0) 0;0 0.2051 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.58.2] 3.1245 (3.31) 3.1245 (3.31) 3.1245 (3.31) 0.0000 (1.0) 3.1245 (3.31) 0.0000 (1.0) 0;0 0.3201 (0.30) 1 1 test_get_url-get-url[3.10.0] 3.4476 (3.66) 3.4476 (3.66) 3.4476 (3.66) 0.0000 (1.0) 3.4476 (3.66) 0.0000 (1.0) 0;0 0.2901 (0.27) 1 1 test_get_url-get-url[3.53.2] 1.0719 (1.14) 1.0719 (1.14) 1.0719 (1.14) 0.0000 (1.0) 1.0719 (1.14) 0.0000 (1.0) 0;0 0.9329 (0.88) 1 1 test_get_url-get-url[main] 0.9426 (1.0) 0.9426 (1.0) 0.9426 (1.0) 0.0000 (1.0) 0.9426 (1.0) 0.0000 (1.0) 0;0 1.0609 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.58.2] 122.1820 (1.02) 148.1520 (1.17) 123.9280 (1.02) 2.5768 (2.71) 123.5688 (1.02) 0.8529 (1.14) 2;6 8.0692 (0.98) 100 1 test_help---help[3.10.0] 120.0037 (1.0) 126.5462 (1.0) 121.6111 (1.0) 0.9505 (1.0) 121.3754 (1.0) 0.7731 (1.03) 15;6 8.2229 (1.0) 100 1 test_help---help[3.53.2] 121.8005 (1.01) 150.9944 (1.19) 123.9479 (1.02) 3.6258 (3.81) 123.1374 (1.01) 0.7511 (1.0) 6;8 8.0679 (0.98) 100 1 test_help---help[main] 122.0463 (1.02) 138.9675 (1.10) 123.3788 (1.01) 1.8596 (1.96) 122.9921 (1.01) 0.7574 (1.01) 5;7 8.1051 (0.99) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.58.2] 9.1229 (1.0) 9.1229 (1.0) 9.1229 (1.0) 0.0000 (1.0) 9.1229 (1.0) 0.0000 (1.0) 0;0 0.1096 (1.0) 1 1 test_import-import[3.10.0] 10.3068 (1.13) 10.3068 (1.13) 10.3068 (1.13) 0.0000 (1.0) 10.3068 (1.13) 0.0000 (1.0) 0;0 0.0970 (0.89) 1 1 test_import-import[3.53.2] 13.6017 (1.49) 13.6017 (1.49) 13.6017 (1.49) 0.0000 (1.0) 13.6017 (1.49) 0.0000 (1.0) 0;0 0.0735 (0.67) 1 1 test_import-import[main] 10.1940 (1.12) 10.1940 (1.12) 10.1940 (1.12) 0.0000 (1.0) 10.1940 (1.12) 0.0000 (1.0) 0;0 0.0981 (0.89) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.58.2] 7.5345 (2.65) 7.5345 (2.65) 7.5345 (2.65) 0.0000 (1.0) 7.5345 (2.65) 0.0000 (1.0) 0;0 0.1327 (0.38) 1 1 test_import_url-import-url[3.10.0] 7.8123 (2.75) 7.8123 (2.75) 7.8123 (2.75) 0.0000 (1.0) 7.8123 (2.75) 0.0000 (1.0) 0;0 0.1280 (0.36) 1 1 test_import_url-import-url[3.53.2] 4.8249 (1.70) 4.8249 (1.70) 4.8249 (1.70) 0.0000 (1.0) 4.8249 (1.70) 0.0000 (1.0) 0;0 0.2073 (0.59) 1 1 test_import_url-import-url[main] 2.8398 (1.0) 2.8398 (1.0) 2.8398 (1.0) 0.0000 (1.0) 2.8398 (1.0) 0.0000 (1.0) 0;0 0.3521 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.58.2] 402.6459 (1.0) 441.6213 (1.0) 418.6892 (1.0) 7.8496 (1.0) 418.6603 (1.0) 11.5654 (1.0) 34;0 2.3884 (1.0) 100 1 test_init-init[3.10.0] 418.5808 (1.04) 487.8527 (1.10) 442.0757 (1.06) 13.7035 (1.75) 440.4026 (1.05) 18.6504 (1.61) 36;1 2.2621 (0.95) 100 1 test_init-init[3.53.2] 420.9726 (1.05) 472.0148 (1.07) 440.5864 (1.05) 10.0294 (1.28) 438.7228 (1.05) 12.2917 (1.06) 25;3 2.2697 (0.95) 100 1 test_init-init[main] 419.9034 (1.04) 593.3340 (1.34) 452.4438 (1.08) 28.1393 (3.58) 445.8153 (1.06) 22.8105 (1.97) 13;7 2.2102 (0.93) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.58.2] 608.9282 (1.38) 608.9282 (1.38) 608.9282 (1.38) 0.0000 (1.0) 608.9282 (1.38) 0.0000 (1.0) 0;0 1.6422 (0.72) 1 1 test_list-list[3.10.0] 685.9666 (1.56) 685.9666 (1.56) 685.9666 (1.56) 0.0000 (1.0) 685.9666 (1.56) 0.0000 (1.0) 0;0 1.4578 (0.64) 1 1 test_list-list[3.53.2] 589.7000 (1.34) 589.7000 (1.34) 589.7000 (1.34) 0.0000 (1.0) 589.7000 (1.34) 0.0000 (1.0) 0;0 1.6958 (0.75) 1 1 test_list-list[main] 440.2229 (1.0) 440.2229 (1.0) 440.2229 (1.0) 0.0000 (1.0) 440.2229 (1.0) 0.0000 (1.0) 0;0 2.2716 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.58.2] 442.5699 (1.04) 442.5699 (1.04) 442.5699 (1.04) 0.0000 (1.0) 442.5699 (1.04) 0.0000 (1.0) 0;0 2.2595 (0.96) 1 1 test_list-list-dvc-only[3.10.0] 435.8883 (1.03) 435.8883 (1.03) 435.8883 (1.03) 0.0000 (1.0) 435.8883 (1.03) 0.0000 (1.0) 0;0 2.2942 (0.97) 1 1 test_list-list-dvc-only[3.53.2] 423.8084 (1.0) 423.8084 (1.0) 423.8084 (1.0) 0.0000 (1.0) 423.8084 (1.0) 0.0000 (1.0) 0;0 2.3596 (1.0) 1 1 test_list-list-dvc-only[main] 427.0284 (1.01) 427.0284 (1.01) 427.0284 (1.01) 0.0000 (1.0) 427.0284 (1.01) 0.0000 (1.0) 0;0 2.3418 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.58.2] 521.0510 (1.05) 521.0510 (1.05) 521.0510 (1.05) 0.0000 (1.0) 521.0510 (1.05) 0.0000 (1.0) 0;0 1.9192 (0.95) 1 1 test_list-list-recursive[3.10.0] 511.4890 (1.03) 511.4890 (1.03) 511.4890 (1.03) 0.0000 (1.0) 511.4890 (1.03) 0.0000 (1.0) 0;0 1.9551 (0.97) 1 1 test_list-list-recursive[3.53.2] 495.4002 (1.0) 495.4002 (1.0) 495.4002 (1.0) 0.0000 (1.0) 495.4002 (1.0) 0.0000 (1.0) 0;0 2.0186 (1.0) 1 1 test_list-list-recursive[main] 501.9695 (1.01) 501.9695 (1.01) 501.9695 (1.01) 0.0000 (1.0) 501.9695 (1.01) 0.0000 (1.0) 0;0 1.9922 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.58.2] 441.4919 (1.03) 441.4919 (1.03) 441.4919 (1.03) 0.0000 (1.0) 441.4919 (1.03) 0.0000 (1.0) 0;0 2.2650 (0.97) 1 1 test_list-list-shallow[3.10.0] 450.9740 (1.05) 450.9740 (1.05) 450.9740 (1.05) 0.0000 (1.0) 450.9740 (1.05) 0.0000 (1.0) 0;0 2.2174 (0.95) 1 1 test_list-list-shallow[3.53.2] 430.1889 (1.0) 430.1889 (1.0) 430.1889 (1.0) 0.0000 (1.0) 430.1889 (1.0) 0.0000 (1.0) 0;0 2.3246 (1.0) 1 1 test_list-list-shallow[main] 435.3619 (1.01) 435.3619 (1.01) 435.3619 (1.01) 0.0000 (1.0) 435.3619 (1.01) 0.0000 (1.0) 0;0 2.2969 (0.99) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add[2.58.2] 2.2189 (1.40) 2.2189 (1.40) 2.2189 (1.40) 0.0000 (1.0) 2.2189 (1.40) 0.0000 (1.0) 0;0 0.4507 (0.71) 1 1 test_partial_add-add[3.10.0] 2.2779 (1.44) 2.2779 (1.44) 2.2779 (1.44) 0.0000 (1.0) 2.2779 (1.44) 0.0000 (1.0) 0;0 0.4390 (0.69) 1 1 test_partial_add-add[3.53.2] 2.0003 (1.26) 2.0003 (1.26) 2.0003 (1.26) 0.0000 (1.0) 2.0003 (1.26) 0.0000 (1.0) 0;0 0.4999 (0.79) 1 1 test_partial_add-add[main] 1.5812 (1.0) 1.5812 (1.0) 1.5812 (1.0) 0.0000 (1.0) 1.5812 (1.0) 0.0000 (1.0) 0;0 0.6324 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial[2.58.2] 3.1376 (2.85) 3.1376 (2.85) 3.1376 (2.85) 0.0000 (1.0) 3.1376 (2.85) 0.0000 (1.0) 0;0 0.3187 (0.35) 1 1 test_partial_add-add-partial[3.10.0] 2.9867 (2.72) 2.9867 (2.72) 2.9867 (2.72) 0.0000 (1.0) 2.9867 (2.72) 0.0000 (1.0) 0;0 0.3348 (0.37) 1 1 test_partial_add-add-partial[3.53.2] 3.2670 (2.97) 3.2670 (2.97) 3.2670 (2.97) 0.0000 (1.0) 3.2670 (2.97) 0.0000 (1.0) 0;0 0.3061 (0.34) 1 1 test_partial_add-add-partial[main] 1.0997 (1.0) 1.0997 (1.0) 1.0997 (1.0) 0.0000 (1.0) 1.0997 (1.0) 0.0000 (1.0) 0;0 0.9093 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.58.2] 586.5011 (1.0) 586.5011 (1.0) 586.5011 (1.0) 0.0000 (1.0) 586.5011 (1.0) 0.0000 (1.0) 0;0 1.7050 (1.0) 1 1 test_partial_add-gc-cloud-noop[3.10.0] 615.9828 (1.05) 615.9828 (1.05) 615.9828 (1.05) 0.0000 (1.0) 615.9828 (1.05) 0.0000 (1.0) 0;0 1.6234 (0.95) 1 1 test_partial_add-gc-cloud-noop[3.53.2] 641.3461 (1.09) 641.3461 (1.09) 641.3461 (1.09) 0.0000 (1.0) 641.3461 (1.09) 0.0000 (1.0) 0;0 1.5592 (0.91) 1 1 test_partial_add-gc-cloud-noop[main] 644.5126 (1.10) 644.5126 (1.10) 644.5126 (1.10) 0.0000 (1.0) 644.5126 (1.10) 0.0000 (1.0) 0;0 1.5516 (0.91) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.58.2] 512.7315 (1.0) 512.7315 (1.0) 512.7315 (1.0) 0.0000 (1.0) 512.7315 (1.0) 0.0000 (1.0) 0;0 1.9503 (1.0) 1 1 test_partial_add-gc-noop[3.10.0] 557.4728 (1.09) 557.4728 (1.09) 557.4728 (1.09) 0.0000 (1.0) 557.4728 (1.09) 0.0000 (1.0) 0;0 1.7938 (0.92) 1 1 test_partial_add-gc-noop[3.53.2] 540.1410 (1.05) 540.1410 (1.05) 540.1410 (1.05) 0.0000 (1.0) 540.1410 (1.05) 0.0000 (1.0) 0;0 1.8514 (0.95) 1 1 test_partial_add-gc-noop[main] 544.8195 (1.06) 544.8195 (1.06) 544.8195 (1.06) 0.0000 (1.0) 544.8195 (1.06) 0.0000 (1.0) 0;0 1.8355 (0.94) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push[2.58.2] 1.9841 (1.83) 1.9841 (1.83) 1.9841 (1.83) 0.0000 (1.0) 1.9841 (1.83) 0.0000 (1.0) 0;0 0.5040 (0.55) 1 1 test_partial_add-push[3.10.0] 1.1796 (1.09) 1.1796 (1.09) 1.1796 (1.09) 0.0000 (1.0) 1.1796 (1.09) 0.0000 (1.0) 0;0 0.8477 (0.92) 1 1 test_partial_add-push[3.53.2] 1.0904 (1.00) 1.0904 (1.00) 1.0904 (1.00) 0.0000 (1.0) 1.0904 (1.00) 0.0000 (1.0) 0;0 0.9171 (1.00) 1 1 test_partial_add-push[main] 1.0850 (1.0) 1.0850 (1.0) 1.0850 (1.0) 0.0000 (1.0) 1.0850 (1.0) 0.0000 (1.0) 0;0 0.9216 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial[2.58.2] 2.0039 (1.64) 2.0039 (1.64) 2.0039 (1.64) 0.0000 (1.0) 2.0039 (1.64) 0.0000 (1.0) 0;0 0.4990 (0.61) 1 1 test_partial_add-push-partial[3.10.0] 1.2299 (1.01) 1.2299 (1.01) 1.2299 (1.01) 0.0000 (1.0) 1.2299 (1.01) 0.0000 (1.0) 0;0 0.8131 (0.99) 1 1 test_partial_add-push-partial[3.53.2] 1.4836 (1.21) 1.4836 (1.21) 1.4836 (1.21) 0.0000 (1.0) 1.4836 (1.21) 0.0000 (1.0) 0;0 0.6741 (0.82) 1 1 test_partial_add-push-partial[main] 1.2237 (1.0) 1.2237 (1.0) 1.2237 (1.0) 0.0000 (1.0) 1.2237 (1.0) 0.0000 (1.0) 0;0 0.8172 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.58.2] 3.7128 (1.85) 3.7128 (1.85) 3.7128 (1.85) 0.0000 (1.0) 3.7128 (1.85) 0.0000 (1.0) 0;0 0.2693 (0.54) 1 1 test_partial_remove-add[3.10.0] 3.7639 (1.88) 3.7639 (1.88) 3.7639 (1.88) 0.0000 (1.0) 3.7639 (1.88) 0.0000 (1.0) 0;0 0.2657 (0.53) 1 1 test_partial_remove-add[3.53.2] 3.3309 (1.66) 3.3309 (1.66) 3.3309 (1.66) 0.0000 (1.0) 3.3309 (1.66) 0.0000 (1.0) 0;0 0.3002 (0.60) 1 1 test_partial_remove-add[main] 2.0020 (1.0) 2.0020 (1.0) 2.0020 (1.0) 0.0000 (1.0) 2.0020 (1.0) 0.0000 (1.0) 0;0 0.4995 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add-update[2.58.2] 1.5294 (2.48) 1.5294 (2.48) 1.5294 (2.48) 0.0000 (1.0) 1.5294 (2.48) 0.0000 (1.0) 0;0 0.6539 (0.40) 1 1 test_partial_remove-add-update[3.10.0] 1.4920 (2.42) 1.4920 (2.42) 1.4920 (2.42) 0.0000 (1.0) 1.4920 (2.42) 0.0000 (1.0) 0;0 0.6703 (0.41) 1 1 test_partial_remove-add-update[3.53.2] 1.3511 (2.19) 1.3511 (2.19) 1.3511 (2.19) 0.0000 (1.0) 1.3511 (2.19) 0.0000 (1.0) 0;0 0.7402 (0.46) 1 1 test_partial_remove-add-update[main] 0.6157 (1.0) 0.6157 (1.0) 0.6157 (1.0) 0.0000 (1.0) 0.6157 (1.0) 0.0000 (1.0) 0;0 1.6241 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.58.2] 519.2573 (1.0) 519.2573 (1.0) 519.2573 (1.0) 0.0000 (1.0) 519.2573 (1.0) 0.0000 (1.0) 0;0 1.9258 (1.0) 1 1 test_partial_remove-gc[3.10.0] 545.7326 (1.05) 545.7326 (1.05) 545.7326 (1.05) 0.0000 (1.0) 545.7326 (1.05) 0.0000 (1.0) 0;0 1.8324 (0.95) 1 1 test_partial_remove-gc[3.53.2] 526.2359 (1.01) 526.2359 (1.01) 526.2359 (1.01) 0.0000 (1.0) 526.2359 (1.01) 0.0000 (1.0) 0;0 1.9003 (0.99) 1 1 test_partial_remove-gc[main] 536.3717 (1.03) 536.3717 (1.03) 536.3717 (1.03) 0.0000 (1.0) 536.3717 (1.03) 0.0000 (1.0) 0;0 1.8644 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.58.2] 564.0547 (1.0) 564.0547 (1.0) 564.0547 (1.0) 0.0000 (1.0) 564.0547 (1.0) 0.0000 (1.0) 0;0 1.7729 (1.0) 1 1 test_partial_remove-gc-cloud[3.10.0] 585.3831 (1.04) 585.3831 (1.04) 585.3831 (1.04) 0.0000 (1.0) 585.3831 (1.04) 0.0000 (1.0) 0;0 1.7083 (0.96) 1 1 test_partial_remove-gc-cloud[3.53.2] 612.8469 (1.09) 612.8469 (1.09) 612.8469 (1.09) 0.0000 (1.0) 612.8469 (1.09) 0.0000 (1.0) 0;0 1.6317 (0.92) 1 1 test_partial_remove-gc-cloud[main] 597.9482 (1.06) 597.9482 (1.06) 597.9482 (1.06) 0.0000 (1.0) 597.9482 (1.06) 0.0000 (1.0) 0;0 1.6724 (0.94) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.58.2] 3.4113 (2.40) 3.4113 (2.40) 3.4113 (2.40) 0.0000 (1.0) 3.4113 (2.40) 0.0000 (1.0) 0;0 0.2931 (0.42) 1 1 test_partial_remove-push[3.10.0] 1.8864 (1.33) 1.8864 (1.33) 1.8864 (1.33) 0.0000 (1.0) 1.8864 (1.33) 0.0000 (1.0) 0;0 0.5301 (0.75) 1 1 test_partial_remove-push[3.53.2] 1.5149 (1.06) 1.5149 (1.06) 1.5149 (1.06) 0.0000 (1.0) 1.5149 (1.06) 0.0000 (1.0) 0;0 0.6601 (0.94) 1 1 test_partial_remove-push[main] 1.4229 (1.0) 1.4229 (1.0) 1.4229 (1.0) 0.0000 (1.0) 1.4229 (1.0) 0.0000 (1.0) 0;0 0.7028 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push-update[2.58.2] 516.9287 (1.04) 516.9287 (1.04) 516.9287 (1.04) 0.0000 (1.0) 516.9287 (1.04) 0.0000 (1.0) 0;0 1.9345 (0.96) 1 1 test_partial_remove-push-update[3.10.0] 498.0975 (1.0) 498.0975 (1.0) 498.0975 (1.0) 0.0000 (1.0) 498.0975 (1.0) 0.0000 (1.0) 0;0 2.0076 (1.0) 1 1 test_partial_remove-push-update[3.53.2] 809.5184 (1.63) 809.5184 (1.63) 809.5184 (1.63) 0.0000 (1.0) 809.5184 (1.63) 0.0000 (1.0) 0;0 1.2353 (0.62) 1 1 test_partial_remove-push-update[main] 800.8799 (1.61) 800.8799 (1.61) 800.8799 (1.61) 0.0000 (1.0) 800.8799 (1.61) 0.0000 (1.0) 0;0 1.2486 (0.62) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.58.2] 446.8761 (1.0) 448.5941 (1.0) 447.6882 (1.0) 0.8120 (1.01) 447.5669 (1.0) 1.5632 (1.18) 1;0 2.2337 (1.0) 5 3 test_plots-plots-diff[3.10.0] 810.7348 (1.81) 819.7727 (1.83) 813.7514 (1.82) 3.5955 (4.47) 812.9557 (1.82) 4.1812 (3.15) 1;0 1.2289 (0.55) 5 3 test_plots-plots-diff[3.53.2] 769.9670 (1.72) 774.2320 (1.73) 772.3323 (1.73) 1.8268 (2.27) 772.3476 (1.73) 3.1990 (2.41) 2;0 1.2948 (0.58) 5 3 test_plots-plots-diff[main] 771.6735 (1.73) 773.5259 (1.72) 772.5238 (1.73) 0.8050 (1.0) 772.1124 (1.73) 1.3262 (1.0) 2;0 1.2945 (0.58) 5 3 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.58.2] 461.8925 (1.0) 464.8730 (1.0) 463.1507 (1.0) 1.4389 (1.0) 462.2228 (1.0) 2.5083 (1.36) 1;0 2.1591 (1.0) 5 3 test_plots-plots-diff-json[3.10.0] 1,039.5426 (2.25) 1,043.7248 (2.25) 1,041.2314 (2.25) 1.5739 (1.09) 1,040.7585 (2.25) 1.8396 (1.0) 2;0 0.9604 (0.44) 5 3 test_plots-plots-diff-json[3.53.2] 839.0236 (1.82) 843.0879 (1.81) 840.7582 (1.82) 1.7944 (1.25) 840.5887 (1.82) 3.2216 (1.75) 1;0 1.1894 (0.55) 5 3 test_plots-plots-diff-json[main] 838.6311 (1.82) 843.8791 (1.82) 841.8644 (1.82) 2.2353 (1.55) 842.8412 (1.82) 3.5595 (1.93) 1;0 1.1878 (0.55) 5 3 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_plots-plots-show[2.58.2] 411.3180 (1.0) 420.1248 (1.0) 413.7991 (1.0) 3.5842 (1.47) 412.5665 (1.0) 2.7674 (1.0) 1;1 2.4166 (1.0) 5 3 test_plots-plots-show[3.10.0] 665.9319 (1.62) 671.9539 (1.60) 668.0687 (1.61) 2.4426 (1.0) 667.9248 (1.62) 3.3108 (1.20) 1;0 1.4969 (0.62) 5 3 test_plots-plots-show[3.53.2] 639.5134 (1.55) 648.4075 (1.54) 642.7322 (1.55) 3.4050 (1.39) 641.9953 (1.56) 3.6407 (1.32) 1;0 1.5559 (0.64) 5 3 test_plots-plots-show[main] 641.4309 (1.56) 682.8295 (1.63) 650.7126 (1.57) 17.9794 (7.36) 642.6466 (1.56) 11.5367 (4.17) 1;1 1.5368 (0.64) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.58.2] 426.2954 (1.0) 429.5220 (1.0) 428.3214 (1.0) 1.2424 (1.58) 428.7201 (1.0) 1.4586 (1.07) 1;0 2.3347 (1.0) 5 3 test_plots-plots-show-json[3.10.0] 793.2417 (1.86) 795.0868 (1.85) 794.2976 (1.85) 0.7887 (1.0) 794.4117 (1.85) 1.3647 (1.0) 2;0 1.2590 (0.54) 5 3 test_plots-plots-show-json[3.53.2] 681.8820 (1.60) 685.9272 (1.60) 684.5416 (1.60) 1.6281 (2.06) 684.7247 (1.60) 2.0613 (1.51) 1;0 1.4608 (0.63) 5 3 test_plots-plots-show-json[main] 683.8226 (1.60) 689.7644 (1.61) 687.0563 (1.60) 2.2044 (2.80) 687.3516 (1.60) 2.7989 (2.05) 2;0 1.4555 (0.62) 5 3 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.58.2] 3.5973 (2.57) 3.5973 (2.57) 3.5973 (2.57) 0.0000 (1.0) 3.5973 (2.57) 0.0000 (1.0) 0;0 0.2780 (0.39) 1 1 test_push-push[3.10.0] 2.1008 (1.50) 2.1008 (1.50) 2.1008 (1.50) 0.0000 (1.0) 2.1008 (1.50) 0.0000 (1.0) 0;0 0.4760 (0.67) 1 1 test_push-push[3.53.2] 1.6106 (1.15) 1.6106 (1.15) 1.6106 (1.15) 0.0000 (1.0) 1.6106 (1.15) 0.0000 (1.0) 0;0 0.6209 (0.87) 1 1 test_push-push[main] 1.4015 (1.0) 1.4015 (1.0) 1.4015 (1.0) 0.0000 (1.0) 1.4015 (1.0) 0.0000 (1.0) 0;0 0.7135 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.58.2] 3.7520 (1.88) 3.7520 (1.88) 3.7520 (1.88) 0.0000 (1.0) 3.7520 (1.88) 0.0000 (1.0) 0;0 0.2665 (0.53) 1 1 test_sharing-add[3.10.0] 3.7144 (1.86) 3.7144 (1.86) 3.7144 (1.86) 0.0000 (1.0) 3.7144 (1.86) 0.0000 (1.0) 0;0 0.2692 (0.54) 1 1 test_sharing-add[3.53.2] 3.5948 (1.80) 3.5948 (1.80) 3.5948 (1.80) 0.0000 (1.0) 3.5948 (1.80) 0.0000 (1.0) 0;0 0.2782 (0.55) 1 1 test_sharing-add[main] 1.9920 (1.0) 1.9920 (1.0) 1.9920 (1.0) 0.0000 (1.0) 1.9920 (1.0) 0.0000 (1.0) 0;0 0.5020 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.58.2] 2.5554 (3.80) 2.5554 (3.80) 2.5554 (3.80) 0.0000 (1.0) 2.5554 (3.80) 0.0000 (1.0) 0;0 0.3913 (0.26) 1 1 test_sharing-add-noop[3.10.0] 2.3723 (3.53) 2.3723 (3.53) 2.3723 (3.53) 0.0000 (1.0) 2.3723 (3.53) 0.0000 (1.0) 0;0 0.4215 (0.28) 1 1 test_sharing-add-noop[3.53.2] 2.1426 (3.19) 2.1426 (3.19) 2.1426 (3.19) 0.0000 (1.0) 2.1426 (3.19) 0.0000 (1.0) 0;0 0.4667 (0.31) 1 1 test_sharing-add-noop[main] 0.6723 (1.0) 0.6723 (1.0) 0.6723 (1.0) 0.0000 (1.0) 0.6723 (1.0) 0.0000 (1.0) 0;0 1.4875 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout[2.58.2] 1.8134 (1.62) 1.8134 (1.62) 1.8134 (1.62) 0.0000 (1.0) 1.8134 (1.62) 0.0000 (1.0) 0;0 0.5515 (0.62) 1 1 test_sharing-checkout[3.10.0] 3.6129 (3.22) 3.6129 (3.22) 3.6129 (3.22) 0.0000 (1.0) 3.6129 (3.22) 0.0000 (1.0) 0;0 0.2768 (0.31) 1 1 test_sharing-checkout[3.53.2] 1.3476 (1.20) 1.3476 (1.20) 1.3476 (1.20) 0.0000 (1.0) 1.3476 (1.20) 0.0000 (1.0) 0;0 0.7421 (0.83) 1 1 test_sharing-checkout[main] 1.1214 (1.0) 1.1214 (1.0) 1.1214 (1.0) 0.0000 (1.0) 1.1214 (1.0) 0.0000 (1.0) 0;0 0.8918 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.58.2] 583.1932 (1.18) 583.1932 (1.18) 583.1932 (1.18) 0.0000 (1.0) 583.1932 (1.18) 0.0000 (1.0) 0;0 1.7147 (0.85) 1 1 test_sharing-checkout-noop[3.10.0] 587.9431 (1.19) 587.9431 (1.19) 587.9431 (1.19) 0.0000 (1.0) 587.9431 (1.19) 0.0000 (1.0) 0;0 1.7008 (0.84) 1 1 test_sharing-checkout-noop[3.53.2] 561.5643 (1.13) 561.5643 (1.13) 561.5643 (1.13) 0.0000 (1.0) 561.5643 (1.13) 0.0000 (1.0) 0;0 1.7807 (0.88) 1 1 test_sharing-checkout-noop[main] 494.8099 (1.0) 494.8099 (1.0) 494.8099 (1.0) 0.0000 (1.0) 494.8099 (1.0) 0.0000 (1.0) 0;0 2.0210 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-fetch[2.58.2] 3.8384 (2.60) 3.8384 (2.60) 3.8384 (2.60) 0.0000 (1.0) 3.8384 (2.60) 0.0000 (1.0) 0;0 0.2605 (0.38) 1 1 test_sharing-fetch[3.10.0] 4.3594 (2.95) 4.3594 (2.95) 4.3594 (2.95) 0.0000 (1.0) 4.3594 (2.95) 0.0000 (1.0) 0;0 0.2294 (0.34) 1 1 test_sharing-fetch[3.53.2] 1.7822 (1.21) 1.7822 (1.21) 1.7822 (1.21) 0.0000 (1.0) 1.7822 (1.21) 0.0000 (1.0) 0;0 0.5611 (0.83) 1 1 test_sharing-fetch[main] 1.4766 (1.0) 1.4766 (1.0) 1.4766 (1.0) 0.0000 (1.0) 1.4766 (1.0) 0.0000 (1.0) 0;0 0.6772 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing-fetch-noop[2.58.2] 452.9762 (1.0) 452.9762 (1.0) 452.9762 (1.0) 0.0000 (1.0) 452.9762 (1.0) 0.0000 (1.0) 0;0 2.2076 (1.0) 1 1 test_sharing-fetch-noop[3.10.0] 546.0145 (1.21) 546.0145 (1.21) 546.0145 (1.21) 0.0000 (1.0) 546.0145 (1.21) 0.0000 (1.0) 0;0 1.8315 (0.83) 1 1 test_sharing-fetch-noop[3.53.2] 844.0281 (1.86) 844.0281 (1.86) 844.0281 (1.86) 0.0000 (1.0) 844.0281 (1.86) 0.0000 (1.0) 0;0 1.1848 (0.54) 1 1 test_sharing-fetch-noop[main] 847.9482 (1.87) 847.9482 (1.87) 847.9482 (1.87) 0.0000 (1.0) 847.9482 (1.87) 0.0000 (1.0) 0;0 1.1793 (0.53) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.58.2] 3.4129 (2.36) 3.4129 (2.36) 3.4129 (2.36) 0.0000 (1.0) 3.4129 (2.36) 0.0000 (1.0) 0;0 0.2930 (0.42) 1 1 test_sharing-push[3.10.0] 1.8757 (1.30) 1.8757 (1.30) 1.8757 (1.30) 0.0000 (1.0) 1.8757 (1.30) 0.0000 (1.0) 0;0 0.5331 (0.77) 1 1 test_sharing-push[3.53.2] 1.4719 (1.02) 1.4719 (1.02) 1.4719 (1.02) 0.0000 (1.0) 1.4719 (1.02) 0.0000 (1.0) 0;0 0.6794 (0.98) 1 1 test_sharing-push[main] 1.4442 (1.0) 1.4442 (1.0) 1.4442 (1.0) 0.0000 (1.0) 1.4442 (1.0) 0.0000 (1.0) 0;0 0.6924 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.58.2] 483.4018 (1.03) 483.4018 (1.03) 483.4018 (1.03) 0.0000 (1.0) 483.4018 (1.03) 0.0000 (1.0) 0;0 2.0687 (0.97) 1 1 test_sharing-push-noop[3.10.0] 470.9905 (1.0) 470.9905 (1.0) 470.9905 (1.0) 0.0000 (1.0) 470.9905 (1.0) 0.0000 (1.0) 0;0 2.1232 (1.0) 1 1 test_sharing-push-noop[3.53.2] 846.7239 (1.80) 846.7239 (1.80) 846.7239 (1.80) 0.0000 (1.0) 846.7239 (1.80) 0.0000 (1.0) 0;0 1.1810 (0.56) 1 1 test_sharing-push-noop[main] 852.3098 (1.81) 852.3098 (1.81) 852.3098 (1.81) 0.0000 (1.0) 852.3098 (1.81) 0.0000 (1.0) 0;0 1.1733 (0.55) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.58.2] 1.3529 (1.91) 1.3529 (1.91) 1.3529 (1.91) 0.0000 (1.0) 1.3529 (1.91) 0.0000 (1.0) 0;0 0.7392 (0.52) 1 1 test_status-status[3.10.0] 1.4408 (2.04) 1.4408 (2.04) 1.4408 (2.04) 0.0000 (1.0) 1.4408 (2.04) 0.0000 (1.0) 0;0 0.6941 (0.49) 1 1 test_status-status[3.53.2] 1.2728 (1.80) 1.2728 (1.80) 1.2728 (1.80) 0.0000 (1.0) 1.2728 (1.80) 0.0000 (1.0) 0;0 0.7857 (0.56) 1 1 test_status-status[main] 0.7065 (1.0) 0.7065 (1.0) 0.7065 (1.0) 0.0000 (1.0) 0.7065 (1.0) 0.0000 (1.0) 0;0 1.4155 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.58.2] 553.3072 (1.19) 553.3072 (1.19) 553.3072 (1.19) 0.0000 (1.0) 553.3072 (1.19) 0.0000 (1.0) 0;0 1.8073 (0.84) 1 1 test_status-status-changed[3.10.0] 554.4097 (1.19) 554.4097 (1.19) 554.4097 (1.19) 0.0000 (1.0) 554.4097 (1.19) 0.0000 (1.0) 0;0 1.8037 (0.84) 1 1 test_status-status-changed[3.53.2] 540.2161 (1.16) 540.2161 (1.16) 540.2161 (1.16) 0.0000 (1.0) 540.2161 (1.16) 0.0000 (1.0) 0;0 1.8511 (0.86) 1 1 test_status-status-changed[main] 463.9719 (1.0) 463.9719 (1.0) 463.9719 (1.0) 0.0000 (1.0) 463.9719 (1.0) 0.0000 (1.0) 0;0 2.1553 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.58.2] 547.4519 (1.21) 547.4519 (1.21) 547.4519 (1.21) 0.0000 (1.0) 547.4519 (1.21) 0.0000 (1.0) 0;0 1.8266 (0.83) 1 1 test_status-status-changed-noop[3.10.0] 557.5898 (1.23) 557.5898 (1.23) 557.5898 (1.23) 0.0000 (1.0) 557.5898 (1.23) 0.0000 (1.0) 0;0 1.7934 (0.81) 1 1 test_status-status-changed-noop[3.53.2] 522.1032 (1.15) 522.1032 (1.15) 522.1032 (1.15) 0.0000 (1.0) 522.1032 (1.15) 0.0000 (1.0) 0;0 1.9153 (0.87) 1 1 test_status-status-changed-noop[main] 453.5162 (1.0) 453.5162 (1.0) 453.5162 (1.0) 0.0000 (1.0) 453.5162 (1.0) 0.0000 (1.0) 0;0 2.2050 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.58.2] 549.3895 (1.19) 549.3895 (1.19) 549.3895 (1.19) 0.0000 (1.0) 549.3895 (1.19) 0.0000 (1.0) 0;0 1.8202 (0.84) 1 1 test_status-status-noop[3.10.0] 554.5811 (1.20) 554.5811 (1.20) 554.5811 (1.20) 0.0000 (1.0) 554.5811 (1.20) 0.0000 (1.0) 0;0 1.8032 (0.83) 1 1 test_status-status-noop[3.53.2] 526.6111 (1.14) 526.6111 (1.14) 526.6111 (1.14) 0.0000 (1.0) 526.6111 (1.14) 0.0000 (1.0) 0;0 1.8989 (0.87) 1 1 test_status-status-noop[main] 460.7645 (1.0) 460.7645 (1.0) 460.7645 (1.0) 0.0000 (1.0) 460.7645 (1.0) 0.0000 (1.0) 0;0 2.1703 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-import-url[2.58.2] 7.7934 (2.76) 7.7934 (2.76) 7.7934 (2.76) 0.0000 (1.0) 7.7934 (2.76) 0.0000 (1.0) 0;0 0.1283 (0.36) 1 1 test_update-import-url[3.10.0] 7.5515 (2.67) 7.5515 (2.67) 7.5515 (2.67) 0.0000 (1.0) 7.5515 (2.67) 0.0000 (1.0) 0;0 0.1324 (0.37) 1 1 test_update-import-url[3.53.2] 5.1113 (1.81) 5.1113 (1.81) 5.1113 (1.81) 0.0000 (1.0) 5.1113 (1.81) 0.0000 (1.0) 0;0 0.1956 (0.55) 1 1 test_update-import-url[main] 2.8240 (1.0) 2.8240 (1.0) 2.8240 (1.0) 0.0000 (1.0) 2.8240 (1.0) 0.0000 (1.0) 0;0 0.3541 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.58.2] 6.7279 (3.87) 6.7279 (3.87) 6.7279 (3.87) 0.0000 (1.0) 6.7279 (3.87) 0.0000 (1.0) 0;0 0.1486 (0.26) 1 1 test_update-update[3.10.0] 6.5520 (3.77) 6.5520 (3.77) 6.5520 (3.77) 0.0000 (1.0) 6.5520 (3.77) 0.0000 (1.0) 0;0 0.1526 (0.27) 1 1 test_update-update[3.53.2] 4.1742 (2.40) 4.1742 (2.40) 4.1742 (2.40) 0.0000 (1.0) 4.1742 (2.40) 0.0000 (1.0) 0;0 0.2396 (0.42) 1 1 test_update-update[main] 1.7389 (1.0) 1.7389 (1.0) 1.7389 (1.0) 0.0000 (1.0) 1.7389 (1.0) 0.0000 (1.0) 0;0 0.5751 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_update-update-noop[2.58.2] 992.7646 (1.60) 992.7646 (1.60) 992.7646 (1.60) 0.0000 (1.0) 992.7646 (1.60) 0.0000 (1.0) 0;0 1.0073 (0.63) 1 1 test_update-update-noop[3.10.0] 963.8978 (1.55) 963.8978 (1.55) 963.8978 (1.55) 0.0000 (1.0) 963.8978 (1.55) 0.0000 (1.0) 0;0 1.0375 (0.65) 1 1 test_update-update-noop[3.53.2] 920.5583 (1.48) 920.5583 (1.48) 920.5583 (1.48) 0.0000 (1.0) 920.5583 (1.48) 0.0000 (1.0) 0;0 1.0863 (0.68) 1 1 test_update-update-noop[main] 621.8281 (1.0) 621.8281 (1.0) 621.8281 (1.0) 0.0000 (1.0) 621.8281 (1.0) 0.0000 (1.0) 0;0 1.6082 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
3 weeks ago 
github-actions[bot]
commented
3 weeks ago