Closed skshetry closed 1 month ago
Tue Aug 13 16:50:09 UTC 2024 dataset: small project: example-get-started ------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add[2.58.2] 3.8501 (1.90) 3.8501 (1.90) 3.8501 (1.90) 0.0000 (1.0) 3.8501 (1.90) 0.0000 (1.0) 0;0 0.2597 (0.53) 1 1 test_add_copy-add[3.10.0] 3.8542 (1.90) 3.8542 (1.90) 3.8542 (1.90) 0.0000 (1.0) 3.8542 (1.90) 0.0000 (1.0) 0;0 0.2595 (0.53) 1 1 test_add_copy-add[3.53.2] 3.3761 (1.67) 3.3761 (1.67) 3.3761 (1.67) 0.0000 (1.0) 3.3761 (1.67) 0.0000 (1.0) 0;0 0.2962 (0.60) 1 1 test_add_copy-add[main] 2.0245 (1.0) 2.0245 (1.0) 2.0245 (1.0) 0.0000 (1.0) 2.0245 (1.0) 0.0000 (1.0) 0;0 0.4939 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_copy-add-noop[2.58.2] 1.5729 (2.35) 1.5729 (2.35) 1.5729 (2.35) 0.0000 (1.0) 1.5729 (2.35) 0.0000 (1.0) 0;0 0.6358 (0.43) 1 1 test_add_copy-add-noop[3.10.0] 1.5106 (2.25) 1.5106 (2.25) 1.5106 (2.25) 0.0000 (1.0) 1.5106 (2.25) 0.0000 (1.0) 0;0 0.6620 (0.44) 1 1 test_add_copy-add-noop[3.53.2] 1.4121 (2.11) 1.4121 (2.11) 1.4121 (2.11) 0.0000 (1.0) 1.4121 (2.11) 0.0000 (1.0) 0;0 0.7082 (0.47) 1 1 test_add_copy-add-noop[main] 0.6707 (1.0) 0.6707 (1.0) 0.6707 (1.0) 0.0000 (1.0) 0.6707 (1.0) 0.0000 (1.0) 0;0 1.4909 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add[2.58.2] 3.0507 (1.35) 3.0507 (1.35) 3.0507 (1.35) 0.0000 (1.0) 3.0507 (1.35) 0.0000 (1.0) 0;0 0.3278 (0.74) 1 1 test_add_hardlink-add[3.10.0] 3.1071 (1.37) 3.1071 (1.37) 3.1071 (1.37) 0.0000 (1.0) 3.1071 (1.37) 0.0000 (1.0) 0;0 0.3218 (0.73) 1 1 test_add_hardlink-add[3.53.2] 2.7304 (1.20) 2.7304 (1.20) 2.7304 (1.20) 0.0000 (1.0) 2.7304 (1.20) 0.0000 (1.0) 0;0 0.3663 (0.83) 1 1 test_add_hardlink-add[main] 2.2679 (1.0) 2.2679 (1.0) 2.2679 (1.0) 0.0000 (1.0) 2.2679 (1.0) 0.0000 (1.0) 0;0 0.4409 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_hardlink-add-noop[2.58.2] 1.7265 (2.55) 1.7265 (2.55) 1.7265 (2.55) 0.0000 (1.0) 1.7265 (2.55) 0.0000 (1.0) 0;0 0.5792 (0.39) 1 1 test_add_hardlink-add-noop[3.10.0] 1.6424 (2.42) 1.6424 (2.42) 1.6424 (2.42) 0.0000 (1.0) 1.6424 (2.42) 0.0000 (1.0) 0;0 0.6089 (0.41) 1 1 test_add_hardlink-add-noop[3.53.2] 1.5203 (2.24) 1.5203 (2.24) 1.5203 (2.24) 0.0000 (1.0) 1.5203 (2.24) 0.0000 (1.0) 0;0 0.6578 (0.45) 1 1 test_add_hardlink-add-noop[main] 0.6773 (1.0) 0.6773 (1.0) 0.6773 (1.0) 0.0000 (1.0) 0.6773 (1.0) 0.0000 (1.0) 0;0 1.4765 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add_symlink-add[2.58.2] 3.1531 (1.35) 3.1531 (1.35) 3.1531 (1.35) 0.0000 (1.0) 3.1531 (1.35) 0.0000 (1.0) 0;0 0.3171 (0.74) 1 1 test_add_symlink-add[3.10.0] 3.1845 (1.36) 3.1845 (1.36) 3.1845 (1.36) 0.0000 (1.0) 3.1845 (1.36) 0.0000 (1.0) 0;0 0.3140 (0.74) 1 1 test_add_symlink-add[3.53.2] 2.8691 (1.22) 2.8691 (1.22) 2.8691 (1.22) 0.0000 (1.0) 2.8691 (1.22) 0.0000 (1.0) 0;0 0.3485 (0.82) 1 1 test_add_symlink-add[main] 2.3425 (1.0) 2.3425 (1.0) 2.3425 (1.0) 0.0000 (1.0) 2.3425 (1.0) 0.0000 (1.0) 0;0 0.4269 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_add_symlink-add-noop[2.58.2] 2.0382 (2.83) 2.0382 (2.83) 2.0382 (2.83) 0.0000 (1.0) 2.0382 (2.83) 0.0000 (1.0) 0;0 0.4906 (0.35) 1 1 test_add_symlink-add-noop[3.10.0] 1.9418 (2.70) 1.9418 (2.70) 1.9418 (2.70) 0.0000 (1.0) 1.9418 (2.70) 0.0000 (1.0) 0;0 0.5150 (0.37) 1 1 test_add_symlink-add-noop[3.53.2] 2.1204 (2.94) 2.1204 (2.94) 2.1204 (2.94) 0.0000 (1.0) 2.1204 (2.94) 0.0000 (1.0) 0;0 0.4716 (0.34) 1 1 test_add_symlink-add-noop[main] 0.7203 (1.0) 0.7203 (1.0) 0.7203 (1.0) 0.0000 (1.0) 0.7203 (1.0) 0.0000 (1.0) 0;0 1.3884 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout[2.58.2] 2.1179 (1.21) 2.1179 (1.21) 2.1179 (1.21) 0.0000 (1.0) 2.1179 (1.21) 0.0000 (1.0) 0;0 0.4722 (0.82) 1 1 test_checkout_copy-checkout[3.10.0] 4.0711 (2.33) 4.0711 (2.33) 4.0711 (2.33) 0.0000 (1.0) 4.0711 (2.33) 0.0000 (1.0) 0;0 0.2456 (0.43) 1 1 test_checkout_copy-checkout[3.53.2] 1.7447 (1.0) 1.7447 (1.0) 1.7447 (1.0) 0.0000 (1.0) 1.7447 (1.0) 0.0000 (1.0) 0;0 0.5732 (1.0) 1 1 test_checkout_copy-checkout[main] 1.7997 (1.03) 1.7997 (1.03) 1.7997 (1.03) 0.0000 (1.0) 1.7997 (1.03) 0.0000 (1.0) 0;0 0.5557 (0.97) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-noop[2.58.2] 598.7303 (1.20) 598.7303 (1.20) 598.7303 (1.20) 0.0000 (1.0) 598.7303 (1.20) 0.0000 (1.0) 0;0 1.6702 (0.84) 1 1 test_checkout_copy-checkout-noop[3.10.0] 608.3867 (1.22) 608.3867 (1.22) 608.3867 (1.22) 0.0000 (1.0) 608.3867 (1.22) 0.0000 (1.0) 0;0 1.6437 (0.82) 1 1 test_checkout_copy-checkout-noop[3.53.2] 577.7847 (1.15) 577.7847 (1.15) 577.7847 (1.15) 0.0000 (1.0) 577.7847 (1.15) 0.0000 (1.0) 0;0 1.7307 (0.87) 1 1 test_checkout_copy-checkout-noop[main] 500.5311 (1.0) 500.5311 (1.0) 500.5311 (1.0) 0.0000 (1.0) 500.5311 (1.0) 0.0000 (1.0) 0;0 1.9979 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_copy-checkout-update[2.58.2] 734.5046 (1.34) 734.5046 (1.34) 734.5046 (1.34) 0.0000 (1.0) 734.5046 (1.34) 0.0000 (1.0) 0;0 1.3615 (0.75) 1 1 test_checkout_copy-checkout-update[3.10.0] 654.9740 (1.19) 654.9740 (1.19) 654.9740 (1.19) 0.0000 (1.0) 654.9740 (1.19) 0.0000 (1.0) 0;0 1.5268 (0.84) 1 1 test_checkout_copy-checkout-update[3.53.2] 643.4403 (1.17) 643.4403 (1.17) 643.4403 (1.17) 0.0000 (1.0) 643.4403 (1.17) 0.0000 (1.0) 0;0 1.5541 (0.85) 1 1 test_checkout_copy-checkout-update[main] 548.5550 (1.0) 548.5550 (1.0) 548.5550 (1.0) 0.0000 (1.0) 548.5550 (1.0) 0.0000 (1.0) 0;0 1.8230 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_hardlink-checkout[2.58.2] 1.3938 (1.15) 1.3938 (1.15) 1.3938 (1.15) 0.0000 (1.0) 1.3938 (1.15) 0.0000 (1.0) 0;0 0.7175 (0.87) 1 1 test_checkout_hardlink-checkout[3.10.0] 1.3357 (1.10) 1.3357 (1.10) 1.3357 (1.10) 0.0000 (1.0) 1.3357 (1.10) 0.0000 (1.0) 0;0 0.7487 (0.91) 1 1 test_checkout_hardlink-checkout[3.53.2] 1.2147 (1.0) 1.2147 (1.0) 1.2147 (1.0) 0.0000 (1.0) 1.2147 (1.0) 0.0000 (1.0) 0;0 0.8232 (1.0) 1 1 test_checkout_hardlink-checkout[main] 1.2811 (1.05) 1.2811 (1.05) 1.2811 (1.05) 0.0000 (1.0) 1.2811 (1.05) 0.0000 (1.0) 0;0 0.7806 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-noop[2.58.2] 577.0048 (1.20) 577.0048 (1.20) 577.0048 (1.20) 0.0000 (1.0) 577.0048 (1.20) 0.0000 (1.0) 0;0 1.7331 (0.84) 1 1 test_checkout_hardlink-checkout-noop[3.10.0] 590.6368 (1.22) 590.6368 (1.22) 590.6368 (1.22) 0.0000 (1.0) 590.6368 (1.22) 0.0000 (1.0) 0;0 1.6931 (0.82) 1 1 test_checkout_hardlink-checkout-noop[3.53.2] 558.7783 (1.16) 558.7783 (1.16) 558.7783 (1.16) 0.0000 (1.0) 558.7783 (1.16) 0.0000 (1.0) 0;0 1.7896 (0.86) 1 1 test_checkout_hardlink-checkout-noop[main] 482.5756 (1.0) 482.5756 (1.0) 482.5756 (1.0) 0.0000 (1.0) 482.5756 (1.0) 0.0000 (1.0) 0;0 2.0722 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_hardlink-checkout-update[2.58.2] 714.8481 (1.33) 714.8481 (1.33) 714.8481 (1.33) 0.0000 (1.0) 714.8481 (1.33) 0.0000 (1.0) 0;0 1.3989 (0.75) 1 1 test_checkout_hardlink-checkout-update[3.10.0] 639.9515 (1.19) 639.9515 (1.19) 639.9515 (1.19) 0.0000 (1.0) 639.9515 (1.19) 0.0000 (1.0) 0;0 1.5626 (0.84) 1 1 test_checkout_hardlink-checkout-update[3.53.2] 611.2366 (1.14) 611.2366 (1.14) 611.2366 (1.14) 0.0000 (1.0) 611.2366 (1.14) 0.0000 (1.0) 0;0 1.6360 (0.88) 1 1 test_checkout_hardlink-checkout-update[main] 537.0388 (1.0) 537.0388 (1.0) 537.0388 (1.0) 0.0000 (1.0) 537.0388 (1.0) 0.0000 (1.0) 0;0 1.8621 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout[2.58.2] 1.5783 (1.17) 1.5783 (1.17) 1.5783 (1.17) 0.0000 (1.0) 1.5783 (1.17) 0.0000 (1.0) 0;0 0.6336 (0.86) 1 1 test_checkout_symlink-checkout[3.10.0] 1.5480 (1.15) 1.5480 (1.15) 1.5480 (1.15) 0.0000 (1.0) 1.5480 (1.15) 0.0000 (1.0) 0;0 0.6460 (0.87) 1 1 test_checkout_symlink-checkout[3.53.2] 1.3499 (1.0) 1.3499 (1.0) 1.3499 (1.0) 0.0000 (1.0) 1.3499 (1.0) 0.0000 (1.0) 0;0 0.7408 (1.0) 1 1 test_checkout_symlink-checkout[main] 1.4254 (1.06) 1.4254 (1.06) 1.4254 (1.06) 0.0000 (1.0) 1.4254 (1.06) 0.0000 (1.0) 0;0 0.7015 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_checkout_symlink-checkout-noop[2.58.2] 650.5426 (1.18) 650.5426 (1.18) 650.5426 (1.18) 0.0000 (1.0) 650.5426 (1.18) 0.0000 (1.0) 0;0 1.5372 (0.85) 1 1 test_checkout_symlink-checkout-noop[3.10.0] 636.5347 (1.15) 636.5347 (1.15) 636.5347 (1.15) 0.0000 (1.0) 636.5347 (1.15) 0.0000 (1.0) 0;0 1.5710 (0.87) 1 1 test_checkout_symlink-checkout-noop[3.53.2] 622.0941 (1.13) 622.0941 (1.13) 622.0941 (1.13) 0.0000 (1.0) 622.0941 (1.13) 0.0000 (1.0) 0;0 1.6075 (0.89) 1 1 test_checkout_symlink-checkout-noop[main] 552.5533 (1.0) 552.5533 (1.0) 552.5533 (1.0) 0.0000 (1.0) 552.5533 (1.0) 0.0000 (1.0) 0;0 1.8098 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_checkout_symlink-checkout-update[2.58.2] 843.8640 (1.31) 843.8640 (1.31) 843.8640 (1.31) 0.0000 (1.0) 843.8640 (1.31) 0.0000 (1.0) 0;0 1.1850 (0.76) 1 1 test_checkout_symlink-checkout-update[3.10.0] 724.4494 (1.12) 724.4494 (1.12) 724.4494 (1.12) 0.0000 (1.0) 724.4494 (1.12) 0.0000 (1.0) 0;0 1.3804 (0.89) 1 1 test_checkout_symlink-checkout-update[3.53.2] 751.0596 (1.17) 751.0596 (1.17) 751.0596 (1.17) 0.0000 (1.0) 751.0596 (1.17) 0.0000 (1.0) 0;0 1.3315 (0.86) 1 1 test_checkout_symlink-checkout-update[main] 644.0691 (1.0) 644.0691 (1.0) 644.0691 (1.0) 0.0000 (1.0) 644.0691 (1.0) 0.0000 (1.0) 0;0 1.5526 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-changed[2.58.2] 634.0742 (1.19) 634.0742 (1.19) 634.0742 (1.19) 0.0000 (1.0) 634.0742 (1.19) 0.0000 (1.0) 0;0 1.5771 (0.84) 1 1 test_data_status-data-changed[3.10.0] 603.2475 (1.13) 603.2475 (1.13) 603.2475 (1.13) 0.0000 (1.0) 603.2475 (1.13) 0.0000 (1.0) 0;0 1.6577 (0.88) 1 1 test_data_status-data-changed[3.53.2] 595.5996 (1.12) 595.5996 (1.12) 595.5996 (1.12) 0.0000 (1.0) 595.5996 (1.12) 0.0000 (1.0) 0;0 1.6790 (0.89) 1 1 test_data_status-data-changed[main] 533.0172 (1.0) 533.0172 (1.0) 533.0172 (1.0) 0.0000 (1.0) 533.0172 (1.0) 0.0000 (1.0) 0;0 1.8761 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-changed-noop[2.58.2] 635.2391 (1.22) 635.2391 (1.22) 635.2391 (1.22) 0.0000 (1.0) 635.2391 (1.22) 0.0000 (1.0) 0;0 1.5742 (0.82) 1 1 test_data_status-data-changed-noop[3.10.0] 606.6684 (1.17) 606.6684 (1.17) 606.6684 (1.17) 0.0000 (1.0) 606.6684 (1.17) 0.0000 (1.0) 0;0 1.6483 (0.85) 1 1 test_data_status-data-changed-noop[3.53.2] 604.5805 (1.17) 604.5805 (1.17) 604.5805 (1.17) 0.0000 (1.0) 604.5805 (1.17) 0.0000 (1.0) 0;0 1.6540 (0.86) 1 1 test_data_status-data-changed-noop[main] 518.6594 (1.0) 518.6594 (1.0) 518.6594 (1.0) 0.0000 (1.0) 518.6594 (1.0) 0.0000 (1.0) 0;0 1.9280 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_data_status-data-new[2.58.2] 1.5579 (1.86) 1.5579 (1.86) 1.5579 (1.86) 0.0000 (1.0) 1.5579 (1.86) 0.0000 (1.0) 0;0 0.6419 (0.54) 1 1 test_data_status-data-new[3.10.0] 1.5274 (1.83) 1.5274 (1.83) 1.5274 (1.83) 0.0000 (1.0) 1.5274 (1.83) 0.0000 (1.0) 0;0 0.6547 (0.55) 1 1 test_data_status-data-new[3.53.2] 1.4262 (1.70) 1.4262 (1.70) 1.4262 (1.70) 0.0000 (1.0) 1.4262 (1.70) 0.0000 (1.0) 0;0 0.7012 (0.59) 1 1 test_data_status-data-new[main] 0.8365 (1.0) 0.8365 (1.0) 0.8365 (1.0) 0.0000 (1.0) 0.8365 (1.0) 0.0000 (1.0) 0;0 1.1955 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status-data-noop[2.58.2] 644.2980 (1.18) 644.2980 (1.18) 644.2980 (1.18) 0.0000 (1.0) 644.2980 (1.18) 0.0000 (1.0) 0;0 1.5521 (0.85) 1 1 test_data_status-data-noop[3.10.0] 604.2319 (1.11) 604.2319 (1.11) 604.2319 (1.11) 0.0000 (1.0) 604.2319 (1.11) 0.0000 (1.0) 0;0 1.6550 (0.90) 1 1 test_data_status-data-noop[3.53.2] 658.0463 (1.21) 658.0463 (1.21) 658.0463 (1.21) 0.0000 (1.0) 658.0463 (1.21) 0.0000 (1.0) 0;0 1.5196 (0.83) 1 1 test_data_status-data-noop[main] 544.6368 (1.0) 544.6368 (1.0) 544.6368 (1.0) 0.0000 (1.0) 544.6368 (1.0) 0.0000 (1.0) 0;0 1.8361 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed[2.58.2] 1.2099 (1.09) 1.2099 (1.09) 1.2099 (1.09) 0.0000 (1.0) 1.2099 (1.09) 0.0000 (1.0) 0;0 0.8265 (0.92) 1 1 test_data_status_all_flags-data-changed[3.10.0] 1.1799 (1.06) 1.1799 (1.06) 1.1799 (1.06) 0.0000 (1.0) 1.1799 (1.06) 0.0000 (1.0) 0;0 0.8476 (0.94) 1 1 test_data_status_all_flags-data-changed[3.53.2] 1.1291 (1.02) 1.1291 (1.02) 1.1291 (1.02) 0.0000 (1.0) 1.1291 (1.02) 0.0000 (1.0) 0;0 0.8857 (0.98) 1 1 test_data_status_all_flags-data-changed[main] 1.1085 (1.0) 1.1085 (1.0) 1.1085 (1.0) 0.0000 (1.0) 1.1085 (1.0) 0.0000 (1.0) 0;0 0.9021 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-changed-noop[2.58.2] 1.2530 (1.14) 1.2530 (1.14) 1.2530 (1.14) 0.0000 (1.0) 1.2530 (1.14) 0.0000 (1.0) 0;0 0.7981 (0.88) 1 1 test_data_status_all_flags-data-changed-noop[3.10.0] 1.2106 (1.10) 1.2106 (1.10) 1.2106 (1.10) 0.0000 (1.0) 1.2106 (1.10) 0.0000 (1.0) 0;0 0.8261 (0.91) 1 1 test_data_status_all_flags-data-changed-noop[3.53.2] 1.3333 (1.21) 1.3333 (1.21) 1.3333 (1.21) 0.0000 (1.0) 1.3333 (1.21) 0.0000 (1.0) 0;0 0.7500 (0.82) 1 1 test_data_status_all_flags-data-changed-noop[main] 1.0999 (1.0) 1.0999 (1.0) 1.0999 (1.0) 0.0000 (1.0) 1.0999 (1.0) 0.0000 (1.0) 0;0 0.9092 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-new[2.58.2] 2.0952 (1.39) 2.0952 (1.39) 2.0952 (1.39) 0.0000 (1.0) 2.0952 (1.39) 0.0000 (1.0) 0;0 0.4773 (0.72) 1 1 test_data_status_all_flags-data-new[3.10.0] 2.1089 (1.40) 2.1089 (1.40) 2.1089 (1.40) 0.0000 (1.0) 2.1089 (1.40) 0.0000 (1.0) 0;0 0.4742 (0.72) 1 1 test_data_status_all_flags-data-new[3.53.2] 2.0063 (1.33) 2.0063 (1.33) 2.0063 (1.33) 0.0000 (1.0) 2.0063 (1.33) 0.0000 (1.0) 0;0 0.4984 (0.75) 1 1 test_data_status_all_flags-data-new[main] 1.5108 (1.0) 1.5108 (1.0) 1.5108 (1.0) 0.0000 (1.0) 1.5108 (1.0) 0.0000 (1.0) 0;0 0.6619 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_data_status_all_flags-data-noop[2.58.2] 1.1658 (1.07) 1.1658 (1.07) 1.1658 (1.07) 0.0000 (1.0) 1.1658 (1.07) 0.0000 (1.0) 0;0 0.8578 (0.94) 1 1 test_data_status_all_flags-data-noop[3.10.0] 1.1611 (1.06) 1.1611 (1.06) 1.1611 (1.06) 0.0000 (1.0) 1.1611 (1.06) 0.0000 (1.0) 0;0 0.8613 (0.94) 1 1 test_data_status_all_flags-data-noop[3.53.2] 1.1605 (1.06) 1.1605 (1.06) 1.1605 (1.06) 0.0000 (1.0) 1.1605 (1.06) 0.0000 (1.0) 0;0 0.8617 (0.94) 1 1 test_data_status_all_flags-data-noop[main] 1.0902 (1.0) 1.0902 (1.0) 1.0902 (1.0) 0.0000 (1.0) 1.0902 (1.0) 0.0000 (1.0) 0;0 0.9172 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff[2.58.2] 1.4644 (1.44) 1.4644 (1.44) 1.4644 (1.44) 0.0000 (1.0) 1.4644 (1.44) 0.0000 (1.0) 0;0 0.6829 (0.69) 1 1 test_diff-diff[3.10.0] 1.6572 (1.63) 1.6572 (1.63) 1.6572 (1.63) 0.0000 (1.0) 1.6572 (1.63) 0.0000 (1.0) 0;0 0.6034 (0.61) 1 1 test_diff-diff[3.53.2] 1.4694 (1.44) 1.4694 (1.44) 1.4694 (1.44) 0.0000 (1.0) 1.4694 (1.44) 0.0000 (1.0) 0;0 0.6805 (0.69) 1 1 test_diff-diff[main] 1.0177 (1.0) 1.0177 (1.0) 1.0177 (1.0) 0.0000 (1.0) 1.0177 (1.0) 0.0000 (1.0) 0;0 0.9826 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed[2.58.2] 704.2267 (1.21) 704.2267 (1.21) 704.2267 (1.21) 0.0000 (1.0) 704.2267 (1.21) 0.0000 (1.0) 0;0 1.4200 (0.82) 1 1 test_diff-diff-changed[3.10.0] 703.6935 (1.21) 703.6935 (1.21) 703.6935 (1.21) 0.0000 (1.0) 703.6935 (1.21) 0.0000 (1.0) 0;0 1.4211 (0.82) 1 1 test_diff-diff-changed[3.53.2] 674.0359 (1.16) 674.0359 (1.16) 674.0359 (1.16) 0.0000 (1.0) 674.0359 (1.16) 0.0000 (1.0) 0;0 1.4836 (0.86) 1 1 test_diff-diff-changed[main] 579.9071 (1.0) 579.9071 (1.0) 579.9071 (1.0) 0.0000 (1.0) 579.9071 (1.0) 0.0000 (1.0) 0;0 1.7244 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-changed-noop[2.58.2] 677.3578 (1.17) 677.3578 (1.17) 677.3578 (1.17) 0.0000 (1.0) 677.3578 (1.17) 0.0000 (1.0) 0;0 1.4763 (0.86) 1 1 test_diff-diff-changed-noop[3.10.0] 685.4336 (1.18) 685.4336 (1.18) 685.4336 (1.18) 0.0000 (1.0) 685.4336 (1.18) 0.0000 (1.0) 0;0 1.4589 (0.85) 1 1 test_diff-diff-changed-noop[3.53.2] 662.4201 (1.14) 662.4201 (1.14) 662.4201 (1.14) 0.0000 (1.0) 662.4201 (1.14) 0.0000 (1.0) 0;0 1.5096 (0.88) 1 1 test_diff-diff-changed-noop[main] 580.2317 (1.0) 580.2317 (1.0) 580.2317 (1.0) 0.0000 (1.0) 580.2317 (1.0) 0.0000 (1.0) 0;0 1.7234 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_diff-diff-noop[2.58.2] 640.0764 (1.11) 640.0764 (1.11) 640.0764 (1.11) 0.0000 (1.0) 640.0764 (1.11) 0.0000 (1.0) 0;0 1.5623 (0.90) 1 1 test_diff-diff-noop[3.10.0] 650.0264 (1.12) 650.0264 (1.12) 650.0264 (1.12) 0.0000 (1.0) 650.0264 (1.12) 0.0000 (1.0) 0;0 1.5384 (0.89) 1 1 test_diff-diff-noop[3.53.2] 652.4561 (1.13) 652.4561 (1.13) 652.4561 (1.13) 0.0000 (1.0) 652.4561 (1.13) 0.0000 (1.0) 0;0 1.5327 (0.89) 1 1 test_diff-diff-noop[main] 577.8923 (1.0) 577.8923 (1.0) 577.8923 (1.0) 0.0000 (1.0) 577.8923 (1.0) 0.0000 (1.0) 0;0 1.7304 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_exp_show-exp[2.58.2] 1.0401 (1.0) 1.0401 (1.0) 1.0401 (1.0) 0.0000 (1.0) 1.0401 (1.0) 0.0000 (1.0) 0;0 0.9615 (1.0) 1 1 test_exp_show-exp[3.10.0] 6.4491 (6.20) 6.4491 (6.20) 6.4491 (6.20) 0.0000 (1.0) 6.4491 (6.20) 0.0000 (1.0) 0;0 0.1551 (0.16) 1 1 test_exp_show-exp[3.53.2] 4.5122 (4.34) 4.5122 (4.34) 4.5122 (4.34) 0.0000 (1.0) 4.5122 (4.34) 0.0000 (1.0) 0;0 0.2216 (0.23) 1 1 test_exp_show-exp[main] 5.4446 (5.23) 5.4446 (5.23) 5.4446 (5.23) 0.0000 (1.0) 5.4446 (5.23) 0.0000 (1.0) 0;0 0.1837 (0.19) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_fetch-fetch[2.58.2] 4.0254 (2.78) 4.0254 (2.78) 4.0254 (2.78) 0.0000 (1.0) 4.0254 (2.78) 0.0000 (1.0) 0;0 0.2484 (0.36) 1 1 test_fetch-fetch[3.10.0] 4.5781 (3.16) 4.5781 (3.16) 4.5781 (3.16) 0.0000 (1.0) 4.5781 (3.16) 0.0000 (1.0) 0;0 0.2184 (0.32) 1 1 test_fetch-fetch[3.53.2] 2.0172 (1.39) 2.0172 (1.39) 2.0172 (1.39) 0.0000 (1.0) 2.0172 (1.39) 0.0000 (1.0) 0;0 0.4957 (0.72) 1 1 test_fetch-fetch[main] 1.4468 (1.0) 1.4468 (1.0) 1.4468 (1.0) 0.0000 (1.0) 1.4468 (1.0) 0.0000 (1.0) 0;0 0.6912 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_gc-gc[2.58.2] 616.3747 (1.25) 616.3747 (1.25) 616.3747 (1.25) 0.0000 (1.0) 616.3747 (1.25) 0.0000 (1.0) 0;0 1.6224 (0.80) 1 1 test_gc-gc[3.10.0] 749.5131 (1.52) 749.5131 (1.52) 749.5131 (1.52) 0.0000 (1.0) 749.5131 (1.52) 0.0000 (1.0) 0;0 1.3342 (0.66) 1 1 test_gc-gc[3.53.2] 663.9080 (1.35) 663.9080 (1.35) 663.9080 (1.35) 0.0000 (1.0) 663.9080 (1.35) 0.0000 (1.0) 0;0 1.5062 (0.74) 1 1 test_gc-gc[main] 491.6896 (1.0) 491.6896 (1.0) 491.6896 (1.0) 0.0000 (1.0) 491.6896 (1.0) 0.0000 (1.0) 0;0 2.0338 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get-get[2.58.2] 5.6228 (1.15) 5.6228 (1.15) 5.6228 (1.15) 0.0000 (1.0) 5.6228 (1.15) 0.0000 (1.0) 0;0 0.1778 (0.87) 1 1 test_get-get[3.10.0] 6.8281 (1.40) 6.8281 (1.40) 6.8281 (1.40) 0.0000 (1.0) 6.8281 (1.40) 0.0000 (1.0) 0;0 0.1465 (0.72) 1 1 test_get-get[3.53.2] 5.0477 (1.03) 5.0477 (1.03) 5.0477 (1.03) 0.0000 (1.0) 5.0477 (1.03) 0.0000 (1.0) 0;0 0.1981 (0.97) 1 1 test_get-get[main] 4.8914 (1.0) 4.8914 (1.0) 4.8914 (1.0) 0.0000 (1.0) 4.8914 (1.0) 0.0000 (1.0) 0;0 0.2044 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_get_url-get-url[2.58.2] 3.1574 (3.33) 3.1574 (3.33) 3.1574 (3.33) 0.0000 (1.0) 3.1574 (3.33) 0.0000 (1.0) 0;0 0.3167 (0.30) 1 1 test_get_url-get-url[3.10.0] 3.4151 (3.60) 3.4151 (3.60) 3.4151 (3.60) 0.0000 (1.0) 3.4151 (3.60) 0.0000 (1.0) 0;0 0.2928 (0.28) 1 1 test_get_url-get-url[3.53.2] 1.0722 (1.13) 1.0722 (1.13) 1.0722 (1.13) 0.0000 (1.0) 1.0722 (1.13) 0.0000 (1.0) 0;0 0.9326 (0.88) 1 1 test_get_url-get-url[main] 0.9479 (1.0) 0.9479 (1.0) 0.9479 (1.0) 0.0000 (1.0) 0.9479 (1.0) 0.0000 (1.0) 0;0 1.0550 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_help---help[2.58.2] 125.3991 (1.02) 135.6137 (1.0) 128.5532 (1.02) 2.3965 (1.0) 128.3419 (1.02) 3.1965 (1.36) 33;2 7.7789 (0.99) 100 1 test_help---help[3.10.0] 123.0650 (1.0) 138.5175 (1.02) 126.6495 (1.0) 2.8153 (1.17) 125.8993 (1.0) 4.1692 (1.77) 32;1 7.8958 (1.0) 100 1 test_help---help[3.53.2] 125.4237 (1.02) 144.0316 (1.06) 128.6855 (1.02) 2.8976 (1.21) 128.0606 (1.02) 2.3490 (1.0) 12;7 7.7709 (0.98) 100 1 test_help---help[main] 123.6659 (1.00) 145.5314 (1.07) 127.5893 (1.01) 2.7905 (1.16) 127.1903 (1.01) 2.9732 (1.27) 19;2 7.8376 (0.99) 100 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean -------------------------------------------------------------------------- benchmark 'test_import-import': 4 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import-import[2.58.2] 9.1490 (1.0) 9.1490 (1.0) 9.1490 (1.0) 0.0000 (1.0) 9.1490 (1.0) 0.0000 (1.0) 0;0 0.1093 (1.0) 1 1 test_import-import[3.10.0] 10.0270 (1.10) 10.0270 (1.10) 10.0270 (1.10) 0.0000 (1.0) 10.0270 (1.10) 0.0000 (1.0) 0;0 0.0997 (0.91) 1 1 test_import-import[3.53.2] 13.0811 (1.43) 13.0811 (1.43) 13.0811 (1.43) 0.0000 (1.0) 13.0811 (1.43) 0.0000 (1.0) 0;0 0.0764 (0.70) 1 1 test_import-import[main] 10.0815 (1.10) 10.0815 (1.10) 10.0815 (1.10) 0.0000 (1.0) 10.0815 (1.10) 0.0000 (1.0) 0;0 0.0992 (0.91) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_import_url-import-url[2.58.2] 7.8779 (2.69) 7.8779 (2.69) 7.8779 (2.69) 0.0000 (1.0) 7.8779 (2.69) 0.0000 (1.0) 0;0 0.1269 (0.37) 1 1 test_import_url-import-url[3.10.0] 7.5946 (2.59) 7.5946 (2.59) 7.5946 (2.59) 0.0000 (1.0) 7.5946 (2.59) 0.0000 (1.0) 0;0 0.1317 (0.39) 1 1 test_import_url-import-url[3.53.2] 5.0828 (1.73) 5.0828 (1.73) 5.0828 (1.73) 0.0000 (1.0) 5.0828 (1.73) 0.0000 (1.0) 0;0 0.1967 (0.58) 1 1 test_import_url-import-url[main] 2.9337 (1.0) 2.9337 (1.0) 2.9337 (1.0) 0.0000 (1.0) 2.9337 (1.0) 0.0000 (1.0) 0;0 0.3409 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests ----------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_init-init[2.58.2] 395.2129 (1.0) 429.9387 (1.0) 405.5416 (1.0) 7.7715 (1.42) 403.0550 (1.0) 6.4241 (1.0) 20;12 2.4658 (1.0) 100 1 test_init-init[3.10.0] 410.7496 (1.04) 449.3949 (1.05) 422.9005 (1.04) 8.8862 (1.62) 420.1415 (1.04) 8.7499 (1.36) 20;7 2.3646 (0.96) 100 1 test_init-init[3.53.2] 402.9478 (1.02) 431.8884 (1.00) 411.4882 (1.01) 5.4756 (1.0) 410.6092 (1.02) 7.5712 (1.18) 28;2 2.4302 (0.99) 100 1 test_init-init[main] 406.5567 (1.03) 449.5124 (1.05) 419.4073 (1.03) 8.5873 (1.57) 417.4739 (1.04) 11.1879 (1.74) 26;4 2.3843 (0.97) 100 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list[2.58.2] 603.3306 (1.38) 603.3306 (1.38) 603.3306 (1.38) 0.0000 (1.0) 603.3306 (1.38) 0.0000 (1.0) 0;0 1.6575 (0.72) 1 1 test_list-list[3.10.0] 699.0939 (1.60) 699.0939 (1.60) 699.0939 (1.60) 0.0000 (1.0) 699.0939 (1.60) 0.0000 (1.0) 0;0 1.4304 (0.63) 1 1 test_list-list[3.53.2] 588.6200 (1.35) 588.6200 (1.35) 588.6200 (1.35) 0.0000 (1.0) 588.6200 (1.35) 0.0000 (1.0) 0;0 1.6989 (0.74) 1 1 test_list-list[main] 437.3283 (1.0) 437.3283 (1.0) 437.3283 (1.0) 0.0000 (1.0) 437.3283 (1.0) 0.0000 (1.0) 0;0 2.2866 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_list-list-dvc-only[2.58.2] 442.3878 (1.07) 442.3878 (1.07) 442.3878 (1.07) 0.0000 (1.0) 442.3878 (1.07) 0.0000 (1.0) 0;0 2.2605 (0.94) 1 1 test_list-list-dvc-only[3.10.0] 455.2728 (1.10) 455.2728 (1.10) 455.2728 (1.10) 0.0000 (1.0) 455.2728 (1.10) 0.0000 (1.0) 0;0 2.1965 (0.91) 1 1 test_list-list-dvc-only[3.53.2] 413.6446 (1.0) 413.6446 (1.0) 413.6446 (1.0) 0.0000 (1.0) 413.6446 (1.0) 0.0000 (1.0) 0;0 2.4175 (1.0) 1 1 test_list-list-dvc-only[main] 415.6380 (1.00) 415.6380 (1.00) 415.6380 (1.00) 0.0000 (1.0) 415.6380 (1.00) 0.0000 (1.0) 0;0 2.4059 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-recursive[2.58.2] 528.4066 (1.06) 528.4066 (1.06) 528.4066 (1.06) 0.0000 (1.0) 528.4066 (1.06) 0.0000 (1.0) 0;0 1.8925 (0.95) 1 1 test_list-list-recursive[3.10.0] 522.8955 (1.05) 522.8955 (1.05) 522.8955 (1.05) 0.0000 (1.0) 522.8955 (1.05) 0.0000 (1.0) 0;0 1.9124 (0.96) 1 1 test_list-list-recursive[3.53.2] 499.5423 (1.0) 499.5423 (1.0) 499.5423 (1.0) 0.0000 (1.0) 499.5423 (1.0) 0.0000 (1.0) 0;0 2.0018 (1.0) 1 1 test_list-list-recursive[main] 501.7391 (1.00) 501.7391 (1.00) 501.7391 (1.00) 0.0000 (1.0) 501.7391 (1.00) 0.0000 (1.0) 0;0 1.9931 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_list-list-shallow[2.58.2] 440.6177 (1.03) 440.6177 (1.03) 440.6177 (1.03) 0.0000 (1.0) 440.6177 (1.03) 0.0000 (1.0) 0;0 2.2695 (0.97) 1 1 test_list-list-shallow[3.10.0] 453.4595 (1.06) 453.4595 (1.06) 453.4595 (1.06) 0.0000 (1.0) 453.4595 (1.06) 0.0000 (1.0) 0;0 2.2053 (0.95) 1 1 test_list-list-shallow[3.53.2] 429.6286 (1.00) 429.6286 (1.00) 429.6286 (1.00) 0.0000 (1.0) 429.6286 (1.00) 0.0000 (1.0) 0;0 2.3276 (1.00) 1 1 test_list-list-shallow[main] 428.7195 (1.0) 428.7195 (1.0) 428.7195 (1.0) 0.0000 (1.0) 428.7195 (1.0) 0.0000 (1.0) 0;0 2.3325 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add[2.58.2] 2.1579 (1.42) 2.1579 (1.42) 2.1579 (1.42) 0.0000 (1.0) 2.1579 (1.42) 0.0000 (1.0) 0;0 0.4634 (0.70) 1 1 test_partial_add-add[3.10.0] 2.2533 (1.49) 2.2533 (1.49) 2.2533 (1.49) 0.0000 (1.0) 2.2533 (1.49) 0.0000 (1.0) 0;0 0.4438 (0.67) 1 1 test_partial_add-add[3.53.2] 1.9946 (1.31) 1.9946 (1.31) 1.9946 (1.31) 0.0000 (1.0) 1.9946 (1.31) 0.0000 (1.0) 0;0 0.5014 (0.76) 1 1 test_partial_add-add[main] 1.5171 (1.0) 1.5171 (1.0) 1.5171 (1.0) 0.0000 (1.0) 1.5171 (1.0) 0.0000 (1.0) 0;0 0.6591 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial[2.58.2] 3.0662 (2.78) 3.0662 (2.78) 3.0662 (2.78) 0.0000 (1.0) 3.0662 (2.78) 0.0000 (1.0) 0;0 0.3261 (0.36) 1 1 test_partial_add-add-partial[3.10.0] 2.9580 (2.68) 2.9580 (2.68) 2.9580 (2.68) 0.0000 (1.0) 2.9580 (2.68) 0.0000 (1.0) 0;0 0.3381 (0.37) 1 1 test_partial_add-add-partial[3.53.2] 2.6373 (2.39) 2.6373 (2.39) 2.6373 (2.39) 0.0000 (1.0) 2.6373 (2.39) 0.0000 (1.0) 0;0 0.3792 (0.42) 1 1 test_partial_add-add-partial[main] 1.1041 (1.0) 1.1041 (1.0) 1.1041 (1.0) 0.0000 (1.0) 1.1041 (1.0) 0.0000 (1.0) 0;0 0.9057 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[2.58.2] 572.0017 (1.0) 572.0017 (1.0) 572.0017 (1.0) 0.0000 (1.0) 572.0017 (1.0) 0.0000 (1.0) 0;0 1.7482 (1.0) 1 1 test_partial_add-gc-cloud-noop[3.10.0] 603.9923 (1.06) 603.9923 (1.06) 603.9923 (1.06) 0.0000 (1.0) 603.9923 (1.06) 0.0000 (1.0) 0;0 1.6557 (0.95) 1 1 test_partial_add-gc-cloud-noop[3.53.2] 626.0077 (1.09) 626.0077 (1.09) 626.0077 (1.09) 0.0000 (1.0) 626.0077 (1.09) 0.0000 (1.0) 0;0 1.5974 (0.91) 1 1 test_partial_add-gc-cloud-noop[main] 625.1446 (1.09) 625.1446 (1.09) 625.1446 (1.09) 0.0000 (1.0) 625.1446 (1.09) 0.0000 (1.0) 0;0 1.5996 (0.91) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[2.58.2] 509.3004 (1.0) 509.3004 (1.0) 509.3004 (1.0) 0.0000 (1.0) 509.3004 (1.0) 0.0000 (1.0) 0;0 1.9635 (1.0) 1 1 test_partial_add-gc-noop[3.10.0] 546.1954 (1.07) 546.1954 (1.07) 546.1954 (1.07) 0.0000 (1.0) 546.1954 (1.07) 0.0000 (1.0) 0;0 1.8308 (0.93) 1 1 test_partial_add-gc-noop[3.53.2] 538.0468 (1.06) 538.0468 (1.06) 538.0468 (1.06) 0.0000 (1.0) 538.0468 (1.06) 0.0000 (1.0) 0;0 1.8586 (0.95) 1 1 test_partial_add-gc-noop[main] 528.3646 (1.04) 528.3646 (1.04) 528.3646 (1.04) 0.0000 (1.0) 528.3646 (1.04) 0.0000 (1.0) 0;0 1.8926 (0.96) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push[2.58.2] 1.9459 (1.79) 1.9459 (1.79) 1.9459 (1.79) 0.0000 (1.0) 1.9459 (1.79) 0.0000 (1.0) 0;0 0.5139 (0.56) 1 1 test_partial_add-push[3.10.0] 1.1728 (1.08) 1.1728 (1.08) 1.1728 (1.08) 0.0000 (1.0) 1.1728 (1.08) 0.0000 (1.0) 0;0 0.8526 (0.93) 1 1 test_partial_add-push[3.53.2] 1.1557 (1.06) 1.1557 (1.06) 1.1557 (1.06) 0.0000 (1.0) 1.1557 (1.06) 0.0000 (1.0) 0;0 0.8652 (0.94) 1 1 test_partial_add-push[main] 1.0897 (1.0) 1.0897 (1.0) 1.0897 (1.0) 0.0000 (1.0) 1.0897 (1.0) 0.0000 (1.0) 0;0 0.9176 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-push-partial[2.58.2] 2.0111 (1.70) 2.0111 (1.70) 2.0111 (1.70) 0.0000 (1.0) 2.0111 (1.70) 0.0000 (1.0) 0;0 0.4972 (0.59) 1 1 test_partial_add-push-partial[3.10.0] 1.2112 (1.02) 1.2112 (1.02) 1.2112 (1.02) 0.0000 (1.0) 1.2112 (1.02) 0.0000 (1.0) 0;0 0.8256 (0.98) 1 1 test_partial_add-push-partial[3.53.2] 1.1852 (1.0) 1.1852 (1.0) 1.1852 (1.0) 0.0000 (1.0) 1.1852 (1.0) 0.0000 (1.0) 0;0 0.8437 (1.0) 1 1 test_partial_add-push-partial[main] 1.1868 (1.00) 1.1868 (1.00) 1.1868 (1.00) 0.0000 (1.0) 1.1868 (1.00) 0.0000 (1.0) 0;0 0.8426 (1.00) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add[2.58.2] 3.7941 (1.90) 3.7941 (1.90) 3.7941 (1.90) 0.0000 (1.0) 3.7941 (1.90) 0.0000 (1.0) 0;0 0.2636 (0.53) 1 1 test_partial_remove-add[3.10.0] 3.7812 (1.90) 3.7812 (1.90) 3.7812 (1.90) 0.0000 (1.0) 3.7812 (1.90) 0.0000 (1.0) 0;0 0.2645 (0.53) 1 1 test_partial_remove-add[3.53.2] 3.3320 (1.67) 3.3320 (1.67) 3.3320 (1.67) 0.0000 (1.0) 3.3320 (1.67) 0.0000 (1.0) 0;0 0.3001 (0.60) 1 1 test_partial_remove-add[main] 1.9946 (1.0) 1.9946 (1.0) 1.9946 (1.0) 0.0000 (1.0) 1.9946 (1.0) 0.0000 (1.0) 0;0 0.5014 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-add-update[2.58.2] 1.5624 (2.54) 1.5624 (2.54) 1.5624 (2.54) 0.0000 (1.0) 1.5624 (2.54) 0.0000 (1.0) 0;0 0.6400 (0.39) 1 1 test_partial_remove-add-update[3.10.0] 1.4804 (2.41) 1.4804 (2.41) 1.4804 (2.41) 0.0000 (1.0) 1.4804 (2.41) 0.0000 (1.0) 0;0 0.6755 (0.41) 1 1 test_partial_remove-add-update[3.53.2] 1.4330 (2.33) 1.4330 (2.33) 1.4330 (2.33) 0.0000 (1.0) 1.4330 (2.33) 0.0000 (1.0) 0;0 0.6978 (0.43) 1 1 test_partial_remove-add-update[main] 0.6141 (1.0) 0.6141 (1.0) 0.6141 (1.0) 0.0000 (1.0) 0.6141 (1.0) 0.0000 (1.0) 0;0 1.6283 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc[2.58.2] 520.2870 (1.0) 520.2870 (1.0) 520.2870 (1.0) 0.0000 (1.0) 520.2870 (1.0) 0.0000 (1.0) 0;0 1.9220 (1.0) 1 1 test_partial_remove-gc[3.10.0] 559.8660 (1.08) 559.8660 (1.08) 559.8660 (1.08) 0.0000 (1.0) 559.8660 (1.08) 0.0000 (1.0) 0;0 1.7861 (0.93) 1 1 test_partial_remove-gc[3.53.2] 547.2663 (1.05) 547.2663 (1.05) 547.2663 (1.05) 0.0000 (1.0) 547.2663 (1.05) 0.0000 (1.0) 0;0 1.8273 (0.95) 1 1 test_partial_remove-gc[main] 534.0238 (1.03) 534.0238 (1.03) 534.0238 (1.03) 0.0000 (1.0) 534.0238 (1.03) 0.0000 (1.0) 0;0 1.8726 (0.97) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-gc-cloud[2.58.2] 574.9720 (1.0) 574.9720 (1.0) 574.9720 (1.0) 0.0000 (1.0) 574.9720 (1.0) 0.0000 (1.0) 0;0 1.7392 (1.0) 1 1 test_partial_remove-gc-cloud[3.10.0] 632.6124 (1.10) 632.6124 (1.10) 632.6124 (1.10) 0.0000 (1.0) 632.6124 (1.10) 0.0000 (1.0) 0;0 1.5807 (0.91) 1 1 test_partial_remove-gc-cloud[3.53.2] 640.9251 (1.11) 640.9251 (1.11) 640.9251 (1.11) 0.0000 (1.0) 640.9251 (1.11) 0.0000 (1.0) 0;0 1.5602 (0.90) 1 1 test_partial_remove-gc-cloud[main] 607.5306 (1.06) 607.5306 (1.06) 607.5306 (1.06) 0.0000 (1.0) 607.5306 (1.06) 0.0000 (1.0) 0;0 1.6460 (0.95) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push[2.58.2] 3.4409 (2.45) 3.4409 (2.45) 3.4409 (2.45) 0.0000 (1.0) 3.4409 (2.45) 0.0000 (1.0) 0;0 0.2906 (0.41) 1 1 test_partial_remove-push[3.10.0] 1.8766 (1.34) 1.8766 (1.34) 1.8766 (1.34) 0.0000 (1.0) 1.8766 (1.34) 0.0000 (1.0) 0;0 0.5329 (0.75) 1 1 test_partial_remove-push[3.53.2] 1.4761 (1.05) 1.4761 (1.05) 1.4761 (1.05) 0.0000 (1.0) 1.4761 (1.05) 0.0000 (1.0) 0;0 0.6775 (0.95) 1 1 test_partial_remove-push[main] 1.4031 (1.0) 1.4031 (1.0) 1.4031 (1.0) 0.0000 (1.0) 1.4031 (1.0) 0.0000 (1.0) 0;0 0.7127 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove-push-update[2.58.2] 537.0508 (1.03) 537.0508 (1.03) 537.0508 (1.03) 0.0000 (1.0) 537.0508 (1.03) 0.0000 (1.0) 0;0 1.8620 (0.97) 1 1 test_partial_remove-push-update[3.10.0] 520.2363 (1.0) 520.2363 (1.0) 520.2363 (1.0) 0.0000 (1.0) 520.2363 (1.0) 0.0000 (1.0) 0;0 1.9222 (1.0) 1 1 test_partial_remove-push-update[3.53.2] 816.2106 (1.57) 816.2106 (1.57) 816.2106 (1.57) 0.0000 (1.0) 816.2106 (1.57) 0.0000 (1.0) 0;0 1.2252 (0.64) 1 1 test_partial_remove-push-update[main] 819.5867 (1.58) 819.5867 (1.58) 819.5867 (1.58) 0.0000 (1.0) 819.5867 (1.58) 0.0000 (1.0) 0;0 1.2201 (0.63) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ---------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff[2.58.2] 452.5362 (1.0) 457.8041 (1.0) 455.5399 (1.0) 2.3820 (1.13) 456.6741 (1.0) 4.1596 (1.28) 1;0 2.1952 (1.0) 5 3 test_plots-plots-diff[3.10.0] 820.9282 (1.81) 826.1029 (1.80) 823.5455 (1.81) 2.1012 (1.0) 824.3427 (1.81) 3.2389 (1.0) 2;0 1.2143 (0.55) 5 3 test_plots-plots-diff[3.53.2] 776.5723 (1.72) 783.3611 (1.71) 779.5885 (1.71) 3.2487 (1.55) 778.5985 (1.70) 6.1821 (1.91) 1;0 1.2827 (0.58) 5 3 test_plots-plots-diff[main] 781.7791 (1.73) 789.8117 (1.73) 785.5950 (1.72) 3.1409 (1.49) 786.0834 (1.72) 4.7095 (1.45) 2;0 1.2729 (0.58) 5 3 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-diff-json[2.58.2] 471.3730 (1.0) 498.2907 (1.0) 479.7170 (1.0) 10.9544 (3.85) 475.6476 (1.0) 12.5246 (3.84) 1;0 2.0846 (1.0) 5 3 test_plots-plots-diff-json[3.10.0] 1,043.8749 (2.21) 1,051.7245 (2.11) 1,047.7301 (2.18) 2.8482 (1.0) 1,047.3895 (2.20) 3.2592 (1.0) 2;0 0.9544 (0.46) 5 3 test_plots-plots-diff-json[3.53.2] 845.3158 (1.79) 856.7907 (1.72) 850.4849 (1.77) 4.3318 (1.52) 849.8545 (1.79) 5.8780 (1.80) 2;0 1.1758 (0.56) 5 3 test_plots-plots-diff-json[main] 850.6081 (1.80) 866.2313 (1.74) 854.2963 (1.78) 6.6843 (2.35) 851.5492 (1.79) 3.9663 (1.22) 1;1 1.1706 (0.56) 5 3 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show[2.58.2] 419.1590 (1.0) 433.9587 (1.0) 426.3365 (1.0) 6.3813 (2.96) 427.3261 (1.0) 11.2939 (3.42) 2;0 2.3456 (1.0) 5 3 test_plots-plots-show[3.10.0] 668.6647 (1.60) 676.5565 (1.56) 673.2832 (1.58) 2.9433 (1.36) 674.2735 (1.58) 3.2989 (1.0) 2;0 1.4853 (0.63) 5 3 test_plots-plots-show[3.53.2] 648.3066 (1.55) 653.3186 (1.51) 650.8349 (1.53) 2.1567 (1.0) 651.5842 (1.52) 3.6798 (1.12) 2;0 1.5365 (0.66) 5 3 test_plots-plots-show[main] 660.5175 (1.58) 677.3705 (1.56) 665.0278 (1.56) 6.9917 (3.24) 662.5488 (1.55) 5.8492 (1.77) 1;1 1.5037 (0.64) 5 3 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_plots-plots-show-json[2.58.2] 433.1808 (1.0) 453.6198 (1.0) 442.0526 (1.0) 7.5086 (2.31) 440.4938 (1.0) 8.4522 (2.28) 2;0 2.2622 (1.0) 5 3 test_plots-plots-show-json[3.10.0] 804.7076 (1.86) 817.4961 (1.80) 811.0300 (1.83) 5.2018 (1.60) 809.7916 (1.84) 8.4277 (2.28) 2;0 1.2330 (0.55) 5 3 test_plots-plots-show-json[3.53.2] 692.9781 (1.60) 701.8129 (1.55) 696.8199 (1.58) 3.2519 (1.0) 696.0824 (1.58) 3.7011 (1.0) 2;0 1.4351 (0.63) 5 3 test_plots-plots-show-json[main] 692.5482 (1.60) 705.4274 (1.56) 697.7532 (1.58) 5.0728 (1.56) 697.9873 (1.58) 7.0789 (1.91) 2;0 1.4332 (0.63) 5 3 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_push-push[2.58.2] 3.5911 (2.55) 3.5911 (2.55) 3.5911 (2.55) 0.0000 (1.0) 3.5911 (2.55) 0.0000 (1.0) 0;0 0.2785 (0.39) 1 1 test_push-push[3.10.0] 2.2014 (1.57) 2.2014 (1.57) 2.2014 (1.57) 0.0000 (1.0) 2.2014 (1.57) 0.0000 (1.0) 0;0 0.4543 (0.64) 1 1 test_push-push[3.53.2] 1.6316 (1.16) 1.6316 (1.16) 1.6316 (1.16) 0.0000 (1.0) 1.6316 (1.16) 0.0000 (1.0) 0;0 0.6129 (0.86) 1 1 test_push-push[main] 1.4060 (1.0) 1.4060 (1.0) 1.4060 (1.0) 0.0000 (1.0) 1.4060 (1.0) 0.0000 (1.0) 0;0 0.7112 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_sharing-add': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[2.58.2] 3.9857 (1.90) 3.9857 (1.90) 3.9857 (1.90) 0.0000 (1.0) 3.9857 (1.90) 0.0000 (1.0) 0;0 0.2509 (0.53) 1 1 test_sharing-add[3.10.0] 3.8019 (1.81) 3.8019 (1.81) 3.8019 (1.81) 0.0000 (1.0) 3.8019 (1.81) 0.0000 (1.0) 0;0 0.2630 (0.55) 1 1 test_sharing-add[3.53.2] 3.5423 (1.68) 3.5423 (1.68) 3.5423 (1.68) 0.0000 (1.0) 3.5423 (1.68) 0.0000 (1.0) 0;0 0.2823 (0.59) 1 1 test_sharing-add[main] 2.1027 (1.0) 2.1027 (1.0) 2.1027 (1.0) 0.0000 (1.0) 2.1027 (1.0) 0.0000 (1.0) 0;0 0.4756 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add-noop[2.58.2] 2.6370 (3.44) 2.6370 (3.44) 2.6370 (3.44) 0.0000 (1.0) 2.6370 (3.44) 0.0000 (1.0) 0;0 0.3792 (0.29) 1 1 test_sharing-add-noop[3.10.0] 2.5039 (3.27) 2.5039 (3.27) 2.5039 (3.27) 0.0000 (1.0) 2.5039 (3.27) 0.0000 (1.0) 0;0 0.3994 (0.31) 1 1 test_sharing-add-noop[3.53.2] 2.2303 (2.91) 2.2303 (2.91) 2.2303 (2.91) 0.0000 (1.0) 2.2303 (2.91) 0.0000 (1.0) 0;0 0.4484 (0.34) 1 1 test_sharing-add-noop[main] 0.7667 (1.0) 0.7667 (1.0) 0.7667 (1.0) 0.0000 (1.0) 0.7667 (1.0) 0.0000 (1.0) 0;0 1.3043 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-checkout': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout[2.58.2] 1.9051 (1.61) 1.9051 (1.61) 1.9051 (1.61) 0.0000 (1.0) 1.9051 (1.61) 0.0000 (1.0) 0;0 0.5249 (0.62) 1 1 test_sharing-checkout[3.10.0] 3.7418 (3.17) 3.7418 (3.17) 3.7418 (3.17) 0.0000 (1.0) 3.7418 (3.17) 0.0000 (1.0) 0;0 0.2672 (0.32) 1 1 test_sharing-checkout[3.53.2] 1.4099 (1.19) 1.4099 (1.19) 1.4099 (1.19) 0.0000 (1.0) 1.4099 (1.19) 0.0000 (1.0) 0;0 0.7093 (0.84) 1 1 test_sharing-checkout[main] 1.1803 (1.0) 1.1803 (1.0) 1.1803 (1.0) 0.0000 (1.0) 1.1803 (1.0) 0.0000 (1.0) 0;0 0.8473 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[2.58.2] 646.6095 (1.14) 646.6095 (1.14) 646.6095 (1.14) 0.0000 (1.0) 646.6095 (1.14) 0.0000 (1.0) 0;0 1.5465 (0.88) 1 1 test_sharing-checkout-noop[3.10.0] 648.2709 (1.14) 648.2709 (1.14) 648.2709 (1.14) 0.0000 (1.0) 648.2709 (1.14) 0.0000 (1.0) 0;0 1.5426 (0.88) 1 1 test_sharing-checkout-noop[3.53.2] 611.8129 (1.08) 611.8129 (1.08) 611.8129 (1.08) 0.0000 (1.0) 611.8129 (1.08) 0.0000 (1.0) 0;0 1.6345 (0.93) 1 1 test_sharing-checkout-noop[main] 568.6580 (1.0) 568.6580 (1.0) 568.6580 (1.0) 0.0000 (1.0) 568.6580 (1.0) 0.0000 (1.0) 0;0 1.7585 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-fetch[2.58.2] 3.9722 (2.54) 3.9722 (2.54) 3.9722 (2.54) 0.0000 (1.0) 3.9722 (2.54) 0.0000 (1.0) 0;0 0.2517 (0.39) 1 1 test_sharing-fetch[3.10.0] 4.4106 (2.82) 4.4106 (2.82) 4.4106 (2.82) 0.0000 (1.0) 4.4106 (2.82) 0.0000 (1.0) 0;0 0.2267 (0.35) 1 1 test_sharing-fetch[3.53.2] 1.8836 (1.20) 1.8836 (1.20) 1.8836 (1.20) 0.0000 (1.0) 1.8836 (1.20) 0.0000 (1.0) 0;0 0.5309 (0.83) 1 1 test_sharing-fetch[main] 1.5639 (1.0) 1.5639 (1.0) 1.5639 (1.0) 0.0000 (1.0) 1.5639 (1.0) 0.0000 (1.0) 0;0 0.6394 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing-fetch-noop[2.58.2] 528.6037 (1.0) 528.6037 (1.0) 528.6037 (1.0) 0.0000 (1.0) 528.6037 (1.0) 0.0000 (1.0) 0;0 1.8918 (1.0) 1 1 test_sharing-fetch-noop[3.10.0] 591.0983 (1.12) 591.0983 (1.12) 591.0983 (1.12) 0.0000 (1.0) 591.0983 (1.12) 0.0000 (1.0) 0;0 1.6918 (0.89) 1 1 test_sharing-fetch-noop[3.53.2] 911.7692 (1.72) 911.7692 (1.72) 911.7692 (1.72) 0.0000 (1.0) 911.7692 (1.72) 0.0000 (1.0) 0;0 1.0968 (0.58) 1 1 test_sharing-fetch-noop[main] 906.5931 (1.72) 906.5931 (1.72) 906.5931 (1.72) 0.0000 (1.0) 906.5931 (1.72) 0.0000 (1.0) 0;0 1.1030 (0.58) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[2.58.2] 3.5494 (2.25) 3.5494 (2.25) 3.5494 (2.25) 0.0000 (1.0) 3.5494 (2.25) 0.0000 (1.0) 0;0 0.2817 (0.44) 1 1 test_sharing-push[3.10.0] 1.9531 (1.24) 1.9531 (1.24) 1.9531 (1.24) 0.0000 (1.0) 1.9531 (1.24) 0.0000 (1.0) 0;0 0.5120 (0.81) 1 1 test_sharing-push[3.53.2] 1.5763 (1.0) 1.5763 (1.0) 1.5763 (1.0) 0.0000 (1.0) 1.5763 (1.0) 0.0000 (1.0) 0;0 0.6344 (1.0) 1 1 test_sharing-push[main] 1.5834 (1.00) 1.5834 (1.00) 1.5834 (1.00) 0.0000 (1.0) 1.5834 (1.00) 0.0000 (1.0) 0;0 0.6316 (1.00) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[2.58.2] 543.9299 (1.04) 543.9299 (1.04) 543.9299 (1.04) 0.0000 (1.0) 543.9299 (1.04) 0.0000 (1.0) 0;0 1.8385 (0.97) 1 1 test_sharing-push-noop[3.10.0] 525.4590 (1.0) 525.4590 (1.0) 525.4590 (1.0) 0.0000 (1.0) 525.4590 (1.0) 0.0000 (1.0) 0;0 1.9031 (1.0) 1 1 test_sharing-push-noop[3.53.2] 918.7860 (1.75) 918.7860 (1.75) 918.7860 (1.75) 0.0000 (1.0) 918.7860 (1.75) 0.0000 (1.0) 0;0 1.0884 (0.57) 1 1 test_sharing-push-noop[main] 928.3703 (1.77) 928.3703 (1.77) 928.3703 (1.77) 0.0000 (1.0) 928.3703 (1.77) 0.0000 (1.0) 0;0 1.0772 (0.57) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status[2.58.2] 1.3517 (1.90) 1.3517 (1.90) 1.3517 (1.90) 0.0000 (1.0) 1.3517 (1.90) 0.0000 (1.0) 0;0 0.7398 (0.53) 1 1 test_status-status[3.10.0] 1.4547 (2.04) 1.4547 (2.04) 1.4547 (2.04) 0.0000 (1.0) 1.4547 (2.04) 0.0000 (1.0) 0;0 0.6874 (0.49) 1 1 test_status-status[3.53.2] 1.3246 (1.86) 1.3246 (1.86) 1.3246 (1.86) 0.0000 (1.0) 1.3246 (1.86) 0.0000 (1.0) 0;0 0.7549 (0.54) 1 1 test_status-status[main] 0.7115 (1.0) 0.7115 (1.0) 0.7115 (1.0) 0.0000 (1.0) 0.7115 (1.0) 0.0000 (1.0) 0;0 1.4054 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed[2.58.2] 553.0764 (1.17) 553.0764 (1.17) 553.0764 (1.17) 0.0000 (1.0) 553.0764 (1.17) 0.0000 (1.0) 0;0 1.8081 (0.86) 1 1 test_status-status-changed[3.10.0] 560.4523 (1.19) 560.4523 (1.19) 560.4523 (1.19) 0.0000 (1.0) 560.4523 (1.19) 0.0000 (1.0) 0;0 1.7843 (0.84) 1 1 test_status-status-changed[3.53.2] 546.2933 (1.16) 546.2933 (1.16) 546.2933 (1.16) 0.0000 (1.0) 546.2933 (1.16) 0.0000 (1.0) 0;0 1.8305 (0.87) 1 1 test_status-status-changed[main] 472.9009 (1.0) 472.9009 (1.0) 472.9009 (1.0) 0.0000 (1.0) 472.9009 (1.0) 0.0000 (1.0) 0;0 2.1146 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_status-status-changed-noop[2.58.2] 552.3586 (1.20) 552.3586 (1.20) 552.3586 (1.20) 0.0000 (1.0) 552.3586 (1.20) 0.0000 (1.0) 0;0 1.8104 (0.83) 1 1 test_status-status-changed-noop[3.10.0] 559.2803 (1.21) 559.2803 (1.21) 559.2803 (1.21) 0.0000 (1.0) 559.2803 (1.21) 0.0000 (1.0) 0;0 1.7880 (0.82) 1 1 test_status-status-changed-noop[3.53.2] 533.4261 (1.16) 533.4261 (1.16) 533.4261 (1.16) 0.0000 (1.0) 533.4261 (1.16) 0.0000 (1.0) 0;0 1.8747 (0.86) 1 1 test_status-status-changed-noop[main] 460.6302 (1.0) 460.6302 (1.0) 460.6302 (1.0) 0.0000 (1.0) 460.6302 (1.0) 0.0000 (1.0) 0;0 2.1709 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_status-status-noop[2.58.2] 552.3841 (1.21) 552.3841 (1.21) 552.3841 (1.21) 0.0000 (1.0) 552.3841 (1.21) 0.0000 (1.0) 0;0 1.8103 (0.83) 1 1 test_status-status-noop[3.10.0] 563.1234 (1.23) 563.1234 (1.23) 563.1234 (1.23) 0.0000 (1.0) 563.1234 (1.23) 0.0000 (1.0) 0;0 1.7758 (0.81) 1 1 test_status-status-noop[3.53.2] 529.4272 (1.16) 529.4272 (1.16) 529.4272 (1.16) 0.0000 (1.0) 529.4272 (1.16) 0.0000 (1.0) 0;0 1.8888 (0.86) 1 1 test_status-status-noop[main] 456.4558 (1.0) 456.4558 (1.0) 456.4558 (1.0) 0.0000 (1.0) 456.4558 (1.0) 0.0000 (1.0) 0;0 2.1908 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-import-url[2.58.2] 7.3994 (2.65) 7.3994 (2.65) 7.3994 (2.65) 0.0000 (1.0) 7.3994 (2.65) 0.0000 (1.0) 0;0 0.1351 (0.38) 1 1 test_update-import-url[3.10.0] 7.4145 (2.66) 7.4145 (2.66) 7.4145 (2.66) 0.0000 (1.0) 7.4145 (2.66) 0.0000 (1.0) 0;0 0.1349 (0.38) 1 1 test_update-import-url[3.53.2] 4.7673 (1.71) 4.7673 (1.71) 4.7673 (1.71) 0.0000 (1.0) 4.7673 (1.71) 0.0000 (1.0) 0;0 0.2098 (0.59) 1 1 test_update-import-url[main] 2.7924 (1.0) 2.7924 (1.0) 2.7924 (1.0) 0.0000 (1.0) 2.7924 (1.0) 0.0000 (1.0) 0;0 0.3581 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_update-update[2.58.2] 6.5170 (3.79) 6.5170 (3.79) 6.5170 (3.79) 0.0000 (1.0) 6.5170 (3.79) 0.0000 (1.0) 0;0 0.1534 (0.26) 1 1 test_update-update[3.10.0] 6.4493 (3.75) 6.4493 (3.75) 6.4493 (3.75) 0.0000 (1.0) 6.4493 (3.75) 0.0000 (1.0) 0;0 0.1551 (0.27) 1 1 test_update-update[3.53.2] 4.0253 (2.34) 4.0253 (2.34) 4.0253 (2.34) 0.0000 (1.0) 4.0253 (2.34) 0.0000 (1.0) 0;0 0.2484 (0.43) 1 1 test_update-update[main] 1.7202 (1.0) 1.7202 (1.0) 1.7202 (1.0) 0.0000 (1.0) 1.7202 (1.0) 0.0000 (1.0) 0;0 0.5813 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_update-update-noop[2.58.2] 956.2069 (1.58) 956.2069 (1.58) 956.2069 (1.58) 0.0000 (1.0) 956.2069 (1.58) 0.0000 (1.0) 0;0 1.0458 (0.63) 1 1 test_update-update-noop[3.10.0] 938.8577 (1.55) 938.8577 (1.55) 938.8577 (1.55) 0.0000 (1.0) 938.8577 (1.55) 0.0000 (1.0) 0;0 1.0651 (0.64) 1 1 test_update-update-noop[3.53.2] 930.9266 (1.54) 930.9266 (1.54) 930.9266 (1.54) 0.0000 (1.0) 930.9266 (1.54) 0.0000 (1.0) 0;0 1.0742 (0.65) 1 1 test_update-update-noop[main] 604.2120 (1.0) 604.2120 (1.0) 604.2120 (1.0) 0.0000 (1.0) 604.2120 (1.0) 0.0000 (1.0) 0;0 1.6550 (1.0) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 month ago 
github-actions[bot]
commented
1 month ago