Closed skshetry closed 1 year ago
Tue May 9 07:33:18 UTC 2023 dataset: small project: example-get-started ----------------------------------------------------------------------------------------- benchmark 'test_sharing-add': 2 tests ----------------------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-add[5369c067f4fec35bb956b5c8c000ca82e9318349] 3.4002 (1.0) 3.4002 (1.0) 3.4002 (1.0) 0.0000 (1.0) 3.4002 (1.0) 0.0000 (1.0) 0;0 0.2941 (1.0) 1 1 test_sharing-add[main] 3.5916 (1.06) 3.5916 (1.06) 3.5916 (1.06) 0.0000 (1.0) 3.5916 (1.06) 0.0000 (1.0) 0;0 0.2784 (0.95) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------- benchmark 'test_sharing-add-noop': 2 tests ----------------------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing-add-noop[5369c067f4fec35bb956b5c8c000ca82e9318349] 2.3980 (1.0) 2.3980 (1.0) 2.3980 (1.0) 0.0000 (1.0) 2.3980 (1.0) 0.0000 (1.0) 0;0 0.4170 (1.0) 1 1 test_sharing-add-noop[main] 2.3984 (1.00) 2.3984 (1.00) 2.3984 (1.00) 0.0000 (1.0) 2.3984 (1.00) 0.0000 (1.0) 0;0 0.4169 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ --------------------------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 2 tests --------------------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-checkout-noop[5369c067f4fec35bb956b5c8c000ca82e9318349] 659.4465 (1.0) 659.4465 (1.0) 659.4465 (1.0) 0.0000 (1.0) 659.4465 (1.0) 0.0000 (1.0) 0;0 1.5164 (1.0) 1 1 test_sharing-checkout-noop[main] 668.0056 (1.01) 668.0056 (1.01) 668.0056 (1.01) 0.0000 (1.0) 668.0056 (1.01) 0.0000 (1.0) 0;0 1.4970 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------- benchmark 'test_sharing-pull': 2 tests ----------------------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull[5369c067f4fec35bb956b5c8c000ca82e9318349] 6.3293 (1.00) 6.3293 (1.00) 6.3293 (1.00) 0.0000 (1.0) 6.3293 (1.00) 0.0000 (1.0) 0;0 0.1580 (1.00) 1 1 test_sharing-pull[main] 6.3176 (1.0) 6.3176 (1.0) 6.3176 (1.0) 0.0000 (1.0) 6.3176 (1.0) 0.0000 (1.0) 0;0 0.1583 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 2 tests --------------------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-pull-noop[5369c067f4fec35bb956b5c8c000ca82e9318349] 713.6090 (1.0) 713.6090 (1.0) 713.6090 (1.0) 0.0000 (1.0) 713.6090 (1.0) 0.0000 (1.0) 0;0 1.4013 (1.0) 1 1 test_sharing-pull-noop[main] 719.2517 (1.01) 719.2517 (1.01) 719.2517 (1.01) 0.0000 (1.0) 719.2517 (1.01) 0.0000 (1.0) 0;0 1.3903 (0.99) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------- benchmark 'test_sharing-push': 2 tests ----------------------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push[5369c067f4fec35bb956b5c8c000ca82e9318349] 3.3102 (1.02) 3.3102 (1.02) 3.3102 (1.02) 0.0000 (1.0) 3.3102 (1.02) 0.0000 (1.0) 0;0 0.3021 (0.98) 1 1 test_sharing-push[main] 3.2599 (1.0) 3.2599 (1.0) 3.2599 (1.0) 0.0000 (1.0) 3.2599 (1.0) 0.0000 (1.0) 0;0 0.3068 (1.0) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 2 tests --------------------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing-push-noop[5369c067f4fec35bb956b5c8c000ca82e9318349] 567.0648 (1.00) 567.0648 (1.00) 567.0648 (1.00) 0.0000 (1.0) 567.0648 (1.00) 0.0000 (1.0) 0;0 1.7635 (1.00) 1 1 test_sharing-push-noop[main] 565.7719 (1.0) 565.7719 (1.0) 565.7719 (1.0) 0.0000 (1.0) 565.7719 (1.0) 0.0000 (1.0) 0;0 1.7675 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ------------------------------------------------------------------------ benchmark 'test_partial_add_s3-add-partial-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-add-partial-add[2.11.0] 9.8452 (3.08) 9.8452 (3.08) 9.8452 (3.08) 0.0000 (1.0) 9.8452 (3.08) 0.0000 (1.0) 0;0 0.1016 (0.32) 1 1 test_partial_add_s3-add-partial-add[2.18.1] 7.9960 (2.50) 7.9960 (2.50) 7.9960 (2.50) 0.0000 (1.0) 7.9960 (2.50) 0.0000 (1.0) 0;0 0.1251 (0.40) 1 1 test_partial_add_s3-add-partial-add[2.39.0] 5.8268 (1.82) 5.8268 (1.82) 5.8268 (1.82) 0.0000 (1.0) 5.8268 (1.82) 0.0000 (1.0) 0;0 0.1716 (0.55) 1 1 test_partial_add_s3-add-partial-add[2.40.0] 6.5860 (2.06) 6.5860 (2.06) 6.5860 (2.06) 0.0000 (1.0) 6.5860 (2.06) 0.0000 (1.0) 0;0 0.1518 (0.49) 1 1 test_partial_add_s3-add-partial-add[2.41.1] 5.9418 (1.86) 5.9418 (1.86) 5.9418 (1.86) 0.0000 (1.0) 5.9418 (1.86) 0.0000 (1.0) 0;0 0.1683 (0.54) 1 1 test_partial_add_s3-add-partial-add[2.45.0] 4.5566 (1.42) 4.5566 (1.42) 4.5566 (1.42) 0.0000 (1.0) 4.5566 (1.42) 0.0000 (1.0) 0;0 0.2195 (0.70) 1 1 test_partial_add_s3-add-partial-add[main] 3.1995 (1.0) 3.1995 (1.0) 3.1995 (1.0) 0.0000 (1.0) 3.1995 (1.0) 0.0000 (1.0) 0;0 0.3125 (1.0) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_add_s3-gc-cloud-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-gc-cloud-noop[2.11.0] 1.7732 (1.00) 1.7732 (1.00) 1.7732 (1.00) 0.0000 (1.0) 1.7732 (1.00) 0.0000 (1.0) 0;0 0.5640 (1.00) 1 1 test_partial_add_s3-gc-cloud-noop[2.18.1] 1.7837 (1.01) 1.7837 (1.01) 1.7837 (1.01) 0.0000 (1.0) 1.7837 (1.01) 0.0000 (1.0) 0;0 0.5606 (0.99) 1 1 test_partial_add_s3-gc-cloud-noop[2.39.0] 1.7731 (1.0) 1.7731 (1.0) 1.7731 (1.0) 0.0000 (1.0) 1.7731 (1.0) 0.0000 (1.0) 0;0 0.5640 (1.0) 1 1 test_partial_add_s3-gc-cloud-noop[2.40.0] 1.8321 (1.03) 1.8321 (1.03) 1.8321 (1.03) 0.0000 (1.0) 1.8321 (1.03) 0.0000 (1.0) 0;0 0.5458 (0.97) 1 1 test_partial_add_s3-gc-cloud-noop[2.41.1] 1.7931 (1.01) 1.7931 (1.01) 1.7931 (1.01) 0.0000 (1.0) 1.7931 (1.01) 0.0000 (1.0) 0;0 0.5577 (0.99) 1 1 test_partial_add_s3-gc-cloud-noop[2.45.0] 1.7845 (1.01) 1.7845 (1.01) 1.7845 (1.01) 0.0000 (1.0) 1.7845 (1.01) 0.0000 (1.0) 0;0 0.5604 (0.99) 1 1 test_partial_add_s3-gc-cloud-noop[main] 1.8555 (1.05) 1.8555 (1.05) 1.8555 (1.05) 0.0000 (1.0) 1.8555 (1.05) 0.0000 (1.0) 0;0 0.5389 (0.96) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_add_s3-gc-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-gc-noop[2.11.0] 536.8609 (1.0) 536.8609 (1.0) 536.8609 (1.0) 0.0000 (1.0) 536.8609 (1.0) 0.0000 (1.0) 0;0 1.8627 (1.0) 1 1 test_partial_add_s3-gc-noop[2.18.1] 578.8903 (1.08) 578.8903 (1.08) 578.8903 (1.08) 0.0000 (1.0) 578.8903 (1.08) 0.0000 (1.0) 0;0 1.7274 (0.93) 1 1 test_partial_add_s3-gc-noop[2.39.0] 628.2627 (1.17) 628.2627 (1.17) 628.2627 (1.17) 0.0000 (1.0) 628.2627 (1.17) 0.0000 (1.0) 0;0 1.5917 (0.85) 1 1 test_partial_add_s3-gc-noop[2.40.0] 621.4495 (1.16) 621.4495 (1.16) 621.4495 (1.16) 0.0000 (1.0) 621.4495 (1.16) 0.0000 (1.0) 0;0 1.6091 (0.86) 1 1 test_partial_add_s3-gc-noop[2.41.1] 643.3085 (1.20) 643.3085 (1.20) 643.3085 (1.20) 0.0000 (1.0) 643.3085 (1.20) 0.0000 (1.0) 0;0 1.5545 (0.83) 1 1 test_partial_add_s3-gc-noop[2.45.0] 602.7303 (1.12) 602.7303 (1.12) 602.7303 (1.12) 0.0000 (1.0) 602.7303 (1.12) 0.0000 (1.0) 0;0 1.6591 (0.89) 1 1 test_partial_add_s3-gc-noop[main] 705.5402 (1.31) 705.5402 (1.31) 705.5402 (1.31) 0.0000 (1.0) 705.5402 (1.31) 0.0000 (1.0) 0;0 1.4174 (0.76) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_partial_add_s3-push-partial-add': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add_s3-push-partial-add[2.11.0] 27.2175 (20.04) 27.2175 (20.04) 27.2175 (20.04) 0.0000 (1.0) 27.2175 (20.04) 0.0000 (1.0) 0;0 0.0367 (0.05) 1 1 test_partial_add_s3-push-partial-add[2.18.1] 25.7134 (18.93) 25.7134 (18.93) 25.7134 (18.93) 0.0000 (1.0) 25.7134 (18.93) 0.0000 (1.0) 0;0 0.0389 (0.05) 1 1 test_partial_add_s3-push-partial-add[2.39.0] 14.4440 (10.63) 14.4440 (10.63) 14.4440 (10.63) 0.0000 (1.0) 14.4440 (10.63) 0.0000 (1.0) 0;0 0.0692 (0.09) 1 1 test_partial_add_s3-push-partial-add[2.40.0] 15.0125 (11.05) 15.0125 (11.05) 15.0125 (11.05) 0.0000 (1.0) 15.0125 (11.05) 0.0000 (1.0) 0;0 0.0666 (0.09) 1 1 test_partial_add_s3-push-partial-add[2.41.1] 8.7440 (6.44) 8.7440 (6.44) 8.7440 (6.44) 0.0000 (1.0) 8.7440 (6.44) 0.0000 (1.0) 0;0 0.1144 (0.16) 1 1 test_partial_add_s3-push-partial-add[2.45.0] 6.4808 (4.77) 6.4808 (4.77) 6.4808 (4.77) 0.0000 (1.0) 6.4808 (4.77) 0.0000 (1.0) 0;0 0.1543 (0.21) 1 1 test_partial_add_s3-push-partial-add[main] 1.3584 (1.0) 1.3584 (1.0) 1.3584 (1.0) 0.0000 (1.0) 1.3584 (1.0) 0.0000 (1.0) 0;0 0.7361 (1.0) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove_s3-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-add[2.11.0] 3.9105 (5.75) 3.9105 (5.75) 3.9105 (5.75) 0.0000 (1.0) 3.9105 (5.75) 0.0000 (1.0) 0;0 0.2557 (0.17) 1 1 test_partial_remove_s3-add[2.18.1] 3.1828 (4.68) 3.1828 (4.68) 3.1828 (4.68) 0.0000 (1.0) 3.1828 (4.68) 0.0000 (1.0) 0;0 0.3142 (0.21) 1 1 test_partial_remove_s3-add[2.39.0] 2.4717 (3.64) 2.4717 (3.64) 2.4717 (3.64) 0.0000 (1.0) 2.4717 (3.64) 0.0000 (1.0) 0;0 0.4046 (0.28) 1 1 test_partial_remove_s3-add[2.40.0] 2.4109 (3.55) 2.4109 (3.55) 2.4109 (3.55) 0.0000 (1.0) 2.4109 (3.55) 0.0000 (1.0) 0;0 0.4148 (0.28) 1 1 test_partial_remove_s3-add[2.41.1] 0.6799 (1.0) 0.6799 (1.0) 0.6799 (1.0) 0.0000 (1.0) 0.6799 (1.0) 0.0000 (1.0) 0;0 1.4709 (1.0) 1 1 test_partial_remove_s3-add[2.45.0] 4.2027 (6.18) 4.2027 (6.18) 4.2027 (6.18) 0.0000 (1.0) 4.2027 (6.18) 0.0000 (1.0) 0;0 0.2379 (0.16) 1 1 test_partial_remove_s3-add[main] 2.0120 (2.96) 2.0120 (2.96) 2.0120 (2.96) 0.0000 (1.0) 2.0120 (2.96) 0.0000 (1.0) 0;0 0.4970 (0.34) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-gc': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-gc[2.11.0] 567.1548 (1.0) 567.1548 (1.0) 567.1548 (1.0) 0.0000 (1.0) 567.1548 (1.0) 0.0000 (1.0) 0;0 1.7632 (1.0) 1 1 test_partial_remove_s3-gc[2.18.1] 593.0284 (1.05) 593.0284 (1.05) 593.0284 (1.05) 0.0000 (1.0) 593.0284 (1.05) 0.0000 (1.0) 0;0 1.6863 (0.96) 1 1 test_partial_remove_s3-gc[2.39.0] 613.0135 (1.08) 613.0135 (1.08) 613.0135 (1.08) 0.0000 (1.0) 613.0135 (1.08) 0.0000 (1.0) 0;0 1.6313 (0.93) 1 1 test_partial_remove_s3-gc[2.40.0] 625.5177 (1.10) 625.5177 (1.10) 625.5177 (1.10) 0.0000 (1.0) 625.5177 (1.10) 0.0000 (1.0) 0;0 1.5987 (0.91) 1 1 test_partial_remove_s3-gc[2.41.1] 630.0501 (1.11) 630.0501 (1.11) 630.0501 (1.11) 0.0000 (1.0) 630.0501 (1.11) 0.0000 (1.0) 0;0 1.5872 (0.90) 1 1 test_partial_remove_s3-gc[2.45.0] 592.2061 (1.04) 592.2061 (1.04) 592.2061 (1.04) 0.0000 (1.0) 592.2061 (1.04) 0.0000 (1.0) 0;0 1.6886 (0.96) 1 1 test_partial_remove_s3-gc[main] 690.7858 (1.22) 690.7858 (1.22) 690.7858 (1.22) 0.0000 (1.0) 690.7858 (1.22) 0.0000 (1.0) 0;0 1.4476 (0.82) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_partial_remove_s3-gc-cloud': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-gc-cloud[2.11.0] 17.5757 (10.04) 17.5757 (10.04) 17.5757 (10.04) 0.0000 (1.0) 17.5757 (10.04) 0.0000 (1.0) 0;0 0.0569 (0.10) 1 1 test_partial_remove_s3-gc-cloud[2.18.1] 18.0202 (10.29) 18.0202 (10.29) 18.0202 (10.29) 0.0000 (1.0) 18.0202 (10.29) 0.0000 (1.0) 0;0 0.0555 (0.10) 1 1 test_partial_remove_s3-gc-cloud[2.39.0] 18.1965 (10.39) 18.1965 (10.39) 18.1965 (10.39) 0.0000 (1.0) 18.1965 (10.39) 0.0000 (1.0) 0;0 0.0550 (0.10) 1 1 test_partial_remove_s3-gc-cloud[2.40.0] 17.8945 (10.22) 17.8945 (10.22) 17.8945 (10.22) 0.0000 (1.0) 17.8945 (10.22) 0.0000 (1.0) 0;0 0.0559 (0.10) 1 1 test_partial_remove_s3-gc-cloud[2.41.1] 33.8172 (19.31) 33.8172 (19.31) 33.8172 (19.31) 0.0000 (1.0) 33.8172 (19.31) 0.0000 (1.0) 0;0 0.0296 (0.05) 1 1 test_partial_remove_s3-gc-cloud[2.45.0] 1.7512 (1.0) 1.7512 (1.0) 1.7512 (1.0) 0.0000 (1.0) 1.7512 (1.0) 0.0000 (1.0) 0;0 0.5710 (1.0) 1 1 test_partial_remove_s3-gc-cloud[main] 2.0142 (1.15) 2.0142 (1.15) 2.0142 (1.15) 0.0000 (1.0) 2.0142 (1.15) 0.0000 (1.0) 0;0 0.4965 (0.87) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_partial_remove_s3-push': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_remove_s3-push[2.11.0] 1.7691 (1.50) 1.7691 (1.50) 1.7691 (1.50) 0.0000 (1.0) 1.7691 (1.50) 0.0000 (1.0) 0;0 0.5653 (0.67) 1 1 test_partial_remove_s3-push[2.18.1] 1.8312 (1.55) 1.8312 (1.55) 1.8312 (1.55) 0.0000 (1.0) 1.8312 (1.55) 0.0000 (1.0) 0;0 0.5461 (0.64) 1 1 test_partial_remove_s3-push[2.39.0] 1.7849 (1.51) 1.7849 (1.51) 1.7849 (1.51) 0.0000 (1.0) 1.7849 (1.51) 0.0000 (1.0) 0;0 0.5603 (0.66) 1 1 test_partial_remove_s3-push[2.40.0] 1.7588 (1.49) 1.7588 (1.49) 1.7588 (1.49) 0.0000 (1.0) 1.7588 (1.49) 0.0000 (1.0) 0;0 0.5686 (0.67) 1 1 test_partial_remove_s3-push[2.41.1] 1.1806 (1.0) 1.1806 (1.0) 1.1806 (1.0) 0.0000 (1.0) 1.1806 (1.0) 0.0000 (1.0) 0;0 0.8470 (1.0) 1 1 test_partial_remove_s3-push[2.45.0] 1.2614 (1.07) 1.2614 (1.07) 1.2614 (1.07) 0.0000 (1.0) 1.2614 (1.07) 0.0000 (1.0) 0;0 0.7928 (0.94) 1 1 test_partial_remove_s3-push[main] 1.4311 (1.21) 1.4311 (1.21) 1.4311 (1.21) 0.0000 (1.0) 1.4311 (1.21) 0.0000 (1.0) 0;0 0.6988 (0.82) 1 1 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-add[2.11.0] 9.7962 (1.97) 9.7962 (1.97) 9.7962 (1.97) 0.0000 (1.0) 9.7962 (1.97) 0.0000 (1.0) 0;0 0.1021 (0.51) 1 1 test_sharing_s3-add[2.18.1] 7.8350 (1.58) 7.8350 (1.58) 7.8350 (1.58) 0.0000 (1.0) 7.8350 (1.58) 0.0000 (1.0) 0;0 0.1276 (0.63) 1 1 test_sharing_s3-add[2.39.0] 7.2904 (1.47) 7.2904 (1.47) 7.2904 (1.47) 0.0000 (1.0) 7.2904 (1.47) 0.0000 (1.0) 0;0 0.1372 (0.68) 1 1 test_sharing_s3-add[2.40.0] 7.5554 (1.52) 7.5554 (1.52) 7.5554 (1.52) 0.0000 (1.0) 7.5554 (1.52) 0.0000 (1.0) 0;0 0.1324 (0.66) 1 1 test_sharing_s3-add[2.41.1] 7.5074 (1.51) 7.5074 (1.51) 7.5074 (1.51) 0.0000 (1.0) 7.5074 (1.51) 0.0000 (1.0) 0;0 0.1332 (0.66) 1 1 test_sharing_s3-add[2.45.0] 4.9715 (1.0) 4.9715 (1.0) 4.9715 (1.0) 0.0000 (1.0) 4.9715 (1.0) 0.0000 (1.0) 0;0 0.2011 (1.0) 1 1 test_sharing_s3-add[main] 4.9897 (1.00) 4.9897 (1.00) 4.9897 (1.00) 0.0000 (1.0) 4.9897 (1.00) 0.0000 (1.0) 0;0 0.2004 (1.00) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ ------------------------------------------------------------------------ benchmark 'test_sharing_s3-add-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-add-noop[2.11.0] 4.3887 (1.45) 4.3887 (1.45) 4.3887 (1.45) 0.0000 (1.0) 4.3887 (1.45) 0.0000 (1.0) 0;0 0.2279 (0.69) 1 1 test_sharing_s3-add-noop[2.18.1] 4.5220 (1.50) 4.5220 (1.50) 4.5220 (1.50) 0.0000 (1.0) 4.5220 (1.50) 0.0000 (1.0) 0;0 0.2211 (0.67) 1 1 test_sharing_s3-add-noop[2.39.0] 3.0231 (1.0) 3.0231 (1.0) 3.0231 (1.0) 0.0000 (1.0) 3.0231 (1.0) 0.0000 (1.0) 0;0 0.3308 (1.0) 1 1 test_sharing_s3-add-noop[2.40.0] 3.1421 (1.04) 3.1421 (1.04) 3.1421 (1.04) 0.0000 (1.0) 3.1421 (1.04) 0.0000 (1.0) 0;0 0.3183 (0.96) 1 1 test_sharing_s3-add-noop[2.41.1] 3.0783 (1.02) 3.0783 (1.02) 3.0783 (1.02) 0.0000 (1.0) 3.0783 (1.02) 0.0000 (1.0) 0;0 0.3249 (0.98) 1 1 test_sharing_s3-add-noop[2.45.0] 3.2839 (1.09) 3.2839 (1.09) 3.2839 (1.09) 0.0000 (1.0) 3.2839 (1.09) 0.0000 (1.0) 0;0 0.3045 (0.92) 1 1 test_sharing_s3-add-noop[main] 3.3092 (1.09) 3.3092 (1.09) 3.3092 (1.09) 0.0000 (1.0) 3.3092 (1.09) 0.0000 (1.0) 0;0 0.3022 (0.91) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------------------------------------- benchmark 'test_sharing_s3-checkout-noop': 7 tests ---------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-checkout-noop[2.11.0] 628.3670 (1.0) 628.3670 (1.0) 628.3670 (1.0) 0.0000 (1.0) 628.3670 (1.0) 0.0000 (1.0) 0;0 1.5914 (1.0) 1 1 test_sharing_s3-checkout-noop[2.18.1] 733.5733 (1.17) 733.5733 (1.17) 733.5733 (1.17) 0.0000 (1.0) 733.5733 (1.17) 0.0000 (1.0) 0;0 1.3632 (0.86) 1 1 test_sharing_s3-checkout-noop[2.39.0] 727.5564 (1.16) 727.5564 (1.16) 727.5564 (1.16) 0.0000 (1.0) 727.5564 (1.16) 0.0000 (1.0) 0;0 1.3745 (0.86) 1 1 test_sharing_s3-checkout-noop[2.40.0] 719.7369 (1.15) 719.7369 (1.15) 719.7369 (1.15) 0.0000 (1.0) 719.7369 (1.15) 0.0000 (1.0) 0;0 1.3894 (0.87) 1 1 test_sharing_s3-checkout-noop[2.41.1] 713.8316 (1.14) 713.8316 (1.14) 713.8316 (1.14) 0.0000 (1.0) 713.8316 (1.14) 0.0000 (1.0) 0;0 1.4009 (0.88) 1 1 test_sharing_s3-checkout-noop[2.45.0] 764.1923 (1.22) 764.1923 (1.22) 764.1923 (1.22) 0.0000 (1.0) 764.1923 (1.22) 0.0000 (1.0) 0;0 1.3086 (0.82) 1 1 test_sharing_s3-checkout-noop[main] 857.1269 (1.36) 857.1269 (1.36) 857.1269 (1.36) 0.0000 (1.0) 857.1269 (1.36) 0.0000 (1.0) 0;0 1.1667 (0.73) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull[2.11.0] 18.3494 (1.17) 18.3494 (1.17) 18.3494 (1.17) 0.0000 (1.0) 18.3494 (1.17) 0.0000 (1.0) 0;0 0.0545 (0.85) 1 1 test_sharing_s3-pull[2.18.1] 18.5288 (1.18) 18.5288 (1.18) 18.5288 (1.18) 0.0000 (1.0) 18.5288 (1.18) 0.0000 (1.0) 0;0 0.0540 (0.85) 1 1 test_sharing_s3-pull[2.39.0] 18.3716 (1.17) 18.3716 (1.17) 18.3716 (1.17) 0.0000 (1.0) 18.3716 (1.17) 0.0000 (1.0) 0;0 0.0544 (0.85) 1 1 test_sharing_s3-pull[2.40.0] 19.0374 (1.22) 19.0374 (1.22) 19.0374 (1.22) 0.0000 (1.0) 19.0374 (1.22) 0.0000 (1.0) 0;0 0.0525 (0.82) 1 1 test_sharing_s3-pull[2.41.1] 19.6238 (1.25) 19.6238 (1.25) 19.6238 (1.25) 0.0000 (1.0) 19.6238 (1.25) 0.0000 (1.0) 0;0 0.0510 (0.80) 1 1 test_sharing_s3-pull[2.45.0] 15.7593 (1.01) 15.7593 (1.01) 15.7593 (1.01) 0.0000 (1.0) 15.7593 (1.01) 0.0000 (1.0) 0;0 0.0635 (0.99) 1 1 test_sharing_s3-pull[main] 15.6618 (1.0) 15.6618 (1.0) 15.6618 (1.0) 0.0000 (1.0) 15.6618 (1.0) 0.0000 (1.0) 0;0 0.0638 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- benchmark 'test_sharing_s3-pull-noop': 7 tests -------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-pull-noop[2.11.0] 958.5338 (1.0) 958.5338 (1.0) 958.5338 (1.0) 0.0000 (1.0) 958.5338 (1.0) 0.0000 (1.0) 0;0 1.0433 (1.0) 1 1 test_sharing_s3-pull-noop[2.18.1] 1,019.5723 (1.06) 1,019.5723 (1.06) 1,019.5723 (1.06) 0.0000 (1.0) 1,019.5723 (1.06) 0.0000 (1.0) 0;0 0.9808 (0.94) 1 1 test_sharing_s3-pull-noop[2.39.0] 969.3257 (1.01) 969.3257 (1.01) 969.3257 (1.01) 0.0000 (1.0) 969.3257 (1.01) 0.0000 (1.0) 0;0 1.0316 (0.99) 1 1 test_sharing_s3-pull-noop[2.40.0] 995.1268 (1.04) 995.1268 (1.04) 995.1268 (1.04) 0.0000 (1.0) 995.1268 (1.04) 0.0000 (1.0) 0;0 1.0049 (0.96) 1 1 test_sharing_s3-pull-noop[2.41.1] 1,025.5251 (1.07) 1,025.5251 (1.07) 1,025.5251 (1.07) 0.0000 (1.0) 1,025.5251 (1.07) 0.0000 (1.0) 0;0 0.9751 (0.93) 1 1 test_sharing_s3-pull-noop[2.45.0] 1,056.4775 (1.10) 1,056.4775 (1.10) 1,056.4775 (1.10) 0.0000 (1.0) 1,056.4775 (1.10) 0.0000 (1.0) 0;0 0.9465 (0.91) 1 1 test_sharing_s3-pull-noop[main] 1,139.3609 (1.19) 1,139.3609 (1.19) 1,139.3609 (1.19) 0.0000 (1.0) 1,139.3609 (1.19) 0.0000 (1.0) 0;0 0.8777 (0.84) 1 1 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------- benchmark 'test_sharing_s3-push': 7 tests -------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_sharing_s3-push[2.11.0] 26.7385 (2.28) 26.7385 (2.28) 26.7385 (2.28) 0.0000 (1.0) 26.7385 (2.28) 0.0000 (1.0) 0;0 0.0374 (0.44) 1 1 test_sharing_s3-push[2.18.1] 26.2995 (2.24) 26.2995 (2.24) 26.2995 (2.24) 0.0000 (1.0) 26.2995 (2.24) 0.0000 (1.0) 0;0 0.0380 (0.45) 1 1 test_sharing_s3-push[2.39.0] 27.2579 (2.32) 27.2579 (2.32) 27.2579 (2.32) 0.0000 (1.0) 27.2579 (2.32) 0.0000 (1.0) 0;0 0.0367 (0.43) 1 1 test_sharing_s3-push[2.40.0] 29.4540 (2.51) 29.4540 (2.51) 29.4540 (2.51) 0.0000 (1.0) 29.4540 (2.51) 0.0000 (1.0) 0;0 0.0340 (0.40) 1 1 test_sharing_s3-push[2.41.1] 14.8373 (1.27) 14.8373 (1.27) 14.8373 (1.27) 0.0000 (1.0) 14.8373 (1.27) 0.0000 (1.0) 0;0 0.0674 (0.79) 1 1 test_sharing_s3-push[2.45.0] 11.9738 (1.02) 11.9738 (1.02) 11.9738 (1.02) 0.0000 (1.0) 11.9738 (1.02) 0.0000 (1.0) 0;0 0.0835 (0.98) 1 1 test_sharing_s3-push[main] 11.7247 (1.0) 11.7247 (1.0) 11.7247 (1.0) 0.0000 (1.0) 11.7247 (1.0) 0.0000 (1.0) 0;0 0.0853 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------ benchmark 'test_sharing_s3-push-noop': 7 tests ------------------------------------------------------------------------ Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_sharing_s3-push-noop[2.11.0] 1.2109 (1.0) 1.2109 (1.0) 1.2109 (1.0) 0.0000 (1.0) 1.2109 (1.0) 0.0000 (1.0) 0;0 0.8258 (1.0) 1 1 test_sharing_s3-push-noop[2.18.1] 1.2680 (1.05) 1.2680 (1.05) 1.2680 (1.05) 0.0000 (1.0) 1.2680 (1.05) 0.0000 (1.0) 0;0 0.7886 (0.95) 1 1 test_sharing_s3-push-noop[2.39.0] 1.2171 (1.01) 1.2171 (1.01) 1.2171 (1.01) 0.0000 (1.0) 1.2171 (1.01) 0.0000 (1.0) 0;0 0.8216 (0.99) 1 1 test_sharing_s3-push-noop[2.40.0] 1.2406 (1.02) 1.2406 (1.02) 1.2406 (1.02) 0.0000 (1.0) 1.2406 (1.02) 0.0000 (1.0) 0;0 0.8061 (0.98) 1 1 test_sharing_s3-push-noop[2.41.1] 1.2602 (1.04) 1.2602 (1.04) 1.2602 (1.04) 0.0000 (1.0) 1.2602 (1.04) 0.0000 (1.0) 0;0 0.7935 (0.96) 1 1 test_sharing_s3-push-noop[2.45.0] 1.2657 (1.05) 1.2657 (1.05) 1.2657 (1.05) 0.0000 (1.0) 1.2657 (1.05) 0.0000 (1.0) 0;0 0.7901 (0.96) 1 1 test_sharing_s3-push-noop[main] 1.3373 (1.10) 1.3373 (1.10) 1.3373 (1.10) 0.0000 (1.0) 1.3373 (1.10) 0.0000 (1.0) 0;0 0.7478 (0.91) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------------------- benchmark 'test_add-add': 2 tests ----------------------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_add-add[5369c067f4fec35bb956b5c8c000ca82e9318349] 3.8335 (1.0) 3.8335 (1.0) 3.8335 (1.0) 0.0000 (1.0) 3.8335 (1.0) 0.0000 (1.0) 0;0 0.2609 (1.0) 1 1 test_add-add[main] 3.9280 (1.02) 3.9280 (1.02) 3.9280 (1.02) 0.0000 (1.0) 3.9280 (1.02) 0.0000 (1.0) 0;0 0.2546 (0.98) 1 1 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean ----------------------------------------------------------------------------------------- benchmark 'test_partial_add-add-partial-add': 2 tests ----------------------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-add-partial-add[5369c067f4fec35bb956b5c8c000ca82e9318349] 3.1964 (1.07) 3.1964 (1.07) 3.1964 (1.07) 0.0000 (1.0) 3.1964 (1.07) 0.0000 (1.0) 0;0 0.3129 (0.93) 1 1 test_partial_add-add-partial-add[main] 2.9786 (1.0) 2.9786 (1.0) 2.9786 (1.0) 0.0000 (1.0) 2.9786 (1.0) 0.0000 (1.0) 0;0 0.3357 (1.0) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 2 tests --------------------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-cloud-noop[5369c067f4fec35bb956b5c8c000ca82e9318349] 613.1468 (1.0) 613.1468 (1.0) 613.1468 (1.0) 0.0000 (1.0) 613.1468 (1.0) 0.0000 (1.0) 0;0 1.6309 (1.0) 1 1 test_partial_add-gc-cloud-noop[main] 615.2510 (1.00) 615.2510 (1.00) 615.2510 (1.00) 0.0000 (1.0) 615.2510 (1.00) 0.0000 (1.0) 0;0 1.6254 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 2 tests --------------------------------------------------------------------------------------------- Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- test_partial_add-gc-noop[5369c067f4fec35bb956b5c8c000ca82e9318349] 546.0903 (1.0) 546.0903 (1.0) 546.0903 (1.0) 0.0000 (1.0) 546.0903 (1.0) 0.0000 (1.0) 0;0 1.8312 (1.0) 1 1 test_partial_add-gc-noop[main] 546.6040 (1.00) 546.6040 (1.00) 546.6040 (1.00) 0.0000 (1.0) 546.6040 (1.00) 0.0000 (1.0) 0;0 1.8295 (1.00) 1 1 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- ----------------------------------------------------------------------------------------- benchmark 'test_partial_add-push-partial-add': 2 tests ----------------------------------------------------------------------------------------- Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ test_partial_add-push-partial-add[5369c067f4fec35bb956b5c8c000ca82e9318349] 1.9264 (1.0) 1.9264 (1.0) 1.9264 (1.0) 0.0000 (1.0) 1.9264 (1.0) 0.0000 (1.0) 0;0 0.5191 (1.0) 1 1 test_partial_add-push-partial-add[main] 1.9395 (1.01) 1.9395 (1.01) 1.9395 (1.01) 0.0000 (1.0) 1.9395 (1.01) 0.0000 (1.0) 0;0 0.5156 (0.99) 1 1 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ Legend: Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile. OPS: Operations Per Second, computed as 1 / Mean
github-actions[bot]
commented
1 year ago 
github-actions[bot]
commented
1 year ago