search

iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

raise proper error if minversion is not specified #429

Closed skshetry closed 1 year ago

github-actions[bot] commented 1 year ago 

------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.39.0] 1.3791 (1.31) 1.4229 (1.31) 1.4007 (1.31) 0.0164 (1.44) 1.4021 (1.32) 0.0222 (1.34) 2;0 0.7139 (0.76) 5 3
test_plots-plots-diff[2.40.0] 1.3692 (1.30) 1.3967 (1.28) 1.3843 (1.29) 0.0114 (1.0) 1.3816 (1.30) 0.0183 (1.10) 2;0 0.7224 (0.77) 5 3
test_plots-plots-diff[2.41.1] 1.3551 (1.28) 1.3926 (1.28) 1.3750 (1.29) 0.0174 (1.53) 1.3740 (1.29) 0.0331 (1.99) 3;0 0.7273 (0.78) 5 3
test_plots-plots-diff[2.45.0] 1.2575 (1.19) 1.3005 (1.20) 1.2710 (1.19) 0.0172 (1.51) 1.2638 (1.19) 0.0169 (1.01) 1;0 0.7868 (0.84) 5 3
test_plots-plots-diff[main] 1.0548 (1.0) 1.0879 (1.0) 1.0694 (1.0) 0.0126 (1.10) 1.0656 (1.0) 0.0167 (1.0) 2;0 0.9351 (1.0) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.39.0] 2.5076 (1.72) 2.5982 (1.71) 2.5368 (1.72) 0.0367 (1.56) 2.5259 (1.72) 0.0445 (1.86) 1;0 0.3942 (0.58) 5 3
test_plots-plots-diff-json[2.40.0] 2.4935 (1.71) 2.5557 (1.68) 2.5154 (1.70) 0.0253 (1.07) 2.5135 (1.71) 0.0347 (1.45) 1;0 0.3975 (0.59) 5 3
test_plots-plots-diff-json[2.41.1] 2.4983 (1.71) 2.5708 (1.69) 2.5179 (1.71) 0.0306 (1.30) 2.5038 (1.70) 0.0319 (1.33) 1;0 0.3972 (0.59) 5 3
test_plots-plots-diff-json[2.45.0] 2.2732 (1.56) 2.3278 (1.53) 2.2878 (1.55) 0.0236 (1.0) 2.2737 (1.55) 0.0266 (1.12) 1;0 0.4371 (0.65) 5 3
test_plots-plots-diff-json[main] 1.4603 (1.0) 1.5181 (1.0) 1.4767 (1.0) 0.0238 (1.01) 1.4694 (1.0) 0.0239 (1.0) 1;0 0.6772 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.39.0] 936.8248 (1.12) 947.3621 (1.07) 944.6837 (1.11) 4.4184 (1.0) 946.3037 (1.12) 3.0943 (1.0) 1;1 1.0586 (0.90) 5 3
test_plots-plots-show[2.40.0] 934.8750 (1.12) 945.4621 (1.07) 939.3588 (1.10) 4.4996 (1.02) 938.4902 (1.11) 7.6885 (2.48) 1;0 1.0646 (0.91) 5 3
test_plots-plots-show[2.41.1] 928.3475 (1.11) 954.7442 (1.08) 943.5721 (1.10) 9.8390 (2.23) 946.0591 (1.12) 11.7093 (3.78) 2;0 1.0598 (0.91) 5 3
test_plots-plots-show[2.45.0] 892.7419 (1.07) 947.6017 (1.07) 924.3629 (1.08) 22.6598 (5.13) 935.3681 (1.10) 34.6448 (11.20) 2;0 1.0818 (0.92) 5 3
test_plots-plots-show[main] 833.5751 (1.0) 883.1612 (1.0) 854.1364 (1.0) 20.0833 (4.55) 847.0354 (1.0) 30.6692 (9.91) 2;0 1.1708 (1.0) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.39.0] 1.5126 (1.43) 1.5625 (1.45) 1.5374 (1.44) 0.0202 (2.82) 1.5401 (1.44) 0.0330 (3.66) 2;0 0.6504 (0.69) 5 3
test_plots-plots-show-json[2.40.0] 1.5185 (1.44) 1.6393 (1.52) 1.5741 (1.47) 0.0493 (6.88) 1.5608 (1.46) 0.0798 (8.85) 2;0 0.6353 (0.68) 5 3
test_plots-plots-show-json[2.41.1] 1.5201 (1.44) 1.5495 (1.44) 1.5333 (1.44) 0.0111 (1.54) 1.5322 (1.44) 0.0147 (1.63) 2;0 0.6522 (0.70) 5 3
test_plots-plots-show-json[2.45.0] 1.4349 (1.36) 1.4543 (1.35) 1.4443 (1.35) 0.0072 (1.0) 1.4452 (1.36) 0.0090 (1.0) 2;0 0.6924 (0.74) 5 3
test_plots-plots-show-json[main] 1.0575 (1.0) 1.0797 (1.0) 1.0680 (1.0) 0.0092 (1.29) 1.0662 (1.0) 0.0156 (1.73) 2;0 0.9363 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```