search

iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

plots: diff with HEAD #428

Closed skshetry closed 1 year ago

github-actions[bot] commented 1 year ago 

------------------------------------------------------------------------ benchmark 'test_plots-plots-diff': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.39.0] 1.2857 (1.29) 1.2928 (1.28) 1.2884 (1.28) 0.0032 (1.0) 1.2869 (1.28) 0.0054 (1.02) 1;0 0.7762 (0.78) 5 3
test_plots-plots-diff[2.40.0] 1.2788 (1.28) 1.3178 (1.30) 1.3022 (1.30) 0.0157 (4.89) 1.3007 (1.29) 0.0225 (4.23) 1;0 0.7679 (0.77) 5 3
test_plots-plots-diff[2.41.1] 1.2873 (1.29) 1.2955 (1.28) 1.2918 (1.29) 0.0033 (1.04) 1.2914 (1.29) 0.0053 (1.0) 2;0 0.7741 (0.78) 5 3
test_plots-plots-diff[2.45.0] 1.1705 (1.17) 1.1844 (1.17) 1.1779 (1.17) 0.0060 (1.87) 1.1770 (1.17) 0.0105 (1.98) 2;0 0.8490 (0.85) 5 3
test_plots-plots-diff[main] 0.9991 (1.0) 1.0101 (1.0) 1.0039 (1.0) 0.0043 (1.33) 1.0046 (1.0) 0.0060 (1.13) 2;0 0.9961 (1.0) 5 3
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_plots-plots-diff-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.39.0] 2.3931 (1.72) 2.4215 (1.63) 2.4067 (1.70) 0.0115 (1.0) 2.4036 (1.72) 0.0184 (1.01) 2;0 0.4155 (0.59) 5 3
test_plots-plots-diff-json[2.40.0] 2.3795 (1.71) 2.4228 (1.63) 2.3974 (1.69) 0.0192 (1.67) 2.3902 (1.71) 0.0335 (1.83) 1;0 0.4171 (0.59) 5 3
test_plots-plots-diff-json[2.41.1] 2.3823 (1.71) 2.4255 (1.64) 2.4003 (1.69) 0.0187 (1.63) 2.3931 (1.71) 0.0316 (1.73) 1;0 0.4166 (0.59) 5 3
test_plots-plots-diff-json[2.45.0] 2.1530 (1.55) 2.1826 (1.47) 2.1672 (1.53) 0.0120 (1.05) 2.1715 (1.55) 0.0183 (1.0) 2;0 0.4614 (0.65) 5 3
test_plots-plots-diff-json[main] 1.3902 (1.0) 1.4830 (1.0) 1.4164 (1.0) 0.0379 (3.30) 1.3996 (1.0) 0.0313 (1.71) 1;1 0.7060 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.39.0] 863.0851 (1.10) 874.7518 (1.10) 869.0562 (1.10) 4.1558 (1.0) 868.8201 (1.10) 3.8660 (1.0) 2;0 1.1507 (0.91) 5 3
test_plots-plots-show[2.40.0] 862.3705 (1.10) 871.2301 (1.09) 867.6378 (1.10) 4.3173 (1.04) 870.0845 (1.10) 7.7896 (2.01) 1;0 1.1526 (0.91) 5 3
test_plots-plots-show[2.41.1] 862.9064 (1.10) 885.4502 (1.11) 872.9607 (1.10) 8.9520 (2.15) 872.1570 (1.10) 13.9539 (3.61) 2;0 1.1455 (0.91) 5 3
test_plots-plots-show[2.45.0] 823.1589 (1.05) 838.9868 (1.05) 830.6579 (1.05) 6.0888 (1.47) 830.4938 (1.05) 8.9817 (2.32) 2;0 1.2039 (0.95) 5 3
test_plots-plots-show[main] 785.4900 (1.0) 796.0245 (1.0) 791.7418 (1.0) 4.2803 (1.03) 791.5022 (1.0) 6.5107 (1.68) 2;0 1.2630 (1.0) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_plots-plots-show-json': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.39.0] 1.4517 (1.45) 1.4683 (1.45) 1.4596 (1.45) 0.0070 (3.20) 1.4584 (1.45) 0.0120 (3.12) 2;0 0.6851 (0.69) 5 3
test_plots-plots-show-json[2.40.0] 1.4501 (1.45) 1.4705 (1.46) 1.4628 (1.45) 0.0077 (3.56) 1.4658 (1.45) 0.0083 (2.15) 1;0 0.6836 (0.69) 5 3
test_plots-plots-show-json[2.41.1] 1.4497 (1.45) 1.4653 (1.45) 1.4573 (1.45) 0.0059 (2.69) 1.4555 (1.44) 0.0075 (1.95) 2;0 0.6862 (0.69) 5 3
test_plots-plots-show-json[2.45.0] 1.3509 (1.35) 1.3560 (1.34) 1.3534 (1.35) 0.0022 (1.0) 1.3536 (1.34) 0.0039 (1.0) 2;0 0.7389 (0.74) 5 3
test_plots-plots-show-json[main] 1.0008 (1.0) 1.0099 (1.0) 1.0059 (1.0) 0.0041 (1.88) 1.0079 (1.0) 0.0070 (1.80) 1;0 0.9942 (1.0) 5 3
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```