search

iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

tests: do not load hydra_pytest #381

Closed skshetry closed 2 years ago

github-actions[bot] commented 2 years ago 

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.18.1] 1.1354 (1.01) 1.1354 (1.01) 1.1354 (1.01) 0.0000 (1.0) 1.1354 (1.01) 0.0000 (1.0) 0;0 0.8807 (0.99) 1 1
test_data_status_all_flags-data-changed[2.24.0] 1.1218 (1.0) 1.1218 (1.0) 1.1218 (1.0) 0.0000 (1.0) 1.1218 (1.0) 0.0000 (1.0) 0;0 0.8914 (1.0) 1 1
test_data_status_all_flags-data-changed[main] 1.1541 (1.03) 1.1541 (1.03) 1.1541 (1.03) 0.0000 (1.0) 1.1541 (1.03) 0.0000 (1.0) 0;0 0.8665 (0.97) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.18.1] 1.1347 (1.02) 1.1347 (1.02) 1.1347 (1.02) 0.0000 (1.0) 1.1347 (1.02) 0.0000 (1.0) 0;0 0.8813 (0.98) 1 1
test_data_status_all_flags-data-changed-noop[2.24.0] 1.1098 (1.0) 1.1098 (1.0) 1.1098 (1.0) 0.0000 (1.0) 1.1098 (1.0) 0.0000 (1.0) 0;0 0.9011 (1.0) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.1519 (1.04) 1.1519 (1.04) 1.1519 (1.04) 0.0000 (1.0) 1.1519 (1.04) 0.0000 (1.0) 0;0 0.8681 (0.96) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.18.1] 1.8818 (1.01) 1.8818 (1.01) 1.8818 (1.01) 0.0000 (1.0) 1.8818 (1.01) 0.0000 (1.0) 0;0 0.5314 (0.99) 1 1
test_data_status_all_flags-data-new[2.24.0] 1.8603 (1.0) 1.8603 (1.0) 1.8603 (1.0) 0.0000 (1.0) 1.8603 (1.0) 0.0000 (1.0) 0;0 0.5375 (1.0) 1 1
test_data_status_all_flags-data-new[main] 2.0348 (1.09) 2.0348 (1.09) 2.0348 (1.09) 0.0000 (1.0) 2.0348 (1.09) 0.0000 (1.0) 0;0 0.4915 (0.91) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.18.1] 1.0946 (1.01) 1.0946 (1.01) 1.0946 (1.01) 0.0000 (1.0) 1.0946 (1.01) 0.0000 (1.0) 0;0 0.9136 (0.99) 1 1
test_data_status_all_flags-data-noop[2.24.0] 1.0803 (1.0) 1.0803 (1.0) 1.0803 (1.0) 0.0000 (1.0) 1.0803 (1.0) 0.0000 (1.0) 0;0 0.9257 (1.0) 1 1
test_data_status_all_flags-data-noop[main] 1.1128 (1.03) 1.1128 (1.03) 1.1128 (1.03) 0.0000 (1.0) 1.1128 (1.03) 0.0000 (1.0) 0;0 0.8986 (0.97) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```