search

iterative / dvc-bench

Benchmarks for DVC
http://bench.dvc.org/
Apache License 2.0
20 stars 10 forks source link

fix ci #406

Closed dtrifiro closed 1 year ago

dtrifiro commented 1 year ago

use ubuntu-latest everywhere (see https://github.com/actions/runner-images/issues/6002)

github-actions[bot] commented 1 year ago 

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 394.3185 (1.09) 394.3185 (1.09) 394.3185 (1.09) 0.0000 (1.0) 394.3185 (1.09) 0.0000 (1.0) 0;0 2.5360 (0.92) 1 1
test_list-list[2.18.1] 361.1300 (1.0) 361.1300 (1.0) 361.1300 (1.0) 0.0000 (1.0) 361.1300 (1.0) 0.0000 (1.0) 0;0 2.7691 (1.0) 1 1
test_list-list[2.24.0] 373.5055 (1.03) 373.5055 (1.03) 373.5055 (1.03) 0.0000 (1.0) 373.5055 (1.03) 0.0000 (1.0) 0;0 2.6773 (0.97) 1 1
test_list-list[2.6.3] 426.4032 (1.18) 426.4032 (1.18) 426.4032 (1.18) 0.0000 (1.0) 426.4032 (1.18) 0.0000 (1.0) 0;0 2.3452 (0.85) 1 1
test_list-list[main] 379.6273 (1.05) 379.6273 (1.05) 379.6273 (1.05) 0.0000 (1.0) 379.6273 (1.05) 0.0000 (1.0) 0;0 2.6342 (0.95) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 382.5784 (1.03) 382.5784 (1.03) 382.5784 (1.03) 0.0000 (1.0) 382.5784 (1.03) 0.0000 (1.0) 0;0 2.6138 (0.97) 1 1
test_list-list-dvc-only[2.18.1] 459.9560 (1.24) 459.9560 (1.24) 459.9560 (1.24) 0.0000 (1.0) 459.9560 (1.24) 0.0000 (1.0) 0;0 2.1741 (0.81) 1 1
test_list-list-dvc-only[2.24.0] 370.5605 (1.0) 370.5605 (1.0) 370.5605 (1.0) 0.0000 (1.0) 370.5605 (1.0) 0.0000 (1.0) 0;0 2.6986 (1.0) 1 1
test_list-list-dvc-only[2.6.3] 393.1266 (1.06) 393.1266 (1.06) 393.1266 (1.06) 0.0000 (1.0) 393.1266 (1.06) 0.0000 (1.0) 0;0 2.5437 (0.94) 1 1
test_list-list-dvc-only[main] 377.3874 (1.02) 377.3874 (1.02) 377.3874 (1.02) 0.0000 (1.0) 377.3874 (1.02) 0.0000 (1.0) 0;0 2.6498 (0.98) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.6480 (1.67) 1.6480 (1.67) 1.6480 (1.67) 0.0000 (1.0) 1.6480 (1.67) 0.0000 (1.0) 0;0 0.6068 (0.60) 1 1
test_list-list-recursive[2.18.1] 2.3346 (2.37) 2.3346 (2.37) 2.3346 (2.37) 0.0000 (1.0) 2.3346 (2.37) 0.0000 (1.0) 0;0 0.4283 (0.42) 1 1
test_list-list-recursive[2.24.0] 1.0253 (1.04) 1.0253 (1.04) 1.0253 (1.04) 0.0000 (1.0) 1.0253 (1.04) 0.0000 (1.0) 0;0 0.9753 (0.96) 1 1
test_list-list-recursive[2.6.3] 1.0014 (1.02) 1.0014 (1.02) 1.0014 (1.02) 0.0000 (1.0) 1.0014 (1.02) 0.0000 (1.0) 0;0 0.9986 (0.98) 1 1
test_list-list-recursive[main] 0.9849 (1.0) 0.9849 (1.0) 0.9849 (1.0) 0.0000 (1.0) 0.9849 (1.0) 0.0000 (1.0) 0;0 1.0153 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```
github-actions[bot] commented 1 year ago 

---------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.11.0] 406.0013 (1.14) 406.0013 (1.14) 406.0013 (1.14) 0.0000 (1.0) 406.0013 (1.14) 0.0000 (1.0) 0;0 2.4630 (0.88) 1 1
test_list-list[2.18.1] 356.3033 (1.0) 356.3033 (1.0) 356.3033 (1.0) 0.0000 (1.0) 356.3033 (1.0) 0.0000 (1.0) 0;0 2.8066 (1.0) 1 1
test_list-list[2.24.0] 369.3452 (1.04) 369.3452 (1.04) 369.3452 (1.04) 0.0000 (1.0) 369.3452 (1.04) 0.0000 (1.0) 0;0 2.7075 (0.96) 1 1
test_list-list[2.6.3] 478.9603 (1.34) 478.9603 (1.34) 478.9603 (1.34) 0.0000 (1.0) 478.9603 (1.34) 0.0000 (1.0) 0;0 2.0879 (0.74) 1 1
test_list-list[main] 382.1020 (1.07) 382.1020 (1.07) 382.1020 (1.07) 0.0000 (1.0) 382.1020 (1.07) 0.0000 (1.0) 0;0 2.6171 (0.93) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.11.0] 382.9795 (1.09) 382.9795 (1.09) 382.9795 (1.09) 0.0000 (1.0) 382.9795 (1.09) 0.0000 (1.0) 0;0 2.6111 (0.92) 1 1
test_list-list-dvc-only[2.18.1] 350.8165 (1.0) 350.8165 (1.0) 350.8165 (1.0) 0.0000 (1.0) 350.8165 (1.0) 0.0000 (1.0) 0;0 2.8505 (1.0) 1 1
test_list-list-dvc-only[2.24.0] 367.8784 (1.05) 367.8784 (1.05) 367.8784 (1.05) 0.0000 (1.0) 367.8784 (1.05) 0.0000 (1.0) 0;0 2.7183 (0.95) 1 1
test_list-list-dvc-only[2.6.3] 389.9155 (1.11) 389.9155 (1.11) 389.9155 (1.11) 0.0000 (1.0) 389.9155 (1.11) 0.0000 (1.0) 0;0 2.5647 (0.90) 1 1
test_list-list-dvc-only[main] 376.7531 (1.07) 376.7531 (1.07) 376.7531 (1.07) 0.0000 (1.0) 376.7531 (1.07) 0.0000 (1.0) 0;0 2.6543 (0.93) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------ benchmark 'test_list-list-recursive': 5 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.11.0] 1.6467 (2.18) 1.6467 (2.18) 1.6467 (2.18) 0.0000 (1.0) 1.6467 (2.18) 0.0000 (1.0) 0;0 0.6073 (0.46) 1 1
test_list-list-recursive[2.18.1] 2.3175 (3.07) 2.3175 (3.07) 2.3175 (3.07) 0.0000 (1.0) 2.3175 (3.07) 0.0000 (1.0) 0;0 0.4315 (0.33) 1 1
test_list-list-recursive[2.24.0] 1.0162 (1.35) 1.0162 (1.35) 1.0162 (1.35) 0.0000 (1.0) 1.0162 (1.35) 0.0000 (1.0) 0;0 0.9841 (0.74) 1 1
test_list-list-recursive[2.6.3] 0.9878 (1.31) 0.9878 (1.31) 0.9878 (1.31) 0.0000 (1.0) 0.9878 (1.31) 0.0000 (1.0) 0;0 1.0124 (0.76) 1 1
test_list-list-recursive[main] 0.7548 (1.0) 0.7548 (1.0) 0.7548 (1.0) 0.0000 (1.0) 0.7548 (1.0) 0.0000 (1.0) 0;0 1.3248 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```