github-actions[bot]
commented
9 months ago Benchmark comparison for 06afeee (main) vs a50a9136 (PR)
----------------------------------------------------------------------------------------------- benchmark: 2 tests -----------------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fiqa_all_MiniLM_L6_v2 (0002_a50a913) 105.6069 (1.0) 112.8324 (1.0) 108.9961 (1.0) 2.9987 (1.0) 109.7626 (1.0) 4.8882 (1.0) 2;0 0.0092 (1.0) 5 1
test_fiqa_all_MiniLM_L6_v2 (0001_main) 106.1277 (1.00) 138.8260 (1.23) 116.6445 (1.07) 13.4842 (4.50) 109.9105 (1.00) 16.8672 (3.45) 1;0 0.0086 (0.93) 5 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
Updates a simple dask example that no longer works. I'm not sure how important the example is either way, but I wanted to remove the code that no longer "works" at all.