search

rapidsai / crossfit

Metric calculation library
Apache License 2.0
2 stars 5 forks source link

Update dask "compute" benchmark #50

Closed rjzamora closed 7 months ago

rjzamora commented 7 months ago

Updates a simple dask example that no longer works. I'm not sure how important the example is either way, but I wanted to remove the code that no longer "works" at all.

github-actions[bot] commented 7 months ago

Benchmark comparison for 06afeee (main) vs a50a9136 (PR)


----------------------------------------------------------------------------------------------- benchmark: 2 tests -----------------------------------------------------------------------------------------------
Name (time in s)                                   Min                 Max                Mean             StdDev              Median                IQR            Outliers     OPS            Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fiqa_all_MiniLM_L6_v2 (0002_a50a913)     105.6069 (1.0)      112.8324 (1.0)      108.9961 (1.0)       2.9987 (1.0)      109.7626 (1.0)       4.8882 (1.0)           2;0  0.0092 (1.0)           5           1
test_fiqa_all_MiniLM_L6_v2 (0001_main)        106.1277 (1.00)     138.8260 (1.23)     116.6445 (1.07)     13.4842 (4.50)     109.9105 (1.00)     16.8672 (3.45)          1;0  0.0086 (0.93)          5           1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean