search

rapidsai / crossfit

Metric calculation library
Apache License 2.0
2 stars 6 forks source link

add sentence piece tokenizer #43

Closed edknv closed 9 months ago

github-actions[bot] commented 9 months ago

Benchmark comparison for 4148673 (main) vs 29d6e1a6 (PR)


---------------------------------------------------------------------------------------------- benchmark: 2 tests ---------------------------------------------------------------------------------------------
Name (time in s)                                  Min                 Max                Mean            StdDev              Median               IQR            Outliers     OPS            Rounds  Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fiqa_all_MiniLM_L6_v2 (0001_main)        96.8604 (1.0)      105.0648 (1.0)      101.4376 (1.00)     3.0954 (1.03)     101.9218 (1.02)     4.1395 (1.04)          2;0  0.0099 (1.00)          5           1
test_fiqa_all_MiniLM_L6_v2 (0002_29d6e1a)     98.5476 (1.02)     105.8927 (1.01)     101.1966 (1.0)      2.9944 (1.0)       99.6028 (1.0)      3.9975 (1.0)           1;0  0.0099 (1.0)           5           1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean