search

furiosa-ai / furiosa-models

FuriosaAI Model Zoo Project
https://furiosa-ai.github.io/furiosa-models/
Apache License 2.0
9 stars 6 forks source link

TEST: just to trigger ci #152

Closed furiosamg closed 1 year ago

furiosamg commented 1 year ago

0.9.0 기준으로도 정확도가 차이 나는지 테스트 하기 위한 PR입니다. 차이나는 것 확인해서 PR 닫았습니다.

furiosa-infra commented 1 year ago

2ee5725 ci: set versions to 0.9.0


----------------------------------------------------- benchmark: 1 tests -----------------------------------------------------
Name (time in ms)                       Min       Max    Mean  StdDev  Median     IQR   Outliers       OPS  Rounds  Iterations
------------------------------------------------------------------------------------------------------------------------------
test_mlcommons_resnet50_accuracy     1.1020  104.3687  4.6133  1.8747  4.2250  1.0271  5250;5622  216.7632   50000           1
------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
furiosa-infra commented 1 year ago

2ee5725 ci: set versions to 0.9.0


--------------------------------------------------------------------------------------------------------- benchmark: 2 tests --------------------------------------------------------------------------------------------------------
Name (time in ms)                                                Min                   Max                Mean              StdDev              Median                 IQR            Outliers      OPS            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_mlcommons_ssd_resnet34_with_native_rust_pp_accuracy     48.0382 (1.0)        634.0815 (1.0)       58.6905 (1.0)       15.9558 (1.0)       57.9128 (1.0)        2.0504 (1.0)        17;215  17.0385 (1.0)        5000           1
test_mlcommons_ssd_resnet34_accuracy                         98.2647 (2.05)     1,589.6234 (2.51)     259.5852 (4.42)     101.3237 (6.35)     218.9932 (3.78)     102.4215 (49.95)     835;170   3.8523 (0.23)       5000           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean