search

roboflow / roboflow-100-benchmark

Code for replicating Roboflow 100 benchmark results and programmatically downloading benchmark datasets
https://www.rf100.org
MIT License
244 stars 23 forks source link

[WIP] Yolov8 results #35

Closed FrancescoSaverioZuppichini closed 1 year ago

FrancescoSaverioZuppichini commented 1 year ago

Description

Contains results and code to run YOLOv8 on RF100

Note some datasets failed, only on 88

[EDIT] there was an overlook from my side - basically the results for v8 were evaluated on the test, as it should be, while all the others on eval so they are not really comparable

category yolov5 yolov7 yolov8 glip
aerial 0.636 0.504286 0.707286 0.0238571
documents 0.716125 0.7225 0.79775 0.018625
electromagnetic 0.7423 0.639 0.7899 0.0697
microscopic 0.650727 0.59166 0.747455 0.0230909
real world 0.781659 0.705276 0.842171 0.117049
underwater 0.56 0.6624 0.7024 0.1876
videogames 0.863333 0.783167 0.881 0.1625
Total 0.7071 0.6583 0.7811 0.0860
FrancescoSaverioZuppichini commented 1 year ago

To everyone reading this, this results were not merged for a reason - they are using the test set while the others the val set so they are not comparable. Not sure why it was merged, must be overlooked by @Jacobsolawetz