paperswithcode / sotabench-eval

Easily evaluate machine learning models on public benchmarks
Apache License 2.0
171 stars 27 forks source link

Bug fix os.path.isdir() to os.path.isfile() in coco.py #14

Closed glenn-jocher closed 4 years ago

glenn-jocher commented 4 years ago

Current code produces an error when the file is present, as the current code is looking for a directory. Fix corrects this.

glenn-jocher commented 4 years ago

This is part of a bug fix as we are trying to add sotabench functionality to the YOLOv5 repository: https://github.com/ultralytics/yolov5

mkardas commented 4 years ago

Hi Glenn, thanks for the PR, the change has been released in 0.0.38.

glenn-jocher commented 4 years ago

@mkardas great, thanks! I've tried to integrate YOLOv5 with sotabench, as I think our implementation would show impressive speed-mAP performance, but unfortunately all of our builds keep getting skipped. Do you have any ideas for why this might happen, or could you point me in the right direction for who to talk to? Thanks!

Screen Shot 2020-09-07 at 10 11 50 AM