search

ozendelait / rvc_devkit

Robust Vision Challenge Devkits
http://www.robustvision.net/
MIT License
107 stars 13 forks source link

[Timeout Error still exists] COCO (obj det) Submission Error #68

Closed linfeng93 closed 2 years ago

linfeng93 commented 2 years ago

I still got the "timeout" error @ozendelait @tylin

the scoring output logs as follows

Annotation Type: bbox Loading and spliting submission results ... Evaluating test-dev ... Some images have more than 100 detections. Results were cut to 100 detections per images on 1980 images. loading annotations into memory... Done (t=4.27s) creating index... index created! Loading and preparing results... DONE (t=25.80s) creating index... index created! evaluate category: person Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=43.81s). Accumulating evaluation results... DONE (t=4.64s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.614 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.856 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.678 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.426 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.695 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.799 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.204 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.615 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.704 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.542 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.780 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.875 evaluate category: bicycle Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.97s). Accumulating evaluation results... DONE (t=0.32s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.388 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.650 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.390 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.252 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.450 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.601 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.264 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.491 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.528 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.376 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.600 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.752 evaluate category: car Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=7.71s). Accumulating evaluation results... DONE (t=1.32s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.509 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.748 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.557 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.400 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.665 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.693 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.212 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.593 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.650 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.551 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.784 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.844 evaluate category: motorcycle Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=2.08s). Accumulating evaluation results... DONE (t=0.26s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.478 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.768 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.517 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.254 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.456 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.665 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.278 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.557 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.598 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.357 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.591 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.786 evaluate category: airplane Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.41s). Accumulating evaluation results... DONE (t=0.17s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.648 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.861 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.723 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.484 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.649 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.792 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.452 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.714 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.727 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.564 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.722 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.863 evaluate category: bus Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.82s). Accumulating evaluation results... DONE (t=0.37s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.734 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.875 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.810 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.262 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.636 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.847 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.532 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.821 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.827 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.513 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.772 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.910 evaluate category: train Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.59s). Accumulating evaluation results... DONE (t=0.28s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.701 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.888 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.783 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.205 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.489 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.761 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.644 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.798 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.806 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.567 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.622 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.857 evaluate category: truck Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=2.27s). Accumulating evaluation results... DONE (t=0.58s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.404 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.566 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.442 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.214 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.402 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.549 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.388 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.680 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.690 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.506 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.720 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.796 evaluate category: boat Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=4.19s). Accumulating evaluation results... DONE (t=0.58s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.340 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.610 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.330 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.260 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.425 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.457 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.155 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.436 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.545 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.443 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.627 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.716 evaluate category: traffic light Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=2.76s). Accumulating evaluation results... DONE (t=0.49s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.343 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.600 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.350 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.300 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.505 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.435 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.179 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.491 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.524 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.471 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.696 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.688 evaluate category: fire hydrant Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.23s). Accumulating evaluation results... DONE (t=0.18s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.677 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.838 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.757 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.431 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.667 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.808 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.716 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.769 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.769 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.558 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.745 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.889 evaluate category: stop sign Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.43s). Accumulating evaluation results... DONE (t=0.30s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.701 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.784 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.760 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.357 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.693 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.869 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.727 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.833 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.833 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.724 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.800 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.926 evaluate category: parking meter Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.56s). Accumulating evaluation results... DONE (t=0.42s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.454 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.619 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.477 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.145 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.511 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.684 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.430 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.641 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.644 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.329 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.712 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.858 evaluate category: bench Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=3.10s). Accumulating evaluation results... DONE (t=0.97s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.298 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.440 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.315 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.150 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.293 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.479 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.294 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.475 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.500 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.326 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.511 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.702 evaluate category: bird Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=8.76s). Accumulating evaluation results... DONE (t=0.91s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.482 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.699 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.526 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.343 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.668 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.732 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.212 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.499 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.610 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.487 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.775 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.855 evaluate category: cat Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.53s). Accumulating evaluation results... DONE (t=0.22s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.752 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.925 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.836 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.315 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.687 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.792 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.668 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.838 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.841 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.479 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.782 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.874 evaluate category: dog Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.71s). Accumulating evaluation results... DONE (t=0.32s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.735 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.896 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.824 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.371 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.731 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.809 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.669 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.829 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.831 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.574 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.823 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.892 evaluate category: horse Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.87s). Accumulating evaluation results... DONE (t=0.29s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.648 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.856 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.715 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.323 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.651 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.782 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.391 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.741 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.762 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.541 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.755 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.870 evaluate category: sheep Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=2.97s). Accumulating evaluation results... DONE (t=0.29s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.589 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.822 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.650 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.475 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.665 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.749 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.131 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.580 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.703 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.582 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.768 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.869 evaluate category: cow Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=3.48s). Accumulating evaluation results... DONE (t=0.48s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.612 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.831 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.673 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.448 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.657 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.829 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.201 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.634 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.736 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.612 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.778 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.907 evaluate category: elephant Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.83s). Accumulating evaluation results... DONE (t=0.22s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.749 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.918 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.830 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.516 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.695 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.838 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.351 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.774 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.832 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.667 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.788 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.900 evaluate category: bear Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.17s). Accumulating evaluation results... DONE (t=0.15s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.804 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.934 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.882 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.459 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.760 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.838 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.657 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.873 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.874 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.630 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.819 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.905 evaluate category: zebra Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox DONE (t=1.85s). Accumulating evaluation results... DONE (t=0.17s). Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.692 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.912 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.751 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.420 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.678 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.809 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.301 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.725 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.780 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.593 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.759 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.881 evaluate category: giraffe Running per image evaluation... useSegm (deprecated) is not None. Running bbox evaluation Evaluate annotation type bbox

the scoring error log as follows

WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap. /opt/conda/lib/python2.7/site-packages/matplotlib/font_manager.py:273: UserWarning: Matplotlib is building the font cache using fc-list. This may take a moment. warnings.warn('Matplotlib is building the font cache using fc-list. This may take a moment.') Execution time limit exceeded!

I tried to reduce the number of detections of each img (100 -> 75 -> 50 -> 25 -> 10), but still failed

Here are your submissions to date 1 | --- | coco.test.zip | 09/29/2022 20:11:33 | 80362466 | Failed |   |   2 | --- | coco.test100.zip | 09/29/2022 20:48:29 | 50793473 | Failed |   |   3 | --- | coco.test100.zip | 09/29/2022 21:12:20 | 50825518 | Failed |   |   4 | --- | coco.test100.zip | 09/30/2022 02:04:07 | 50809187 | Failed |   |   5 | --- | coco.test100.zip | 09/30/2022 07:44:00 | 50817353 | Failed |   |   6 | --- | coco.test100.zip | 09/30/2022 11:24:58 | 50805602 | Failed |   |   7 | --- | coco.test100.zip | 09/30/2022 14:26:50 | 50823228 | Failed |   |   8 | --- | 20221002_coco.test.zip | 10/01/2022 19:38:59 | 45555971 | Failed |   |   9 | --- | 20221002_coco.test.zip | 10/01/2022 20:06:25 | 45567731 | Failed |   |   10 | --- | 20221002_coco.test100.zip | 10/01/2022 20:33:38 | 45041369 | Failed |   |   11 | --- | 20221002_coco.test75.zip | 10/01/2022 20:52:02 | 41358681 | Failed |   |   12 | --- | 20221002_coco.test50.zip | 10/01/2022 21:00:52 | 31428913 | Failed |   |   13 | --- | 20221002_coco.test25.zip | 10/01/2022 21:08:17 | 24523058 | Failed |   |   14 | --- | 20221002_coco.test25.zip | 10/01/2022 21:16:29 | 17862323 | Failed |   |   15 | --- | 20221002_coco.test10.zip | 10/01/2022 21:33:49 | 12518230 | Failed

need some helps! many thanks

linfeng93 commented 2 years ago

it's ok now