search

TooTouch / MemSeg

Unofficial re-implementation of MemSeg for Anomaly Detection
MIT License
184 stars 31 forks source link

Why the evaluation is slow? #9

Closed EudicL closed 1 year ago

EudicL commented 1 year ago

The process takes up half of my training time.

TooTouch commented 1 year ago

Hi, @EudicL

AUPRO has the biggest impact on the reason why the evaluation takes a long time.

AUPRO, like AUROC, is a threshold independent metric. AUPRO binarizes the predicted pixel-level anomaly score for each threshold for one image, and calculates the IOU with ground truth mask. Therefore, the evaluation is time consuming because it requires the same process for all the test images.