ORippler / gaussian-ad-mvtec

Code underlying our publication "Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detection" at ICPR2020
GNU Affero General Public License v3.0
97 stars 17 forks source link

About the seismic colormap #7

Open suger111 opened 1 year ago

suger111 commented 1 year ago

Hi,Can the code to get the seismic colormap be made publicly available?

suger111 commented 1 year ago

Or how do you view the test results of a test set for a specific image?

ORippler commented 1 year ago

Or how do you view the test results of a test set for a specific image?

Our method does not provide anomaly segmentation results per-se, as we aggregate over all spatial locations by means of average pooling before modeling the PDF by means of MVG. If you are interested in anomaly segmentation results, I refer you to PaDiM, which extended our approach to model the PDF "per-pixel"/spatial location inside the intermediate feature representations by means of MVG. A good implementation for PaDiM is contained in anomalib, and we strongly recommend anomalib in general, as you can find many other algorithms also there.

Can the code to get the seismic colormap be made publicly available?

The heatmaps in our paper are generated by applying XAI techniques, i.e. they are a means to attribute how much the individual pixels contributed to the image-level anomaly score by means of modified backpropagation. Such techniques are in general more compute intensive than those that generate segmentations directly (e.g. PaDiM/PatchCore), and suffer from their own drawbacks (refer also the paper). If you are interested in XAI, I can try to make the time to publish the code also here (iirc we were refactoring it but never got around to publishing it). Here, I would recommend you to apply XAI to the heatmaps generated by PaDiM/PatchCore to resolve the non-linear contribution of the input pixels to the per-location anomaly scores as a direction of future research (this would require numerous code changes though).

Hope this helps.

suger111 commented 1 year ago

OK. Thank you so much.