search

rohban-lab / Knowledge_Distillation_AD

82 stars 46 forks source link

RocAUC is too small #7

Open Nirvana-feng opened 2 years ago

Nirvana-feng commented 2 years ago

Hello, I would like to ask why the experimental RocAUC of the abnormal detection result of the capsule in my mvtec data set is only 0.5969

SMSD75 commented 2 years ago

Hi,

Can you reproduce other results?

Nirvana-feng commented 2 years ago

Yes, the results are very low

SMSD75 commented 2 years ago

Ok, please give us a while to check the reproducibility of the results. As far as I know, they haven't had any problem for the last two months, but I will recheck.

Niousha12 commented 2 years ago

Hi, I have checked the code, and there wasn't a problem with the results. My config file is attached, so you can check your config with mine.

config.zip

one-road commented 2 years ago

@Nirvana-feng For Detection test you should not(!) remove the good folder in {mvtec_class_name}/test/ folder. Please refer test_functions.py line 20~26 @SMSD75 @Niousha12 Could you change default class of MVTecAD dataset in config.yaml to 'bottle' not to repeat this kind of mistake?