The AU-ROC of MVTec 3D

[leefty-1024]

Thanks you code. Do you have results of AU-ROC of MVTec 3D？

[caoyunkang]

Hi, thanks for your interest. Unfortunately, the results are not retained... You can easily get the results through a single run. Best.

[leefty-1024]

2024-03-01 14:58:35.144 | INFO | main:main:152 - bagel=======i_roc: 97.11 2024-03-01 14:58:35.144 | INFO | main:main:152 - bagel=======p_roc: 99.25 2024-03-01 14:58:35.144 | INFO | main:main:152 - bagel=======p_pro: 97.89 2024-03-01 14:58:35.145 | INFO | main:main:152 - bagel=======threshold: 0.81

2024-03-01 15:04:17.110 | INFO | main:main:152 - cable_gland=======i_roc: 86.97 2024-03-01 15:04:17.111 | INFO | main:main:152 - cable_gland=======p_roc: 98.71 2024-03-01 15:04:17.111 | INFO | main:main:152 - cable_gland=======p_pro: 96.67 2024-03-01 15:04:17.111 | INFO | main:main:152 - cable_gland=======threshold: 0.67

2024-03-01 15:11:44.142 | INFO | main:main:152 - carrot=======i_roc: 87.91 2024-03-01 15:11:44.143 | INFO | main:main:152 - carrot=======p_roc: 99.17 2024-03-01 15:11:44.143 | INFO | main:main:152 - carrot=======p_pro: 97.04 2024-03-01 15:11:44.143 | INFO | main:main:152 - carrot=======threshold: 0.65

2024-03-01 15:17:33.031 | INFO | main:main:152 - cookie=======i_roc: 68.24 2024-03-01 15:17:33.031 | INFO | main:main:152 - cookie=======p_roc: 98.34 2024-03-01 15:17:33.031 | INFO | main:main:152 - cookie=======p_pro: 92.17 2024-03-01 15:17:33.031 | INFO | main:main:152 - cookie=======threshold: 0.59

2024-03-01 15:24:42.228 | INFO | main:main:152 - dowel=======i_roc: 87.35 2024-03-01 15:24:42.228 | INFO | main:main:152 - dowel=======p_roc: 98.70 2024-03-01 15:24:42.228 | INFO | main:main:152 - dowel=======p_pro: 94.65 2024-03-01 15:24:42.228 | INFO | main:main:152 - dowel=======threshold: 0.51

2024-03-01 15:30:38.653 | INFO | main:main:152 - foam=======i_roc: 76.44 2024-03-01 15:30:38.653 | INFO | main:main:152 - foam=======p_roc: 85.97 2024-03-01 15:30:38.653 | INFO | main:main:152 - foam=======p_pro: 64.17 2024-03-01 15:30:38.653 | INFO | main:main:152 - foam=======threshold: 0.60

2024-03-01 15:39:09.857 | INFO | main:main:152 - peach=======i_roc: 94.41 2024-03-01 15:39:09.857 | INFO | main:main:152 - peach=======p_roc: 99.51 2024-03-01 15:39:09.857 | INFO | main:main:152 - peach=======p_pro: 98.45 2024-03-01 15:39:09.857 | INFO | main:main:152 - peach=======threshold: 0.73

2024-03-01 15:46:23.743 | INFO | main:main:152 - potato=======i_roc: 59.73 2024-03-01 15:46:23.743 | INFO | main:main:152 - potato=======p_roc: 99.02 2024-03-01 15:46:23.743 | INFO | main:main:152 - potato=======p_pro: 95.48 2024-03-01 15:46:23.743 | INFO | main:main:152 - potato=======threshold: 0.51

2024-03-01 15:53:23.252 | INFO | main:main:152 - rope=======i_roc: 90.58 2024-03-01 15:53:23.252 | INFO | main:main:152 - rope=======p_roc: 99.53 2024-03-01 15:53:23.252 | INFO | main:main:152 - rope=======p_pro: 96.43 2024-03-01 15:53:23.252 | INFO | main:main:152 - rope=======threshold: 0.42

2024-03-01 15:59:01.165 | INFO | main:main:152 - tire=======i_roc: 67.63 2024-03-01 15:59:01.165 | INFO | main:main:152 - tire=======p_roc: 98.78 2024-03-01 15:59:01.165 | INFO | main:main:152 - tire=======p_pro: 94.89 2024-03-01 15:59:01.166 | INFO | main:main:152 - tire=======threshold: 0.59

这里训练50个epoch的mvtec3d 结果。请问i_roc的结果和您之前跑的差别大吗

[caoyunkang]

您好！结果看起来不太合理，并且aupro和文章报道结果有一定差距。请确认超参数是否为默认配置，以及检查在训练过程中，有无更优的epoch。我会在近期测试所公开的代码并确认性能。