The performance of using 4-shot or 8-shot on the Visa dataset is similar to that of 2-shot

mala-lab / InCTRL

Official implementation of CVPR'24 paper 'Toward Generalist Anomaly Detection via In-context Residual Learning with Few-shot Sample Prompts'.

Apache License 2.0

83 stars 12 forks source link

The performance of using 4-shot or 8-shot on the Visa dataset is similar to that of 2-shot #12

Closed guangpintao closed 1 week ago

guangpintao commented 2 months ago

Hello, I validated the 8-shot performance using the provided pre-trained model and few shot samples, and the results were similar to 2-shot, not as high as mentioned in the paper. I did the following: (1) checkpoints/8/checkpoint.pyth modified TEST CHECKPOINT-FILE-PATH (2) changed/fs_samples/visa/2/in the provided test command to/fs_samples/visa/8/， results are as follows:

Did I miss any operational steps？

Qi-Ran commented 2 months ago

您好，训练的命令时要一个类别一个类别的训练吗？

REDriver2023 commented 2 months ago

Hello, I validated the 8-shot performance using the provided pre-trained model and few shot samples, and the results were similar to 2-shot, not as high as mentioned in the paper. I did the following: (1) checkpoints/8/checkpoint.pyth modified TEST CHECKPOINT-FILE-PATH (2) changed/fs_samples/visa/2/in the provided test command to/fs_samples/visa/8/， results are as follows: Did I miss any operational steps？

I also checked the performance on my device, my result is similar as stated in the paper. Here is my result: