openvinotoolkit / anomalib

An anomaly detection library comprising state-of-the-art algorithms and features such as experiment management, hyper-parameter optimization, and edge inference.
https://anomalib.readthedocs.io/en/latest/
Apache License 2.0
3.63k stars 646 forks source link

[Bug]: Question about PaDiM model validation and testing #2199

Open junhhaha opened 1 month ago

junhhaha commented 1 month ago

Describe the bug

Does PaDiM model require validation and testing? notebooks/500_use_cases/501_dobot/501a_training_a_model_with_cubes_from_a_robotic_arm.ipynb when I see the above example code, they validate with the model using the testing function. My understanding is PaDiM model does not require validation. Just need to train the model and test the performance with metrics.

But when I use the PaDiM model with a custom dataset, the default setting automatically splits the normal dataset for validation and testing the dataset. (These three: test_split_ratio, val_split_ratio, and noraml_split_ratio and I try not to allocate normal images to the validation dataset, model training does not work.

Thank you!

Dataset

N/A

Model

N/A

Steps to reproduce the behavior

na

OS information

OS information: na

Expected behavior

na

Screenshots

No response

Pip/GitHub

pip

What version/branch did you use?

No response

Configuration YAML

na

Logs

na

Code of Conduct

hrudaykolla commented 1 month ago

yes I have the same issue, I want to use all my images for training and test on images later