search

openvinotoolkit / training_extensions

Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™
https://openvinotoolkit.github.io/training_extensions/
Apache License 2.0
1.13k stars 436 forks source link

Anomaly task training performance degradation for v2.0.0 #3592

Open yunchu opened 3 weeks ago

yunchu commented 3 weeks ago

Anomaly tasks in OTX2.0.0 show performance degradation compared to OTX1.5.2.

How to run the anomaly benchmark tests

pytest -vs tests/perf/test_anomaly.py --output-root benchmark_result --model-category all --data-root /path/to/val-data/v1 --eval-upto train --num-repeat 5

image-2024-04-09-16-28-24-336

chuneuny-emily commented 3 weeks ago

@ashwinvaidya17 - Please check about e2e time degradation.