Closed yunchu closed 1 week ago
Post-Training Quantization (PTQ) optimization applied to maskrcnn_swimt in the instance segmentation task may result in significantly reduced accuracy.
maskrcnn_swimt
How to run the ins_seg benchmark tests for OTX 2.0.0
pytest -vs tests/perf/test_instance_segmentation.py --output-root benchmark_otx_2.0.0_result --model-category all --data-root /path/to/val-data/v2 --eval-upto optimize --num-repeat 5
cc'ed @eugene123tw
Fixed in https://github.com/openvinotoolkit/training_extensions/pull/3685
This issue is expected to be addressed with an upgrade to OpenVINO and NNCF in a future release.
Fixed in https://github.com/openvinotoolkit/training_extensions/pull/3900
Post-Training Quantization (PTQ) optimization applied to
maskrcnn_swimt
in the instance segmentation task may result in significantly reduced accuracy.How to run the ins_seg benchmark tests for OTX 2.0.0