search

openvinotoolkit / mmdetection

OpenVINO Training Extensions Object Detection
https://github.com/opencv/openvino_training_extensions
Other
93 stars 31 forks source link

[NNCF] Filter pruning #318

Closed evgeniya-egupova closed 2 years ago

nervana-ff commented 2 years ago

Can one of the admins verify this patch?

druzhkov-paul commented 2 years ago

Just out of curiosity, what happens inside of this runner-hook-hookwrapper logic? Does accuracy aware runner modify the base LR regardless of what original LR updater tries to do?

evgeniya-egupova commented 2 years ago

Just out of curiosity, what happens inside of this runner-hook-hookwrapper logic? Does accuracy aware runner modify the base LR regardless of what original LR updater tries to do?

@druzhkov-paul Yes, every new iteration of accuracy aware pruning increases pruning rate and then fine-tunes the model to decide if accuracy criteria are met. So ,it is important to reset the lr scheduler state in order to increase the base learning rate.

alexsu52 commented 2 years ago

LGTM