Open FORRYKIM opened 6 months ago
Thank you for your comment. As described in equation 13, we restrict the $\bar{\delta}{k}^{(l)}$ and $\bar{\zeta}{k}^{(l)}$ to control the injected perturbation in the model weight, which is the absolute size of perturbation.
When I looked at the ANP code, I found that the input perturbation_budget seems to be limiting the range of parameters for the batch normalization layer. For example, if perturbation_budget=4, the range of parameters before the limit is not greater than -4 to 4. How does the absolute size of perturbation described in the paper manifest?