Closed rachtibat closed 3 years ago
Ahh, yes, I think the Parameter-less Flat-Rule makes sense.
Though I actually think the expected behavior of Flat would be, that it also works with Pooling Layers.
Maybe getting rid of the [None]-behavior, but instead also allowing non-existent parameters in mod_params
might be a better approach, then we would not need an additional rule.
I will think about how to modify mod_params
. Maybe a flag to ignore non-existent weights/biases might be beneficial, instead of the 'None'-behavior.
Okay, I fixed this with #16 . Could you try it out and see whether it works for you?
Hi,
yes, now it's working! Good idea to add more control so that the user can choose which parameters to modify.
Thanks
Hi Chris,
I am defining a new composite for instance:
The problem is, that the Flat() rule changes the parameter of a layer and the pooling layers do not define the "weight" parameter. As a consequence, there will be a RuntimeError saying, that zennit tries to access the parameter "weight" which is not available. The solution would be to define a new rule that does not have a param_modifier, for instance:
What do you think?
Best