Heyo! This is a small functionality expansion to the new RBF layers, allowing for the optional normalization of RBF layer outputs. This is controlled by a boolean kwarg, normalize_output in the __init__ methods of the GaussianRBF and PolynomialCutoffRBF. If this option is set to True, the output of the that layer will be divided by the scalar sum of all the outputs of each basis function. By default, this option is set to False - I decided this default behavior because we have not normalized any RBF outputs in any of our models up to this point. Of course, if there is a better reason to make it True by default, we can discuss. Let me know if you see anything amiss or if you would like to add/change functionality!
Development:
[x] Add tests
Checks:
nosetests
Heyo! This is a small functionality expansion to the new RBF layers, allowing for the optional normalization of RBF layer outputs. This is controlled by a boolean kwarg,
normalize_output
in the__init__
methods of theGaussianRBF
andPolynomialCutoffRBF
. If this option is set toTrue
, the output of the that layer will be divided by the scalar sum of all the outputs of each basis function. By default, this option is set toFalse
- I decided this default behavior because we have not normalized any RBF outputs in any of our models up to this point. Of course, if there is a better reason to make itTrue
by default, we can discuss. Let me know if you see anything amiss or if you would like to add/change functionality!