Closed bvdmitri closed 4 months ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 99.00%. Comparing base (
c508a74
) to head (4ee04a4
).
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
I'll work on the documentation tomorrow
@Nimrais you fine merging this?
This PR adds a special bounded direction update rule that bounds the norm (manifold-specific) of a gradient with a pre-specified value. That should help with numerical stability for case where we encounter huge gradients.