FluxML / Optimisers.jl

Optimisers.jl defines many standard optimisers and utilities for learning loops.
https://fluxml.ai/Optimisers.jl
MIT License
72 stars 20 forks source link

Update Optimisers.jl #147

Closed 4SAnalyticsnModelling closed 1 year ago

4SAnalyticsnModelling commented 1 year ago

Add a new variant of Adam optimizer called "PAdam"

[Please delete this text and describe your change here. For bugfixes, please detail the bug and include a test case which your patch fixes. If you are adding a new feature, please clearly describe the design, its rationale, the possible alternatives considered. It is easiest to merge new features when there is clear precedent in other systems; we need to know we're taking the right direction since it can be hard to change later.]

PR Checklist