normal-computing / posteriors

Uncertainty quantification with PyTorch
https://normal-computing.github.io/posteriors/
Apache License 2.0
282 stars 12 forks source link

Add sigma to SGHMC and SGNHT #90

Closed SamDuffield closed 1 month ago

SamDuffield commented 1 month ago

Adds a sigma parameter for the momenta target distribution of SGHMC and SGNHT. This is needed to get an equivalence with SGD+momenta when setting temperature=0 as SGD+momenta has three tuning parameters (lr, momentum, dampening) assuming no weight decay.