Closed sdobber closed 2 years ago
Change ADAM to Adam, replace Flux.Zygote.@nograd with Flux.ChainRulesCore.@non_differentiable, and update the examples with
ADAM
Adam
Flux.Zygote.@nograd
Flux.ChainRulesCore.@non_differentiable
Flux.ChainRulesCore.ignore_derivatives() do Flux.reset!(model) end
to avoid errors coming from differentiating through the reset!-call.
reset!
Change
ADAM
toAdam
, replaceFlux.Zygote.@nograd
withFlux.ChainRulesCore.@non_differentiable
, and update the examples withto avoid errors coming from differentiating through the
reset!
-call.