Open vavrines opened 4 years ago
Hi!
I believe this might be related to https://github.com/FluxML/Zygote.jl/issues/385 I don't think it's related to this package but rather the AD. Zygote is still very immature and anything but toy programs are likely to present some challenges when differentiating, especially for second order differentiation, where also the adjoint definitions need to be differentiable.
Hi Bagge,
I tried to use Zygote.jl with BFGS in Optim.jl, and the simplified codes write as push!(LOAD_PATH, "./FluxOptTools.jl/src/") # from FluxOptTools.jl on GitHub using Flux, FluxOptTools, Zygote, Optim, Random
I passed the optimization when using neural network itself, but failed while using its derivatives. The errors reported are as follows,
Do you have got any advice on how to fix it? Thanks : )