Support `Zygote.forwarddiff` & `Zygote.checkpointed`

SciML / ADTypes.jl

Repository for automatic differentiation backend types

https://sciml.github.io/ADTypes.jl/

MIT License

28 stars 11 forks source link

Support `Zygote.forwarddiff` & `Zygote.checkpointed` #17

Open prbzrg opened 10 months ago

prbzrg commented 10 months ago

Hi, I have a question, do we need to support Zygote.forwarddiff? What about Zygote.checkpointed? I think, there can be parameters of AutoZygote to activate them.

gdalle commented 2 months ago

Supporting Zygote.forwarddiff seems weird to me, because if you really need to differentiate a function with ForwardDiff.jl you will use AutoForwardDiff
Supporting Zygote.checkpointed seems reasonable, and it could be a field checkpointed::Bool of AutoZygote in the same way that e.g. AutoReverseDiff has compile::Bool. A type parameter would seem more type-stable, but given how unstable Zygote.jl itself is, I don't know if it matters. @Vaibhavdixit02, any idea?