FluxML / Zygote.jl

21st century AD
https://fluxml.ai/Zygote.jl/
Other
1.48k stars 213 forks source link

Use ChainRules for Forward-mode #712

Open CarloLucibello opened 4 years ago

CarloLucibello commented 4 years ago

503 reintroduces DiffRules dependence. Can we use ChainRules instead? @oxinabox @MikeInnes

oxinabox commented 4 years ago

Yes, we can, and we should.

oxinabox commented 4 years ago

I believe @willtebbutt talked to @MikeInnes about it when #503 was openned.

willtebbutt commented 4 years ago

But yeah, it would definitely make sense to make the forwards-mode stuff in Zygote also depend on ChainRules... you'll get maintenance for free.

sethaxen commented 4 years ago

And we already have a decent number of frules that would instantly become available.