Open multinegsix opened 7 years ago
Unfortunately there's no good reference that covers the graph-based autodiff used in modern software. I recommend the book Evaluating Derivatives by Griewank, which covers reverse-mode autodiff. Also read up on Single Statement Assignment.
I am interested in the theory behind computation graph, but cannot find comprehensive material for it. Can someone please share some key papers or lecture notes for computation graph?