search

joschu / cgt

Computation Graph Toolkit
Other
628 stars 87 forks source link

Any reference to read? #69

Open multinegsix opened 7 years ago

multinegsix commented 7 years ago

I am interested in the theory behind computation graph, but cannot find comprehensive material for it. Can someone please share some key papers or lecture notes for computation graph?

joschu commented 7 years ago

Unfortunately there's no good reference that covers the graph-based autodiff used in modern software. I recommend the book Evaluating Derivatives by Griewank, which covers reverse-mode autodiff. Also read up on Single Statement Assignment.