noelwelsh / fdl

Simple implementations of forward- and backward-mode automatic differentation in Scala
22 stars 1 forks source link

Functional Deep Learning

This repository contains simple implementations of forward- and backward-mode automatic differentiation, written in Scala, which is the core algorithm in deep learning. There are two goals to this code:

  1. demonstrate how automatic differentiation works (and hopefully show how simple it is); and
  2. show that the chain rule forms a monad (which I haven't been able to find mentioned in the literature).