Open pchanial opened 12 years ago
We could implement it like this :
The chain rule also apply in higher dimensions [1]. Interestingly the derivative of Ax is A^T [2] I think this gives us all we need to implement automatic differentiation in a way that allow the definition of criterions as Operators.
[1] http://en.wikipedia.org/wiki/Chain_rule#The_chain_rule_in_higher_dimensions [2] http://en.wikipedia.org/wiki/Matrix_calculus
Use derivation rules to deduce the derivates of an operator.