tbreloff / OnlineAI.jl

Machine learning for sequential/streaming data
Other
34 stars 10 forks source link

Automatic differentiation #2

Open Evizero opened 8 years ago

Evizero commented 8 years ago

A hot topic for neural networks is the use of automatic differentiation. I have seen the recent announcement of ForwardDiff which seems very promising in that regard. Might be worth considering for this package.

For example: Here is a discussion on the MachineLearning subreddit where that interest came up.

tbreloff commented 8 years ago

Yes nothing stopping auto diff as part of the framework... Should be no more than a short method or 2 to implement. Let me know if you have a specific cost function or activation that you're interested in... I might be able to help out.

On Sep 4, 2015, at 4:08 PM, Christof Stocker notifications@github.com wrote:

A hot topic for neural networks is the use of automatic differentiation. I have seen the recent announcement of ForwardDiff which seems very promising in that regard. Might be worth considering for this package.

For example: Here is a discussion on the MachineLearning subreddit where that interest came up.

— Reply to this email directly or view it on GitHub.