ThoughtWorksInc / DeepDarkFantasy

A Programming Language for Deep Learning
Apache License 2.0
462 stars 47 forks source link

Internalize the diff operator #140

Closed MarisaKirisame closed 5 years ago

MarisaKirisame commented 7 years ago

Proof http://www-bcl.cs.may.ie/~barak/papers/HOSC-forward-nesting.pdf wrong! The trick is simple: have something that carry the code/thunk that can infinitely differentiate around Write some helper to ease the use of such thing will be good.

MarisaKirisame commented 7 years ago

Very fucking simple indeed. Solved in ff6aa401360bee9702a4162c968d79e7aae7a51b

MarisaKirisame commented 7 years ago

Not done yet. Cannot create any InfDiff Double except literal.

MarisaKirisame commented 7 years ago

Should better not close it until we have example.