search

XtractOpen / Meganet.jl

A fresh approach to deep learning written in Julia
http://www.xtract.ai/
Other
14 stars 9 forks source link

Replace kronecker products with functions in Connector #70

Open klensink opened 6 years ago

klensink commented 6 years ago

Replacing the kronecker products with functions offers much greater performance and doesn't require us to store huge dense arrays. This PR is backwards compatible, so the kronecker products will still work if people want to use them.

Forward Benchmark:

BenchmarkTools.TrialJudgement: 
  time:   -85.87% => improvement (5.00% tolerance)
  memory: +0.00% => invariant (1.00% tolerance)

Adjoint Benchmark:

BenchmarkTools.TrialJudgement: 
  time:   -97.05% => improvement (5.00% tolerance)
  memory: +0.78% => invariant (1.00% tolerance)