Sparsity and Decay Penalties

dfdx / Boltzmann.jl

Restricted Boltzmann Machines in Julia

Other

67 stars 27 forks source link

Closed rofinn closed 8 years ago

rofinn commented 8 years ago

Added some simple penalties terms to subtract from dW in update_weights!.

decay - cost * W
sparsity - cost * (actual_mean_hidden_activation - expected_mean_hidden_activation). Only works for binary hidden units