search

dfdx / Boltzmann.jl

Restricted Boltzmann Machines in Julia
Other
67 stars 27 forks source link

Fixed sparsity calculation for conditional rbm and several precision … #24

Closed rofinn closed 8 years ago

rofinn commented 8 years ago

…issues.

  1. In the sparsity calculation for conditional rbms hid_means takes just the visible input provided by split_vis(rbm, X).
  2. The gemm! calls in gradient_classic for the conditional weights weren't using the appropriate precision (ie: Float32 w/ sparsity)
  3. The free_energy function will often produces NaNs do to log(0) or lack of precision.
dfdx commented 8 years ago

Cool, thanks for fixes.