Shared weights should be initialized to first worker's params, not 0

mila-iqia / platoon

Multi-GPU mini-framework for Theano

MIT License

195 stars 41 forks source link

Shared weights should be initialized to first worker's params, not 0 #41

Closed lamblin closed 8 years ago

lamblin commented 8 years ago

Currently, the shared weights are initialized to zero, not to any worker's parameters, unless a worker explicitly sets them after initialization. We should do that automatically in Worker.init_shared_params.