Fix the hidden state norm stabilization code for PyTorch v0.3.1, and

carpedm20 / ENAS-pytorch

PyTorch implementation of "Efficient Neural Architecture Search via Parameters Sharing"

Apache License 2.0

2.69k stars 492 forks source link

Fix the hidden state norm stabilization code for PyTorch v0.3.1, and #10

Closed dukebw closed 6 years ago

dukebw commented 6 years ago

reduce the noise created by logging clipped hidden states.

Sorry, this fixes a few bugs that were still present after my last commit (adding PyTorch v0.3.1 compatibility). I've tested now for v0.4 and v0.3.1 and training seems to be working for both.

carpedm20 commented 6 years ago

Thanks for the fix 👍