mila-iqia / blocks-examples

Examples and scripts using Blocks
MIT License
147 stars 94 forks source link

NaN occurred, how to monitor the auxiliary variables? #84

Closed Beronx86 closed 8 years ago

Beronx86 commented 8 years ago

My program raise NaN error after several iterations. I want to monitor the automatically added auxiliary variables (W_norm and b_norm). I use TrainingDataMonitoring(fg.auxiliary_variables, after_batch=True). But the program raise ValueError: variables should have different names! Duplicates: W_norm, b_norm. My model is a multiple layer neural network. So, there are duplicate auxiliary variable names. What should I do to monitor these variables? Besides how to monitor the gradient?