about ctc cost nan and soaring avg_train_cost

watsonyanghx / CNN_LSTM_CTC_Tensorflow

CNN+LSTM+CTC based OCR implemented using tensorflow.

MIT License

362 stars 210 forks source link

about ctc cost nan and soaring avg_train_cost #9

Closed zzks closed 6 years ago

zzks commented 6 years ago

got ctc cost nan error after 30 epoch in chinese sentence ocr training... I can delay the error by smaller lr, bigger lr decay. But how to prevent ctc cost nan?