Open CreaterLL opened 2 years ago
Hi, thanks for your question. Although drop_out leads to improvement, it also causes a unstable training, you can reduce the learning rate or drop_out ratio. drop_out ratio setting to 0 can make the model training more stable, but also sacrifices some improvement. Feel free to post any further questions.
Thank you for your instructions,i 'll have a try later.
Hi,i'm very interested in your resaerch ,but when i try to reproduce the results in the thesis,i encountered a irregular phenomenon as follows:
i'm confuesed with the "loss=nan" there are any instructions for me? thank you!