Found invalid values tensor NaN during training period of DECI model.

microsoft / causica

MIT License

442 stars 55 forks source link

Found invalid values tensor NaN during training period of DECI model. #62

Open irmathebest opened 1 year ago

irmathebest commented 1 year ago

I used DECI so train a model,the train dimension is 8500*44. In Epoch 1878, the model pops up this error: Here is the config of the model: The problem appears the major time. If you could help me to resolve that issue, that would be great. Thanks!

confoundry commented 1 year ago

Can you share the training curves?