search

taichi-dev / difftaichi

10 differentiable physical simulators built with Taichi differentiable programming (DiffTaichi, ICLR 2020)
2.47k stars 260 forks source link

loss become NAN with Taichi 0.4.0 #10

Closed SJHNJU closed 4 years ago

SJHNJU commented 4 years ago

I install taichi-nightly on OS X and try to run the demo: diffmpm.py, diffmpm3d.py, liquid.py.

However the loss become NAN on the second iteration.

WHY???

yuanming-hu commented 4 years ago

Hi, thanks for reporting. Which taichi version, device (CPU/GPU), and OS are you using?

SJHNJU commented 4 years ago

Thanks! The configurations are as follows: taichi-nightly (0.4.0) CPU MacOS Mojave(10.14.3)

yuanming-hu commented 4 years ago

Thank you. I can reproduce this on my end now. I'll fix it later. Please try Taichi v0.3.25 and see if it works for you.

yuanming-hu commented 4 years ago

Fixing related issues. Taichi v0.3.18 is the version that works.

yuanming-hu commented 4 years ago

Confirmed that the change between v0.3.23 and v0.3.24 introduced something that caused ill behavior in diffmpm.py

yuanming-hu commented 4 years ago

Update: this should be fixed in Taichi v0.4.1. Please update and let me know if your issue is resolved. Thanks so much for reporting!

SJHNJU commented 4 years ago

The issue is resolved, Great job!!! Lots of respect, Thank you!