wenet-e2e / wenet

Production First and Production Ready End-to-End Speech Recognition Toolkit
https://wenet-e2e.github.io/wenet/
Apache License 2.0
3.87k stars 1.04k forks source link

[transformer] set use_reentrant=False for gradient ckpt #2491

Closed xingchensong closed 2 months ago

xingchensong commented 2 months ago

According to pytorch API: https://pytorch.org/docs/stable/checkpoint.html

It is recommended to use use_reentrant=False.

image