Add Recompute Feature in Model training

BR-IDL / PaddleViT

:robot: PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+

https://github.com/BR-IDL/PaddleViT

Apache License 2.0

1.22k stars 318 forks source link

Add Recompute Feature in Model training #86

Open xperzy opened 2 years ago

xperzy commented 2 years ago

Describe your feature request Add recompute for dygraph model training, which aims enlarge the batchsize during the training by free intermediate memories.

Describe the reference code or paper N/A

@jarygrace Let's add this feature asap, thanks!