hpcaitech / FastFold

Optimizing AlphaFold Training and Inference on GPU Clusters
Apache License 2.0
557 stars 86 forks source link

refactor chunk for training #117

Closed Gy-Lu closed 1 year ago

Gy-Lu commented 1 year ago

Our previous chunk code is based on inference, which means that no gradient and inplace is just ok.

However, in training, inplace is forbidden by Pytorch. And I made some modifications on chunk=None cases to avoid inplace.