hpcaitech / FastFold

Optimizing AlphaFold Training and Inference on GPU Clusters
Apache License 2.0
557 stars 86 forks source link

fix distributed sampler for ddp and add dap #141

Closed Gy-Lu closed 1 year ago

Gy-Lu commented 1 year ago

This pr contains 2 parts:

  1. Add distributed sampler for ddp, which ensures every ddp group getting different data.
  2. Add DAP for training. Unit test is not ready for now.