Support FSDP/DeepSpeed via Fabric or Accelerate?

IDEA-Research / detrex

detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.

https://detrex.readthedocs.io/en/latest/

Apache License 2.0

1.9k stars 199 forks source link

Support FSDP/DeepSpeed via Fabric or Accelerate? #310

Open hiyyg opened 9 months ago

hiyyg commented 9 months ago

I have successfully integrated fabric into this framework with just a few lines of change. It is very powerful!

Hope this can be supported officially.

rentainhe commented 9 months ago

I have successfully integrated fabric into this framework with just a few lines of change. It is very powerful!

Hope this can be supported officially.

Thanks for your nice advice!!! Would you like to propose a pull request for this function, we really appreciate it and will merge it into our official code! @hiyyg