foundation-model-stack / fms-fsdp

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
https://pytorch.org/docs/stable/fsdp.html
Apache License 2.0
162 stars 27 forks source link

setup.py to install so we can add tests and move scripts #17

Closed nairbv closed 7 months ago

nairbv commented 7 months ago

a setup.py should make it easier to have a tests or scripts directory