search

foundation-model-stack / fms-fsdp

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
https://pytorch.org/docs/stable/fsdp.html
Apache License 2.0
114 stars 18 forks source link

fix: Correct the typo #96

Open Akash-Nayak opened 1 week ago

Akash-Nayak commented 1 week ago

Signed-off-by: Akash Nayak akash19nayak@gmail.com