search

foundation-model-stack / fms-fsdp

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
https://pytorch.org/docs/stable/fsdp.html
Apache License 2.0
116 stars 18 forks source link

move scripts to scripts folder #2

Closed lchu-ibm closed 5 months ago

lchu-ibm commented 5 months ago

Moved scripts to scripts/ folder.

Current way to call would be, e.g. sbatch scripts/train.slurm in the root repo folder.

We can relax the job-submission folder constraints in the future by make it install-able.

lchu-ibm commented 5 months ago

@nairbv I will do that once we make the repo install-able (if we decide to do that), otherwise moving it around will break many places as currently it relies on relative import and relative job submission.