🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
Install ibm-fms with -I, to ignore the version pre-installed, so that the package is installed from the main branch, which includes the py.typed file required for mypy testing.
Install ibm-fms with
-I, to ignore the version pre-installed, so that the package is installed from the main branch, which includes the py.typed file required for mypy testing.