Extend load plain Pytorch model functionality

Modalities / modalities

Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.

MIT License

61 stars 5 forks source link

Extend load plain Pytorch model functionality #82

Open lllAlexanderlll opened 7 months ago

lllAlexanderlll commented 7 months ago

Add implementation to modalities.src.modalities.checkpointing.checkpointing_execution.PytorchToDiscCheckpointing to support save, delete and load optimizer from plain (non-FSDP) checkpoints