Warmstart checkpoints have correct amount of steps but wrong amount of tokens

Modalities / modalities

Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.

MIT License

63 stars 8 forks source link

Closed fromm-m closed 1 month ago

fromm-m commented 2 months ago

main - tag: 808dfa0ffa39a2248eb8f58ffbb0b45ec1327f90