Modalities / modalities

Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.
MIT License
61 stars 5 forks source link

fix: improved readability by printing only on rank_0 #201

Closed fromm-m closed 2 months ago

fromm-m commented 2 months ago

What does this PR do?

This PR improves logging on large scale distributed training by only printing on rank_0

General Changes

Breaking Changes

Checklist before submitting final PR