Improve error logging / checkpointing even further.

mlfoundations / open_lm

A repository for research on medium sized language models.

MIT License

320 stars 41 forks source link

Closed GeorgiosSmyrnis closed 2 weeks ago

GeorgiosSmyrnis commented 2 weeks ago

Further improve error logging, and also save "bad" checkpoints with fewer data seen than expected.