mlfoundations / open_lm

A repository for research on medium sized language models.
MIT License
320 stars 41 forks source link

Reduce logging when --torchcompile is passed #261

Closed achalddave closed 1 month ago

achalddave commented 1 month ago

Currently, when we compile our models, there is a slew of logging messages from torch that make it hard to find potential errors and to read training logs reasonably. We should figure out how to disable these; likely the root cause is that we set the log level for the root logger to INFO in https://github.com/mlfoundations/open_lm/blob/main/open_lm/logger.py, and we should instead set the log level to WARN there, then use an openlm specific logger that's set to log at INFO.