search

mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.83k stars 502 forks source link

Fix grad accum typing #1296

Closed dakinggg closed 1 week ago

dakinggg commented 1 week ago

Fixes the typing on the config. It wasn't causing any errors because its just for logging, but it was getting incorrectly cast to a string.