mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.83k stars 502 forks source link

Refactor hf checkpointer for config transformations #1318

Closed irenedea closed 4 days ago

irenedea commented 5 days ago

Subclasses can now easily extend the config transformations by overriding the transform_config method.