mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.84k stars 503 forks source link

Make expandable segments on by default #1278

Closed b-chu closed 3 weeks ago

b-chu commented 3 weeks ago

We almost always use expandable segments to help with memory issues