search

mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.84k stars 503 forks source link

Fix MPT HF conversion #1257

Closed dakinggg closed 1 month ago

dakinggg commented 1 month ago

Adds a check to make sure files exist before trying to run conversion on them. This can occur if finetuning MPT with code that is on the HF hub.

Before: mpt-convert-1-zoYixY After: mpt-convert-2-hlVHYN