mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.99k stars 525 forks source link

Add fc to HF export #1209

Closed dakinggg closed 4 months ago

dakinggg commented 4 months ago

The HF export was missing the fc.py file and the associated register, so would result in an error when trying to load the HF exported model. This PR both fixes the issue, and adds a unit test that would've caught it, which requires clearing the registry for the unit test to simulate a fresh environment.

The move of MultiTokenEOSCriteria is just because Composer dev has removed that class, and it is now in foundry.