search

mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.85k stars 504 forks source link

Add example eval scripts for dbrx PT sizes #1218

Closed aspfohl closed 1 month ago

aspfohl commented 1 month ago

Here's an example of how these work: eval-dbrx-U4Ew2U Docs to come in https://docs.mosaicml.com/projects/mcli/en/latest/ (will link PR)

b-chu commented 1 month ago

Also is there a good way to keep these yamls up to date with any changes we might make in PAPI in the future?

aspfohl commented 1 month ago

@b-chu

To reduce duplication, can we just have 1 yaml and put the model section of the different yamls into a README?

The goal was to make submitting eval yamls as easy as possible, ideally without modifying the checkpoint. See the mcli yaml in the docs here https://github.com/databricks-mosaic/mosaicml-cli/pull/1762