search

mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.99k stars 525 forks source link

How to evaluate model using multi-gpu? #1541

Open lqniunjunlper opened 1 week ago

lqniunjunlper commented 1 week ago

When using llm-foundry for model evaluation, multi-gpu mode does not work.

The source code is here: https://github.com/mlfoundations/open_lm/blob/main/eval/eval_openlm_ckpt.py

dakinggg commented 2 days ago

The code you linked does not seem to have anything do with this repo. Could you please clarify?