mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.83k stars 502 forks source link

Extra for serverless #1319

Closed XiaohanZhangCMU closed 4 days ago

XiaohanZhangCMU commented 4 days ago

Create a new extra deps which is the same as all-cpu except databricks-connect. This makes llmfoundry more flexible in use with applications running with databricks-connect, as the version mismatch usually leads to unexpected import errors.