search

mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.99k stars 525 forks source link

Dbfs HF #1214

Closed KuuCi closed 3 months ago

KuuCi commented 4 months ago

This PR is to allow DBFS UC_Volume paths to be set in the hf_name and properly link the datasource in MLFlow

https://github.com/mosaicml/llm-foundry/pull/1142 Was hitting git issues so making new PR

https://dbc-04ac0685-8857.staging.cloud.databricks.com/ml/experiments/974778159721961/runs/c716ca6ae01045638f4aea44340e2e0b?o=3360802220363900

KuuCi commented 4 months ago

https://dbc-04ac0685-8857.staging.cloud.databricks.com/ml/experiments/974778159721961/runs/910967976f4d4914b0422e38b587e9b3?o=3360802220363900

KuuCi commented 4 months ago

https://dbc-04ac0685-8857.staging.cloud.databricks.com/ml/experiments/974778159721961/runs/36fb3460756e46b6a4c59923b170e7e1?o=3360802220363900

irenedea commented 4 months ago

@KuuCi could you add a more descriptive PR title?