search

mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.83k stars 502 forks source link

Relax hf hub pin #1314

Closed dakinggg closed 2 days ago

dakinggg commented 6 days ago

Update the HF hub pin to allow 0.23 with its breaking changes.

snapshot_download now downloads a few extra files for caching, so this PR permits those files.

Manual test 1, dataset from the hub: hf-hub-bump-2-tYn8Hn Manual test 2, direct jsonl dataset: hf-hub-bump-jsonl-2-eGfVnE