mosaicml / llm-foundry

LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.84k stars 503 forks source link

Add logging to convert_text_to_mds.py script #1243

Closed irenedea closed 1 month ago

irenedea commented 1 month ago

Adds logging to the script. We weren't configuring it previously, so no logs showed up 😛