Add retries to downloads in convert_text_to_mds.py

mosaicml / llm-foundry

LLM training code for Databricks foundation models

Apache License 2.0

3.99k stars 525 forks source link

Closed irenedea closed 4 months ago

irenedea commented 4 months ago

Add retries to downloads in convert_text_to_mds.py.

Test run: test-mds-conversion-TQ4LB3 confirmed still works

irenedea commented 4 months ago

@dakinggg Done, added to PR description