Add option not to remove tmp directory when doing `convert_olmo_to_hf_new.py`

allenai / OLMo

Modeling, training, eval, and inference code for OLMo

https://allenai.org/olmo

Apache License 2.0

4.37k stars 431 forks source link

Closed dwadden closed 1 month ago

dwadden commented 1 month ago

Attempting to remove it causes an error when using NFS.

dwadden commented 1 month ago

I'll split this out into 2 separate PR's and do again.