We have an offline conversion script from composer to hf checkpoint format, but it only works for monolithic checkpoints, and has some other components hardcoded. We are also working on improved utilities for working with checkpoints in composer, but as a stopgap, we are introducing an arg here that will run train.py, but just call the hf checkpointer save and then exit.
Test run: just-hf-4-nWWD05 (and confirmed the checkpoint shows up in object store)
We have an offline conversion script from composer to hf checkpoint format, but it only works for monolithic checkpoints, and has some other components hardcoded. We are also working on improved utilities for working with checkpoints in composer, but as a stopgap, we are introducing an arg here that will run train.py, but just call the hf checkpointer save and then exit.
Test run:
just-hf-4-nWWD05(and confirmed the checkpoint shows up in object store)