ServiceNow / Fast-LLM

Accelerating your LLM training to full speed
https://servicenow.github.io/Fast-LLM/
Other
37 stars 5 forks source link

Checkpoint format #31

Closed jlamypoirier closed 3 weeks ago

jlamypoirier commented 3 weeks ago

āœØ Description

Add a CheckpointFormat class hierarchy to make the properties of the various checkpoint formats more understandable, and accessible at config validation time.

Also rename Converter -> CheckpointHandler

There shouldn't be any user-facing change here, they will be for future PRs [edit: accidently set the default export format to state dict, that was meant for next PR]

Extracted from #28 which was getting too big.

šŸ” Type of change

Select all that apply: