ServiceNow / Fast-LLM

Accelerating your LLM training to full speed
https://servicenow.github.io/Fast-LLM/
Other
38 stars 5 forks source link

Better checkpoints #6

Closed jlamypoirier closed 1 month ago

jlamypoirier commented 1 month ago

RENAME[BW COMPATIBLE] pretrained.imported_type ->pretrained.model_type RENAME[BW COMPATIBLE] pretrained.load_weights -> pretrained.model_weights RENAME[BW COMPATIBLE] pretrained.load_optimizer -> pretrained.optimizer_state MERGE (pretrained.override_architecture, pretrained.load_full_base_model_config, pretrained.load_full_fast_llm_config) ->pretrained.load_config:enum