How to save pretrained weights

[lurauch]

• load_state_dict vs. checkpoint vs. huggingface model
• idea: 1. Step: state_dict 2.Step: Upload to huggingface
• state_dicts auf hf

[lurauch]

via huggingface

[lurauch]

• project internally: via wandb (and state_dicts?)
• finished models on huggingface (link to wandb)