search

foundation-model-stack / fms-hf-tuning

🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
Apache License 2.0
28 stars 48 forks source link

docs: Add findings from exploration into model tuning performance degradation #315

Closed willmj closed 3 months ago

willmj commented 3 months ago

Description of the change

Add our findings from exploration into performance degradation. If anything else needs to be added or expanded upon, let me know!