foundation-model-stack / fms-hf-tuning

🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
Apache License 2.0
9 stars 30 forks source link

deps: cap transformers at 4.40.2 #218

Closed anhuong closed 3 days ago

anhuong commented 3 days ago

Description of the change

Due to performance degredation found in transformers 4.41 (see issue #201 ), pinning transformers at 4.40

Was the PR tested