foundation-model-stack / fms-hf-tuning

🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
Apache License 2.0
28 stars 48 forks source link

deps: Update transformers lower bound version #250

Closed Abhishek-TAMU closed 4 months ago

Abhishek-TAMU commented 4 months ago

Description of the change

set the transformers version greater than 4.41 as it may have severe performance degradation. (@Ssukriti) set upper limit of transformers to 5.0, and removing this version constraint (!=4.38.2)

Related issue number

Fix of #246

How to verify the PR

Was the PR tested

anhuong commented 4 months ago

@Abhishek-TAMU your commit history from this branch contains too many commits, this should only include the single commit with your change for the lower bound of teh transformers version