Open Exorust opened 6 months ago
Issue is still open: https://github.com/huggingface/trl/issues/1409 It is shown here as well
Nothing? @loubnabnl any suggestions on how the default Finetuning script doesn't work out of the box?
If you change the requirements.txt to reference the latest version of trl this will work fine.
git+https://github.com/huggingface/transformers.git
accelerate==0.27.1
datasets>=2.16.1
bitsandbytes==0.41.3
peft==0.8.2
git+https://github.com/huggingface/trl.git
wandb==0.16.3
huggingface_hub==0.20.3
That should do it. I'm using Rye to install dependencies, but that change worked for me. Rye dependencies in pyproject.toml
looks like this...
dependencies = [
"transformers @ git+https://github.com/huggingface/transformers.git",
"accelerate==0.27.1",
"datasets>=2.16.1",
"bitsandbytes==0.41.3",
"peft==0.8.2",
"trl @ git+https://github.com/huggingface/trl.git",
"wandb==0.16.3",
"huggingface_hub==0.20.3",
]
Facing the following error while trying to finetune Starcoder2 with the given script.
Description:
For
transformers.AutoModelForCausalLM
to recognize Starcoder2transformers>4.39.0
is required.But
trl
is still usingtransformers==4.38.2
. Even if I compile from source & usetrl=0.7.12.dev0
I still get an issue.Here is the error with using
transformers==4.38.2
Here is the error when using
transformers==4.39.0