Closed phamkhactu closed 11 months ago
Hey @phamkhactu, we'd love to help but there is a significant amount of code here.
Would you mind sharing a reproducible code example so that we may investigate the issue? Thanks!
Hi @LysandreJik
I will share with you about my task. I want to fine-tune llama2 with peft. when I load pretrain model from checkpoint line 610, I get error above.
With my task training, create some steps:
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
System Info
transformers: 4.32.0
Who can help?
No response
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
I have code:
I get errors:
I've search some issues like that, I found some issue relevant with version, I try another version from newest to 4.32. But all of us get same errors
Expected behavior
It runs okie