Closed howardgriffin closed 1 year ago
When I run ‘python sft_test.py’, I encountered this promblem. Any suggestions to solve this problem?
Could you provide the library versions you are using (such as transformers, x_transformers) ?
Could you provide the library versions you are using (such as transformers, x_transformers) ?
Here is my 'transformers' and 'x-transformers' library version of my environment: transformers 4.26.0 x-transformers 1.10.0
I guess maybe there is some library mismatching problem. As a result, the parameters in our checkpoint have different names with parameters of model you initialized (with another version of library).
I think you can print the name of parameters from checkpoint and model you initialized, compare them and manually change the names, then load the parameters.
Or you can install the version provided in our requirements.txt (create a new environment so that it won't influence your other projects).
Thank you for your reply, I will have a try.
I guess maybe there is some library mismatching problem. As a result, the parameters in our checkpoint have different names with parameters of model you initialized (with another version of library).
I think you can print the name of parameters from checkpoint and model you initialized, compare them and manually change the names, then load the parameters.
Or you can install the version provided in our requirements.txt (create a new environment so that it won't influence your other projects).
I change the the version of 'x_transformers' following your requirements, everything goes ok.