Could not find the transformer layer class to wrap in the model.

lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Apache License 2.0

35.53k stars 4.36k forks source link

Could not find the transformer layer class to wrap in the model. #3400

Open Jerry-hyl opened 2 weeks ago

Jerry-hyl commented 2 weeks ago

When I use training code to finetune mistral-7b,I have met the exception like "Could not find the transformer layer class to wrap in the model.". How can I fix it?