Encountered an issue while loading the model using transformers

jzhang38 / TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Apache License 2.0

7.7k stars 453 forks source link

Encountered an issue while loading the model using transformers #167

Open luiluizi opened 6 months ago

luiluizi commented 6 months ago

Use the loading model code provided by huggingface: I have encountered such a problem： May I ask what may be the reason for this? I am a beginner in large models

jzhang38 commented 6 months ago

You should probably upgrade your transformer version.