git-cloner / llama-lora-fine-tuning

llama fine-tuning with lora
https://gitclone.com/aiit/chat/
MIT License
136 stars 14 forks source link

Do the fine tuning and seting --model_max_length 2048 issue #10

Open JustinZou1 opened 1 year ago

JustinZou1 commented 1 year ago
1687406909426 1687406936516

Token indices sequence length is longer than the specified maximum sequence length for this model (2189 > 2048). Running this sequence through the model will result in indexing errors

little51 commented 1 year ago

https://github.com/git-cloner/llama-lora-fine-tuning/issues/3 just a warnning