Error when loading model

artidoro / qlora

QLoRA: Efficient Finetuning of Quantized LLMs

https://arxiv.org/abs/2305.14314

MIT License

10.06k stars 822 forks source link

Error when loading model #292

Open m000lie opened 6 months ago

m000lie commented 6 months ago

hello, i am constantly getting this error:

TypeError: not a string

This occurs whenever i load a model.

praful-1812 commented 4 months ago

Getting same error while finetuning LlaMa3 8b model

Entretoize commented 3 months ago

Any update, did you find a solution ?

LiMa-cas commented 1 month ago

thanks in advance，Hi i have a question about the model. So in your script I see u use the FP16 model instead of INT4 model, could qlora use the quantizationed model (like gptq mode?) to finetune?