Closed Rain-yj closed 2 months ago
Hello! I'm facing a similar issue as well. adapter can't use on base model after training, and the error always shows size mismatch info from PeftModelForCausalLM I am using LoftQ/Llama-2-7b-hf-4bit-64rank, Is there any solution to this? Thank you!
Hello! I'm facing a similar issue as well. adapter can't use on base model after training, and the error always shows size mismatch info from PeftModelForCausalLM I am using LoftQ/Llama-2-7b-hf-4bit-64rank, Is there any solution to this? Thank you!