yxli2123 / LoftQ

MIT License
180 stars 15 forks source link

The issue of rank not being able to change #35

Open Rain-yj opened 5 days ago

Rain-yj commented 5 days ago

Why did I change the model-args. rank to 32 when training llama-7b on the gsm8k task, but the lora rank of the model I printed is still 64

image

Rain-yj commented 5 days ago

image image I changed both places to 32, but the printed ones are still 64