lora finetune multilingual version

[BaoyanWang]

hello sir, what language model did you use in the released multilingual version? I saw that the downloaded one is mplug-owl-bloomz-7b-multilingual. Do you need to modify your Lora fine-tuning code accordingly?

[MAGAer13]

The bloomz-7b, you should modify the lora layer key (q_proj and v_proj) with query_key_value.