mbzuai-oryx / LLaVA-pp

🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
798 stars 58 forks source link

Saved weights during tuning with LoRA #26

Open fangruizhu opened 4 months ago

fangruizhu commented 4 months ago

Hi, thanks for the great work. I am using the code to finetune the Phi3 with LoRA. I have saved intermediate checkpoints. The weights are like this, which are not the same as the provided model. Is it because the new version of transformers? Is it okay to use for inference?

image

Thank you in advance:)