OOM when finetune lora zero3 mPLUG-Owl2 on 4-A100-40g

X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

MIT License

2.25k stars 171 forks source link

Open NamiKaze7 opened 10 months ago

NamiKaze7 commented 10 months ago

Can I finetune_lora on 4-A100-40g? which parameter should I set

jhCOR commented 2 weeks ago

@NamiKaze7 Have you managed to solve the problem? same issue for me