search

Meituan-AutoML / MobileVLM

Strong and Open Vision Language Assistant for Mobile Devices
Apache License 2.0
890 stars 64 forks source link

CUDA out of memory #38

Open qazzombie opened 4 months ago

qazzombie commented 4 months ago

我在A800上，设置batchsize=1,为啥还会oom呀

ghoshaw commented 4 months ago

同问，训练mobilellama的sft需要多大显存？

miraclewkf commented 3 months ago

我在A800上，设置batchsize=1,为啥还会oom呀

请问你解决问题了吗？

wyddmw commented 3 months ago

I met the same problem on a 40G A100 GPU. Waiting for feedback.