search

InternLM / InternLM-XComposer

InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.
1.91k stars 120 forks source link

Lora微调4kHD模型需要的最小显存数？ #318

Open ZhuangPeiyu opened 1 month ago

ZhuangPeiyu commented 1 month ago

请问使用Lora微调4kHD的模型的时候，需要的最小显存是多少呢？单卡32G无法微调，hd_num按照官方代码设置-1.