InternLM / InternLM-XComposer

InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.
1.91k stars 120 forks source link

Minimum GPU requirement for finetuning InternLM-XComposer2-4KHD-7B #316

Open babla9 opened 1 month ago

babla9 commented 1 month ago

Thanks for your work! Whats the minimum GPU memory required for fine-tuning InternLM-XComposer2-4KHD-7B with and without lora? Would 4x V100 be sufficient?