search

AttentionX / InstructBLIP_PEFT

Apache License 2.0
29 stars 4 forks source link

What is the minimum GPU requirement for training? #1

Open iamwangyabin opened 10 months ago

waitzkin commented 9 months ago

Hello, I apologize for the delayed response. For training models with Vicuna-7B, a GPU with VRAM greater than 24GB is required. For training models with FlanT5-XL, a GPU with 24GB VRAM is sufficient.

llv22 commented 8 months ago

@waitzkin thanks for your great work. I have 4 * A6000 (49G) machine, is it enough to train Vicuna-7B? I'm not sure if it's needed to explicitly split model to different GPU. Thanks for your clarification in advance. What's the memory size of your A100, 80G or 90G? how about is its memory consumption?

waitzkin commented 8 months ago

It was about 40G, so single A1000 machine will be enough to train models with Vicuna-7B.

llv22 commented 8 months ago

@waitzkin thanks a lot for your response ^-^. Will try