How much VRAM is needed to finetune co_dino_5scale_vit_large_coco?

Sense-X / Co-DETR

[ICCV 2023] DETRs with Collaborative Hybrid Assignments Training

MIT License

969 stars 105 forks source link

How much VRAM is needed to finetune co_dino_5scale_vit_large_coco? #167

Open hee-dongdong opened 4 days ago

hee-dongdong commented 4 days ago

I have 6 4090 GPUs (VRAM = 120GB). However, when I try to finetune the model, it shows "CUDA out of memory" error. How much VRAM is needed to train the ViT backbone model? I want to know how many GPUs you had when you pretrain the model.