search

Haochen-Luo / CroPA

19 stars 2 forks source link

Can train in RTX 4090？ #4

Open ranck626 opened 1 month ago

ranck626 commented 1 month ago

I don't have a GPU with over 45GB.

ranck626 commented 3 weeks ago

or why need such large graphics memory？

Haochen-Luo commented 3 weeks ago

Loading VLMs requires large memory. Another way to try is to load the model with multiple cards.

ranck626 commented 2 weeks ago

If I switch to blip, I can reduce the video memory footprint.？ Is “Pretrained perturbation” only for flamingo？

Haochen-Luo commented 2 weeks ago
  1. Yes, BLIP-2 requires less memory compared to OF.
  2. Yes, the pre-trained perturbation is only for OF.