search

wengzejia1 / Open-VCLIP

104 stars 3 forks source link

About training cost #8

Closed zyuhan1999 closed 10 months ago

zyuhan1999 commented 11 months ago

Hi! @wengzejia1

Could you please provide the memory requirement per GPU and estimated training time for Open-VCLIP on the K400?

Thanks!

wengzejia1 commented 10 months ago

Hi, I run Open-VCLIP B/16 on 8 * 32GB V100, and it takes about one day.

If your GPU memory is not enough, you can employ checkpointing techniques by configuring the settings to "MODEL.USE_CHECKPOINT True" and "MODEL.STATIC_GRAPH True," as demonstrated in the script located at "script/training/temporal_l14/train_tclipl14_interpolation_0.0-0.6_ratio0.5.sh".

It's worth noting that this approach may extend the overall training time.

zyuhan1999 commented 10 months ago

Hi, I run Open-VCLIP B/16 on 8 * 32GB V100, and it takes about one day.

If your GPU memory is not enough, you can employ checkpointing techniques by configuring the settings to "MODEL.USE_CHECKPOINT True" and "MODEL.STATIC_GRAPH True," as demonstrated in the script located at "script/training/temporal_l14/train_tclipl14_interpolation_0.0-0.6_ratio0.5.sh".

It's worth noting that this approach may extend the overall training time.

Thanks a lot :)