Hardware Requirement for the model to run in LORA

PKU-YuanGroup / Video-LLaVA

【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

https://arxiv.org/pdf/2311.10122.pdf

Apache License 2.0

3.03k stars 220 forks source link

Hardware Requirement for the model to run in LORA #194

Open leochang123 opened 1 month ago

leochang123 commented 1 month ago

我想知道Video-LLaVA透過LORA進行訓練，所需的最低GPU內存大概是多少?

I would like to know the minimum GPU memory requirements needed to effectively run this model in a LoRA setup.

Could anyone share their experiences or insights regarding the necessary GPU memory for this configuration? Any recommendations would be greatly appreciated!

Thank you!