Regarding the VRAM usage of each GPU

Hon-Wong / Elysium

[ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM

https://hon-wong.github.io/Elysium/

59 stars 2 forks source link

Regarding the VRAM usage of each GPU #9

Closed zhaosonghui closed 3 months ago

zhaosonghui commented 3 months ago

This is a very valuable study! During the training process, how much VRAM does each A800 GPU approximately use? I would like to know if it is feasible to replicate the experiment using a 4090 (24GB) version of the GPU

Hon-Wong commented 3 months ago

We use A100-80G for training. You may need some tricks to run the experiment on 4090, e.g., lora, 8-bit, etc.