GPU0 is using much memory 0.0

threestudio-project / threestudio

A unified framework for 3D content generation.

Apache License 2.0

6.32k stars 480 forks source link

GPU0 is using much memory 0.0 #239

Closed jiarenyf closed 1 year ago

jiarenyf commented 1 year ago

How to fix, help, please !

thuliu-yt16 commented 1 year ago

What is your running command?

jiarenyf commented 1 year ago

python3 launch.py --train --config config/prolificdreamer-scene.yaml --gpu 0,1,2,3,4,5,6,7 system.prompt_processor.prompt="Inside of a smart home, realistic detailed photo, 4k" data.n_val_views=8

@thuliu-yt16

thuliu-yt16 commented 1 year ago

The first GPU computes the text embedding in a spawned thread before optimization and then releases it. Did you observe the memory usage keep high or not? If you run the same command twice, what about the memory usage in the second run?