Hi, authors. I am trying to use your framework for scene graph generation(python3 train.py --config configs/scene_2d.yaml --cuda_visible_device 0 --nproc_per_node 1 -b 6), I find that the graphics memory keeps changing during training. I tried to remove gc.collect() and torch.cuda.empty_cache(), but it didn't work. Is there any way to fix the graphics memory? Thanks.
Hi, authors. I am trying to use your framework for scene graph generation(
python3 train.py --config configs/scene_2d.yaml --cuda_visible_device 0 --nproc_per_node 1 -b 6), I find that the graphics memory keeps changing during training. I tried to removegc.collect()andtorch.cuda.empty_cache(), but it didn't work. Is there any way to fix the graphics memory? Thanks.