when I execute train.py as it mentioned in README.md, I met the problem in the topic[ RuntimeError: CUDA out of the memory. Tried to allocate 2.97GiB(GPU 0; 10.92GiB total capacity; 5.99GiB already allocated; 1.7GiB free; 8.63GiB resrved in total by Pytorch)]. Thougth I adjusted the configs[e.g.: bath size and feature dim] many times , but it didn't work.
Why does this model suddenly need so much memory in the middle of training？ could anyone give me a hand?
when I execute train.py as it mentioned in README.md, I met the problem in the topic[ RuntimeError: CUDA out of the memory. Tried to allocate 2.97GiB(GPU 0; 10.92GiB total capacity; 5.99GiB already allocated; 1.7GiB free; 8.63GiB resrved in total by Pytorch)]. Thougth I adjusted the configs[e.g.: bath size and feature dim] many times , but it didn't work. Why does this model suddenly need so much memory in the middle of training？ could anyone give me a hand?