Hi! Thank you for your great work.
When I tried to replicate your work, I encountered the following problem.
Traceback (most recent call last):
File "train_base.py", line 320, in
main()
File "train_base.py", line 291, in main
logger.info('>>>>>>> ------------------- <<<<<<<')
File "/home2/hkz/nips24/POP-main/engine.py", line 137, in exit
torch.cuda.empty_cache()
File "/home/hkz/miniconda3/envs/pop2/lib/python3.6/site-packages/torch/cuda/memory.py", line 114, in empty_cache
torch._C._cuda_emptyCache()
RuntimeError: CUDA error: device-side assert triggered
Have you encountered similar problems in the course of training? If it's convenient, please let me know which GPU you're using. Thank you !!!
![Uploading 问题pop.jpg…]()
Hi! Thank you for your great work. When I tried to replicate your work, I encountered the following problem.
Traceback (most recent call last): File "train_base.py", line 320, in
main()
File "train_base.py", line 291, in main
logger.info('>>>>>>> ------------------- <<<<<<<')
File "/home2/hkz/nips24/POP-main/engine.py", line 137, in exit
torch.cuda.empty_cache()
File "/home/hkz/miniconda3/envs/pop2/lib/python3.6/site-packages/torch/cuda/memory.py", line 114, in empty_cache
torch._C._cuda_emptyCache()
RuntimeError: CUDA error: device-side assert triggered
Have you encountered similar problems in the course of training? If it's convenient, please let me know which GPU you're using. Thank you !!! ![Uploading 问题pop.jpg…]()