Open newledge opened 1 year ago
+1
GPU有人占着,等没人用的时候再跑,或者GPU太小了不够用26>23:Tried to allocate 26.05 GiB ,23.70 GiB total capacity;
You either need to reduce de batch size or the number of worker or any other parameter that might be causing such an issue...
RuntimeError: CUDA out of memory. Tried to allocate 26.05 GiB (GPU 0; 23.70 GiB total capacity; 479.50 MiB already allocated; 21.04 GiB free; 502.00 MiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF