RuntimeError: CUDA out of memory

neurosim / DNN_NeuroSim_V1.3

Benchmark framework of compute-in-memory based accelerators for deep neural network (inference engine focused)

62 stars 36 forks source link

RuntimeError: CUDA out of memory #28

Closed Gaurav5566 closed 2 years ago

Gaurav5566 commented 2 years ago

I am getting the following error. Anyone having any solution.

remainderQ = (upper-lower)(remainder-0)+(cellRange-1)lower # weight cannot map to 0, but to Gmin RuntimeError: CUDA out of memory. Tried to allocate 1.12 MiB (GPU 0; 22.37 GiB total capacity; 15.87 GiB already allocated; 3.56 MiB free; 787.74 MiB cached)

Thanks

neurosim commented 2 years ago

Hi! You could try to reduce the batch size to fit the GPU capacity.